-- Logs begin at Wed 2022-08-31 18:31:48 UTC, end at Wed 2022-08-31 19:35:37 UTC. -- Aug 31 19:03:22.436393 dv-cinder-852210-6-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 31 19:03:22.445243 dv-cinder-852210-6-smb devstack@keystone.service[81668]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 31 19:03:22.449227 dv-cinder-852210-6-smb devstack@keystone.service[81668]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 19:03:22 2022] *** Aug 31 19:03:22.449227 dv-cinder-852210-6-smb devstack@keystone.service[81668]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 19:03:22.449227 dv-cinder-852210-6-smb devstack@keystone.service[81668]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 19:03:22.449227 dv-cinder-852210-6-smb devstack@keystone.service[81668]: nodename: dv-cinder-852210-6-smb Aug 31 19:03:22.449227 dv-cinder-852210-6-smb devstack@keystone.service[81668]: machine: x86_64 Aug 31 19:03:22.449227 dv-cinder-852210-6-smb devstack@keystone.service[81668]: clock source: unix Aug 31 19:03:22.449227 dv-cinder-852210-6-smb devstack@keystone.service[81668]: pcre jit disabled Aug 31 19:03:22.449227 dv-cinder-852210-6-smb devstack@keystone.service[81668]: detected number of CPU cores: 4 Aug 31 19:03:22.449227 dv-cinder-852210-6-smb devstack@keystone.service[81668]: current working directory: / Aug 31 19:03:22.449227 dv-cinder-852210-6-smb devstack@keystone.service[81668]: detected binary path: /usr/bin/uwsgi-core Aug 31 19:03:22.449227 dv-cinder-852210-6-smb devstack@keystone.service[81668]: your processes number limit is 47680 Aug 31 19:03:22.449227 dv-cinder-852210-6-smb devstack@keystone.service[81668]: your memory page size is 4096 bytes Aug 31 19:03:22.449227 dv-cinder-852210-6-smb devstack@keystone.service[81668]: detected max file descriptor number: 2048 Aug 31 19:03:22.449227 dv-cinder-852210-6-smb devstack@keystone.service[81668]: lock engine: pthread robust mutexes Aug 31 19:03:22.449227 dv-cinder-852210-6-smb devstack@keystone.service[81668]: thunder lock: enabled Aug 31 19:03:22.449227 dv-cinder-852210-6-smb devstack@keystone.service[81668]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 31 19:03:22.449227 dv-cinder-852210-6-smb devstack@keystone.service[81668]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 19:03:22.488768 dv-cinder-852210-6-smb devstack@keystone.service[81668]: Python main interpreter initialized at 0x55e77ed7c9c0 Aug 31 19:03:22.488768 dv-cinder-852210-6-smb devstack@keystone.service[81668]: python threads support enabled Aug 31 19:03:22.488768 dv-cinder-852210-6-smb devstack@keystone.service[81668]: your server socket listen backlog is limited to 100 connections Aug 31 19:03:22.488768 dv-cinder-852210-6-smb devstack@keystone.service[81668]: your mercy for graceful operations on workers is 90 seconds Aug 31 19:03:22.489168 dv-cinder-852210-6-smb devstack@keystone.service[81668]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 19:03:22.489251 dv-cinder-852210-6-smb devstack@keystone.service[81668]: *** Operational MODE: preforking *** Aug 31 19:03:22.489477 dv-cinder-852210-6-smb devstack@keystone.service[81668]: *** uWSGI is running in multiple interpreter mode *** Aug 31 19:03:22.489477 dv-cinder-852210-6-smb devstack@keystone.service[81668]: spawned uWSGI master process (pid: 81668) Aug 31 19:03:22.489687 dv-cinder-852210-6-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 31 19:03:22.490661 dv-cinder-852210-6-smb devstack@keystone.service[81668]: spawned uWSGI worker 1 (pid: 81682, cores: 1) Aug 31 19:03:22.490661 dv-cinder-852210-6-smb devstack@keystone.service[81668]: spawned uWSGI worker 2 (pid: 81683, cores: 1) Aug 31 19:03:22.490805 dv-cinder-852210-6-smb devstack@keystone.service[81668]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 19:03:26.774698 dv-cinder-852210-6-smb devstack@keystone.service[81683]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 19:03:26.774698 dv-cinder-852210-6-smb devstack@keystone.service[81683]: from cryptography.utils import int_from_bytes Aug 31 19:03:26.775498 dv-cinder-852210-6-smb devstack@keystone.service[81683]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 19:03:26.775498 dv-cinder-852210-6-smb devstack@keystone.service[81683]: from cryptography.utils import int_from_bytes Aug 31 19:03:26.775617 dv-cinder-852210-6-smb devstack@keystone.service[81682]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 19:03:26.775617 dv-cinder-852210-6-smb devstack@keystone.service[81682]: from cryptography.utils import int_from_bytes Aug 31 19:03:26.776029 dv-cinder-852210-6-smb devstack@keystone.service[81682]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 19:03:26.776029 dv-cinder-852210-6-smb devstack@keystone.service[81682]: from cryptography.utils import int_from_bytes Aug 31 19:03:26.826058 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 19:03:26.826234 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 19:03:26.826348 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] command line args: [] {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 19:03:26.826644 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 19:03:26.826823 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ================================================================================ {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 19:03:26.827077 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] admin_token = **** {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.827325 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] config_dir = [] {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.827513 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.827695 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] config_source = [] {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.827875 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] debug = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.828078 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.829476 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.829476 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.829476 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.829476 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.829476 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] list_limit = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.829476 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] log_config_append = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.829845 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.829845 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] log_dir = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.829948 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] log_file = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.830183 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.830429 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.830705 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.830795 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 19:03:26.830906 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 19:03:26.830983 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.831113 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] command line args: [] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 19:03:26.831192 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.831276 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.831394 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 19:03:26.831512 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.831590 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ================================================================================ {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 19:03:26.831788 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.831876 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] admin_token = **** {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.832026 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.832101 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] config_dir = [] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.832209 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.832327 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.832408 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] config_source = [] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.832486 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.832606 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] debug = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.832702 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.832778 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.832950 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.833078 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.833154 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.833274 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.833349 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.833462 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.833593 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.833822 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] list_limit = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.833928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.79/identity {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.834010 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] log_config_append = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.834117 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] publish_errors = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.834200 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.834315 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] log_dir = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.834404 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.834507 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] log_file = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.834589 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.834732 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.834811 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.834979 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.835065 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.835213 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.835298 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.835447 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] standard_threads = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.835525 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.835608 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.835725 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.835806 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.835907 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.836010 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.836097 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.836243 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] use_journal = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.836319 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.836417 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] use_json = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.836499 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.836592 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] use_stderr = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.836698 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.836776 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] use_syslog = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.836930 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.837025 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.837162 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.837240 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.837407 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.837527 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.837648 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.837724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.837916 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.837993 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.838166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.838404 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.79/identity {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.838502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.838626 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] publish_errors = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.838706 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.838832 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.838914 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.839062 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.839150 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.839228 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.839366 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.839473 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.839617 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.839694 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.839850 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.839932 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] standard_threads = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.840099 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.840177 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.840335 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.840412 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.840527 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.840605 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.840702 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] use_journal = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.840816 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.840893 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] use_json = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.841036 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] use_stderr = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.841123 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.841196 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] use_syslog = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.841292 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.841422 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:03:26.841546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.841674 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.841788 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.841909 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.842023 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.842166 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.842259 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.842401 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.842557 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.842726 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.842805 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.842971 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.843054 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.843220 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.843307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.843452 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.843527 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.843682 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.843765 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.843917 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.844066 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.844166 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.844254 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.844399 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.844476 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.844625 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.844710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.844856 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.844940 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.845099 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.845174 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.845343 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.845425 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.845575 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.845651 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.845818 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.845893 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.846049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.846128 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.846283 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.846361 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.846536 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.846627 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.846767 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.846851 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.846997 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.847074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.847230 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.847306 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.847981 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.848061 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.848218 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.848296 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.848451 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.848525 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.848680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.848764 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.848912 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.848989 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.849139 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.849214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.849374 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.849453 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.849598 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.849674 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.849825 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.849903 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.850044 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.850123 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.850284 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.850362 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.850541 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.850619 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.850780 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.850861 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.851007 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.851083 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.851239 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.851320 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.851467 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.851544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.851696 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.851783 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.851925 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.852264 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.852424 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.852501 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.852652 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.852736 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.852883 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.852958 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.853126 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.853205 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.853355 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.853461 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.853573 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.853669 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.853800 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.853905 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.854032 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.854144 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.854379 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.854537 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.854625 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.854705 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.854824 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.854899 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.855014 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.855101 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.855199 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.855289 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.855436 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.855514 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.855670 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.855781 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.855906 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.856039 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.856121 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.856238 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.856370 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.856448 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.856605 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.856732 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.856838 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.856916 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.857068 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.857160 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.857301 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.857430 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.857537 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.857621 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.857765 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.857841 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.858235 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.858316 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.858316 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.858518 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.858518 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.858696 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.858772 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.858904 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.858982 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.859096 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.859172 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.859243 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.859398 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.859487 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.859632 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.859710 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.859864 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.859941 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.860100 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.860187 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.860331 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.860409 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.860559 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.860637 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.860788 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.860875 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.861021 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.861098 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.861247 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.861324 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.861487 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.861640 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.861717 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.861786 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.861941 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.862020 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.862175 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.862266 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.862407 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.862546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.862700 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.862806 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.863002 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.863134 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.863483 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] auth.external = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.864098 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.864216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.864291 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.864416 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.864501 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.864604 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.864678 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.864748 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] auth.password = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.864858 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.864977 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] auth.token = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.865099 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.865220 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.865340 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.865455 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.865574 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.865703 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.865808 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.865938 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.866045 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.866185 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.866266 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.866432 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.866543 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.866687 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.866765 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.866921 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] credential.caching = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.867001 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.867167 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.867254 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.867411 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.867492 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.867657 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.867736 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.867900 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.867980 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.868138 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.868215 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.868370 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] auth.external = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.868454 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.868601 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.868687 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.868854 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.868979 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.869077 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.869156 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.869337 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.869442 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] auth.password = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.869561 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] auth.token = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.869687 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.869799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.869880 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.870033 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.870112 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.870279 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.870364 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.870532 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.870629 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.870781 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.870861 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] federation.caching = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.871025 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.871110 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.871256 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.871336 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.871489 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] credential.caching = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.871567 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.871717 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.871794 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.871965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.872046 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.872202 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.872281 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.872453 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.872531 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.872687 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.872766 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.872917 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.872994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.873163 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.873240 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.873407 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.873486 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.873638 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.873715 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] identity.caching = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.873881 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.873957 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.874132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.874213 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.874367 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.874445 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.874623 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.874715 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.874870 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.874950 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.875104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.875183 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.875343 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.875434 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] federation.caching = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.875581 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.875704 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.875825 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.875904 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.876054 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.876205 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.876283 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.876354 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.876503 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.876582 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.876738 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.876824 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.876981 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.877059 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.877215 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.877298 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.877466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.877558 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.877703 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.877783 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.877950 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.878030 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.878186 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity.caching = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.878273 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.878422 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.878563 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.878702 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.878781 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.878942 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.879034 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.879175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.879254 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.879412 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.879491 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.879641 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.879727 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.879876 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.879954 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.880119 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.880196 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.880348 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.880434 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.880587 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.880665 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.880819 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.880897 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.881049 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.881136 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.881290 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.881370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.881532 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.881610 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.881763 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.881850 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.882004 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.882137 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.882261 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.882337 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.882487 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.882625 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.882697 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.882757 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.882944 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.883013 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.883181 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.883258 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.883413 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.883494 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.883643 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.883723 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.883877 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.883972 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.884109 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.884187 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.884343 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.884421 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.884585 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.884671 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.884813 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.884892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.885050 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.885127 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.885285 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.885366 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.885513 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.885598 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.885742 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.user = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.885820 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.885982 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.886062 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.886205 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.886283 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.886441 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.886539 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.886691 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.886773 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.886927 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.887005 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.887161 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.887239 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.887400 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.887480 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.887628 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.887706 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.887861 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.887939 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.888093 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.888171 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.888332 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.888410 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.888556 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.888633 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.888785 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.888865 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.889031 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.889108 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.889273 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.889351 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.889508 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.889595 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.889743 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.889822 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.889971 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.890048 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.890199 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.890278 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.890436 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.890563 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.890695 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.890772 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.890932 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.891012 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.891164 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.891242 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.891411 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.891489 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.891654 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.891732 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.891888 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.891966 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.892117 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.892194 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.892351 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.892432 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.892583 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.892662 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.892818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.892897 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.893046 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.893141 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.893282 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.893367 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.893522 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.893630 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.893765 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.893877 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.894008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.894111 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.894278 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.894379 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.894532 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.894646 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] resource.caching = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.894779 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.894900 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.895016 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.895149 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.895236 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.895388 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.895468 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.895638 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.895724 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.895892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.895980 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.896128 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.896207 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.896376 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.896454 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.896614 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.896701 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.896844 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.896921 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.897079 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] role.caching = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.897157 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.897309 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.897396 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] role.driver = sql {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.897542 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.897620 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.897777 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.897853 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.898022 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.898110 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.898262 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.898341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.898514 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.898595 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.898745 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.898822 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.898979 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] resource.caching = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.899058 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.899229 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.899306 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.899470 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.899549 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.899698 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.899776 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.899942 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.900019 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.900184 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.900264 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.900415 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.900492 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.900658 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.900736 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.900894 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.901046 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.901125 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.901282 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.901361 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] role.caching = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.901531 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.901618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] role.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.901779 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.901858 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.902026 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.902104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.902267 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.902353 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.902527 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.902609 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.902771 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.902848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.903015 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.903107 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.903251 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.903329 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.903484 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.903562 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.903714 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.903801 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.903938 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.904016 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.904187 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.904265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.904432 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.904519 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.904676 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.904755 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.904912 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.904992 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.905147 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.905291 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.905370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.905525 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.905604 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] token.caching = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.905772 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.905859 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.906017 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.906096 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.906261 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.906339 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.906530 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.906625 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.906767 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.906846 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.906998 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.907076 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.907241 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.907327 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.907480 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.907558 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.907710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.907788 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.907939 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.908069 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.908153 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.908225 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.908395 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.908472 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.908640 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.908727 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.908884 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.908962 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.909119 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.909197 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.909353 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.909441 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.909584 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.909671 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.910341 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] token.caching = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.910426 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] database.connection = **** {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.910605 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.910688 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.910852 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.910934 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.911086 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.911164 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.911324 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.911402 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.911559 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.911640 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.911795 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.911873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.912027 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.912104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.912262 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.912342 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.912503 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.912586 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.912736 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.912813 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.912967 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.913047 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.913202 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.913321 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.913441 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.913519 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.913678 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.913758 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.913922 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.914009 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.914154 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.914233 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.914392 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.914493 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.914652 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.914722 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.connection = **** {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.914821 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 19:03:26.914901 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.915145 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.915381 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.915619 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.915851 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.916086 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.916319 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.916553 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.916795 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.917030 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.917271 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.917502 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.917744 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.917978 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.918222 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.918447 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.918711 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.918942 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:03:26.919111 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 19:03:26.944419 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:26.944646 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:26.944873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:26.948100 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:26.948331 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:26.948556 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:26.953270 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:26.957596 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:26.982327 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:26.982579 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:26.984543 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:26.984774 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.036067 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.036527 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.084310 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.084543 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.084881 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.085121 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.238986 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.239211 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.239303 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.239435 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.239547 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.239655 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.239739 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.239872 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.239956 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.240090 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.240185 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.240338 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.262898 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.263131 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.263371 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.263481 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.263563 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.263716 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.263802 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.263940 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.264034 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.264163 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.264248 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.264381 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.264594 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.264807 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.275902 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.276207 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.289168 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.289397 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.289597 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.289781 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.289918 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.290060 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.290060 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.290307 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.290447 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.290612 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.290745 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.290877 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.290877 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.290877 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 19:03:27.307104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.307259 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.307390 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 19:03:27.307526 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 19:03:27.307655 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.307823 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 19:03:27.307964 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.308092 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.308220 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 19:03:27.308368 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.308502 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.308630 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.308756 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.308880 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.309006 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.309131 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.319111 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.319266 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.319443 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.319582 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.319711 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.319852 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.319980 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.320109 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.326844 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:03:27.326978 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81682) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:03:27.329713 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:03:27.329843 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81682) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:03:27.329986 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.330118 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.330250 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.330381 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.330615 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.330744 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.330872 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.330998 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.331124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.331258 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.331386 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.331521 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.331661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.332389 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.332525 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.332659 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.332786 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.332917 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.333048 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.333179 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.355750 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.355913 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.357155 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:03:27.357318 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81682) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:03:27.357450 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.357587 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.362046 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:03:27.362188 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81682) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:03:27.362316 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.362444 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.362607 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.362742 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.368927 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:03:27.369212 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.369342 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81682) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:03:27.369503 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.373275 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:03:27.373488 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81682) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:03:27.373619 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.373777 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.373906 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.374048 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.374180 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.374323 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.374499 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.374632 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.374763 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.374904 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.375132 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.376512 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.376809 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.377097 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.392465 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.392741 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.393093 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.393371 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.397287 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:03:27.397804 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81682) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:03:27.400395 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.400688 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.400956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.401252 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.404863 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:03:27.405590 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81682) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:03:27.408112 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:03:27.408747 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81682) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:03:27.411240 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.411537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.411817 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.411951 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.412086 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.412218 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.412358 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.412490 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.412631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.412762 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.412981 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.413368 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.428277 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:03:27.428558 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.428982 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.429087 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.429185 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81682) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:03:27.429471 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.429737 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.429998 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.435902 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.436789 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.437413 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.438437 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.438990 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.439264 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.439999 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.440276 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.442581 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:03:27.442863 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.443152 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.443432 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.443562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81682) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:03:27.443706 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.443841 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.444027 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.444308 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.444597 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.454957 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:03:27.455248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.455542 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.455810 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.455941 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81682) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:03:27.456087 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.456221 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.456353 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.456484 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.456660 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.457323 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.457539 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.457816 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.458107 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.472494 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:03:27.473555 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81682) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:03:27.475406 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:03:27.476617 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81682) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:03:27.478531 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.479802 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.480084 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.481246 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.481546 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:03:27.481836 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.482132 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.482749 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81682) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:03:27.483034 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.483337 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.488606 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.489911 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.490195 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:03:27.491547 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81682) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:03:27.493111 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.493404 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.493689 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.493964 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.494353 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.494670 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.494959 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.495235 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.501872 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:03:27.502166 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.502443 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.503185 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81682) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:03:27.503478 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.504287 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.509712 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:03:27.509991 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.510270 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.510570 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.510844 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.511114 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.511195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81682) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 19:03:27.511383 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.511469 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.511655 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.511741 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.511992 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.512082 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.512264 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.512356 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.512541 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.512634 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.512808 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.512894 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.513071 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.513153 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.513346 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.513436 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.513622 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.513895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.514155 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.514416 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.514720 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 19:03:27.547720 dv-cinder-852210-6-smb devstack@keystone.service[81683]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e77ed7c9c0 pid: 81683 (default app) Aug 31 19:03:27.548966 dv-cinder-852210-6-smb devstack@keystone.service[81682]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e77ed7c9c0 pid: 81682 (default app) Aug 31 19:03:27.551312 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee1184-3803-4208-92ea-7d1b52e38a58 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:27.551731 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee1184-3803-4208-92ea-7d1b52e38a58 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:27.552009 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee1184-3803-4208-92ea-7d1b52e38a58 None None] PATH_INFO: `/v3` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:27.556380 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1/1] 10.222.0.79 () {50 vars in 791 bytes} [Wed Aug 31 19:03:27 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:03:34.108682 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e15153-8490-459c-af63-38e995b7e5df None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:34.109207 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e15153-8490-459c-af63-38e995b7e5df None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:34.109207 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e15153-8490-459c-af63-38e995b7e5df None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:34.114090 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1/2] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:03:34 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:03:34.119476 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b23d5-8759-4efb-81fe-5349dfceb1d4 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:34.119901 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b23d5-8759-4efb-81fe-5349dfceb1d4 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:34.120039 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b23d5-8759-4efb-81fe-5349dfceb1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:34.189225 dv-cinder-852210-6-smb devstack@keystone.service[81683]: INFO dbcounter [None req-c10b23d5-8759-4efb-81fe-5349dfceb1d4 None None] Registered counter for database keystone Aug 31 19:03:34.207902 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG oslo_db.sqlalchemy.engines [None req-c10b23d5-8759-4efb-81fe-5349dfceb1d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:03:34.214043 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writer thread running {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:03:34.392862 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG passlib.handlers.bcrypt [None req-c10b23d5-8759-4efb-81fe-5349dfceb1d4 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81683) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 19:03:34.393173 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG passlib.handlers.bcrypt [None req-c10b23d5-8759-4efb-81fe-5349dfceb1d4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81683) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 19:03:34.453114 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-c10b23d5-8759-4efb-81fe-5349dfceb1d4 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:03:34.454756 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c10b23d5-8759-4efb-81fe-5349dfceb1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:03:34.587721 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 2/3] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:03:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 31 19:03:35.087435 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e15153-8490-459c-af63-38e995b7e5df None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:35.156426 dv-cinder-852210-6-smb devstack@keystone.service[81682]: INFO dbcounter [None req-07e15153-8490-459c-af63-38e995b7e5df None None] Registered counter for database keystone Aug 31 19:03:35.178659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG oslo_db.sqlalchemy.engines [None req-07e15153-8490-459c-af63-38e995b7e5df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81682) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:03:35.184939 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writer thread running {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:03:35.304262 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e15153-8490-459c-af63-38e995b7e5df None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:35.308582 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7050ee-ec1c-4e60-aa6b-e5a329d84265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:35.309212 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7050ee-ec1c-4e60-aa6b-e5a329d84265 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:35.309496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7050ee-ec1c-4e60-aa6b-e5a329d84265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:35.309772 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7050ee-ec1c-4e60-aa6b-e5a329d84265 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:35.317882 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7050ee-ec1c-4e60-aa6b-e5a329d84265 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:35.369901 dv-cinder-852210-6-smb devstack@keystone.service[81682]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3c7050ee-ec1c-4e60-aa6b-e5a329d84265 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 19:03:35.370169 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7050ee-ec1c-4e60-aa6b-e5a329d84265 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:35.380418 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 2/4] 10.222.0.79 () {58 vars in 1324 bytes} [Wed Aug 31 19:03:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:03:35.386316 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b23d5-8759-4efb-81fe-5349dfceb1d4 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:35.401154 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b23d5-8759-4efb-81fe-5349dfceb1d4 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:35.405595 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8468d5-0c9c-45c0-85e8-9ba30501e131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:35.406744 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8468d5-0c9c-45c0-85e8-9ba30501e131 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:35.407025 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8468d5-0c9c-45c0-85e8-9ba30501e131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:35.407307 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8468d5-0c9c-45c0-85e8-9ba30501e131 admin admin] PATH_INFO: `/v3/projects/eabc1ce4c37941459d2c18a04fbaba99` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:35.408909 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8468d5-0c9c-45c0-85e8-9ba30501e131 admin admin] RBAC: Authorizing `identity:get_project(project_id=eabc1ce4c37941459d2c18a04fbaba99)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:35.461953 dv-cinder-852210-6-smb devstack@keystone.service[81683]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0c8468d5-0c9c-45c0-85e8-9ba30501e131 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 19:03:35.462293 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8468d5-0c9c-45c0-85e8-9ba30501e131 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:35.466895 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 3/5] 10.222.0.79 () {56 vars in 1207 bytes} [Wed Aug 31 19:03:35 2022] GET /identity/v3/projects/eabc1ce4c37941459d2c18a04fbaba99 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:03:37.354935 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09473259-7ee5-4625-a9bf-68e1094cf3c4 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:37.355556 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09473259-7ee5-4625-a9bf-68e1094cf3c4 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:37.355556 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09473259-7ee5-4625-a9bf-68e1094cf3c4 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:37.359630 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 3/6] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:03:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:03:37.364983 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9820e-c477-4eb0-98b0-b078ce3456e6 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:37.365393 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9820e-c477-4eb0-98b0-b078ce3456e6 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:37.365532 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9820e-c477-4eb0-98b0-b078ce3456e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:37.385786 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-d6a9820e-c477-4eb0-98b0-b078ce3456e6 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:03:37.387306 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d6a9820e-c477-4eb0-98b0-b078ce3456e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:03:37.395663 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 4/7] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:03:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 31 19:03:37.661297 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09473259-7ee5-4625-a9bf-68e1094cf3c4 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:37.673106 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09473259-7ee5-4625-a9bf-68e1094cf3c4 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:37.677770 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5bc31f-7a45-4fc9-a296-065be8d8ec0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:37.678360 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bc31f-7a45-4fc9-a296-065be8d8ec0b admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:37.678666 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bc31f-7a45-4fc9-a296-065be8d8ec0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:37.678935 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bc31f-7a45-4fc9-a296-065be8d8ec0b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:37.686392 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5bc31f-7a45-4fc9-a296-065be8d8ec0b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:37.688182 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5bc31f-7a45-4fc9-a296-065be8d8ec0b admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:37.697760 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 4/8] 10.222.0.79 () {58 vars in 1324 bytes} [Wed Aug 31 19:03:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:03:37.703177 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9820e-c477-4eb0-98b0-b078ce3456e6 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:37.712295 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9820e-c477-4eb0-98b0-b078ce3456e6 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:37.716655 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8dd54-562b-4eda-828c-08bd5ea0294a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:37.717292 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8dd54-562b-4eda-828c-08bd5ea0294a admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:37.717574 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8dd54-562b-4eda-828c-08bd5ea0294a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:37.717849 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8dd54-562b-4eda-828c-08bd5ea0294a admin admin] PATH_INFO: `/v3/users/cf2ffbbfceaa4c36a9027a844dd4920a` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:37.719171 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff8dd54-562b-4eda-828c-08bd5ea0294a admin admin] RBAC: Authorizing `identity:get_user(user_id=cf2ffbbfceaa4c36a9027a844dd4920a)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:37.720990 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff8dd54-562b-4eda-828c-08bd5ea0294a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:37.722545 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 5/9] 10.222.0.79 () {56 vars in 1198 bytes} [Wed Aug 31 19:03:37 2022] GET /identity/v3/users/cf2ffbbfceaa4c36a9027a844dd4920a => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:03:39.672679 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce8954-0e17-4ec9-ab81-4f2e9c3559eb None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:39.673213 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce8954-0e17-4ec9-ab81-4f2e9c3559eb None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:39.673213 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce8954-0e17-4ec9-ab81-4f2e9c3559eb None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:39.674561 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 5/10] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:03:39.679664 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba215162-13c7-4225-b22f-ce47fb2a6764 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:39.680092 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba215162-13c7-4225-b22f-ce47fb2a6764 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:39.680345 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba215162-13c7-4225-b22f-ce47fb2a6764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:39.699203 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-ba215162-13c7-4225-b22f-ce47fb2a6764 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:03:39.700368 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ba215162-13c7-4225-b22f-ce47fb2a6764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:03:39.708799 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637cd45a-6d33-4850-a1a2-f974a4f8c963 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:39.709089 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637cd45a-6d33-4850-a1a2-f974a4f8c963 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:39.709361 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637cd45a-6d33-4850-a1a2-f974a4f8c963 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:39.710770 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 6/11] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:03:39.715904 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b91e66-86f2-4420-a9f1-e169e10f9a36 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:39.716189 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b91e66-86f2-4420-a9f1-e169e10f9a36 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:39.716468 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b91e66-86f2-4420-a9f1-e169e10f9a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:39.759431 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG passlib.handlers.bcrypt [None req-01b91e66-86f2-4420-a9f1-e169e10f9a36 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81682) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 19:03:39.759814 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG passlib.handlers.bcrypt [None req-01b91e66-86f2-4420-a9f1-e169e10f9a36 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81682) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 19:03:39.780929 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 6/12] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:03:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:03:39.808836 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-01b91e66-86f2-4420-a9f1-e169e10f9a36 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:03:39.810371 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-01b91e66-86f2-4420-a9f1-e169e10f9a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:03:39.912164 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 7/13] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:03:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:03:40.043493 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba215162-13c7-4225-b22f-ce47fb2a6764 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:40.068697 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:40.149888 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba215162-13c7-4225-b22f-ce47fb2a6764 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:40.177055 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b91e66-86f2-4420-a9f1-e169e10f9a36 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:40.183869 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb3d7a-69cf-4128-b31b-b155329f1127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:40.184509 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb3d7a-69cf-4128-b31b-b155329f1127 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:40.184788 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb3d7a-69cf-4128-b31b-b155329f1127 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:40.185064 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb3d7a-69cf-4128-b31b-b155329f1127 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:40.197061 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb3d7a-69cf-4128-b31b-b155329f1127 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:03:40.205789 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-77eb3d7a-69cf-4128-b31b-b155329f1127 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:03:40.205789 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:03:40.205789 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:03:40.205789 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:03:40.205789 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:03:40.205789 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:03:40.205789 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:03:40.205789 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:03:40.205789 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:03:40.205789 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:03:40.205789 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:03:40.205789 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:03:40.205789 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:03:40.205789 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:03:40.205789 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:03:40.205789 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:03:40.206837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:03:40.206837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:03:40.206837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:03:40.206837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:03:40.206837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:03:40.206837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:03:40.206837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:03:40.206837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:03:40.206837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:03:40.206837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:03:40.206837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:03:40.206837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:03:40.206837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:03:40.206837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:03:40.206837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:03:40.206837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:03:40.207672 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:03:40.207672 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:03:40.207672 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:03:40.207672 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:03:40.207672 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:03:40.207672 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:03:40.207672 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:03:40.207672 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:03:40.207672 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:03:40.207672 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:03:40.207672 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:03:40.207672 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:03:40.207672 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 7/14] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 19:03:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:03:40.212558 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb3d7a-69cf-4128-b31b-b155329f1127 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:40.280024 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b91e66-86f2-4420-a9f1-e169e10f9a36 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:40.282248 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:40.295708 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:40.315192 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb3d7a-69cf-4128-b31b-b155329f1127 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:40.319732 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc4eed-19c9-447d-872e-b7b6930eb5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:40.320397 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc4eed-19c9-447d-872e-b7b6930eb5c1 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:40.320673 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc4eed-19c9-447d-872e-b7b6930eb5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:40.320943 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc4eed-19c9-447d-872e-b7b6930eb5c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:40.349329 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf622b6-395d-4a23-95e9-ae6b97c964c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:40.349927 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf622b6-395d-4a23-95e9-ae6b97c964c3 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:40.350202 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf622b6-395d-4a23-95e9-ae6b97c964c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:40.350485 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf622b6-395d-4a23-95e9-ae6b97c964c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:40.351161 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf622b6-395d-4a23-95e9-ae6b97c964c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:03:40.351463 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf622b6-395d-4a23-95e9-ae6b97c964c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:40.353096 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf622b6-395d-4a23-95e9-ae6b97c964c3 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:40.365357 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 8/15] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:03:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:03:40.371269 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf622b6-395d-4a23-95e9-ae6b97c964c3 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:40.389344 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc4eed-19c9-447d-872e-b7b6930eb5c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:40.390925 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc4eed-19c9-447d-872e-b7b6930eb5c1 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:40.472555 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf622b6-395d-4a23-95e9-ae6b97c964c3 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:40.497069 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 8/16] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:03:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 19:03:40.502787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc4eed-19c9-447d-872e-b7b6930eb5c1 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:40.505559 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:40.505880 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc103fb-cba4-4de6-9cfb-cd4183f8af8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:40.506547 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc103fb-cba4-4de6-9cfb-cd4183f8af8d None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:40.506825 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc103fb-cba4-4de6-9cfb-cd4183f8af8d None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:40.507267 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc103fb-cba4-4de6-9cfb-cd4183f8af8d None admin] PATH_INFO: `/v3/users/cf2ffbbfceaa4c36a9027a844dd4920a` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:40.508759 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc103fb-cba4-4de6-9cfb-cd4183f8af8d None admin] RBAC: Authorizing `identity:get_user(user_id=cf2ffbbfceaa4c36a9027a844dd4920a)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:40.510226 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc103fb-cba4-4de6-9cfb-cd4183f8af8d None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:40.511848 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 9/17] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:03:40 2022] GET /identity/v3/users/cf2ffbbfceaa4c36a9027a844dd4920a => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:03:40.517382 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc103fb-cba4-4de6-9cfb-cd4183f8af8d None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:40.535200 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:40.610323 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc4eed-19c9-447d-872e-b7b6930eb5c1 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:40.645051 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f84828-a0cf-49c5-bd3d-dc375e9685fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:40.647115 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f84828-a0cf-49c5-bd3d-dc375e9685fe None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:40.647401 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f84828-a0cf-49c5-bd3d-dc375e9685fe None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:40.647678 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f84828-a0cf-49c5-bd3d-dc375e9685fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:40.651187 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc103fb-cba4-4de6-9cfb-cd4183f8af8d None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:40.666809 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f84828-a0cf-49c5-bd3d-dc375e9685fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:40.668280 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f84828-a0cf-49c5-bd3d-dc375e9685fe None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:40.686463 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-f3f84828-a0cf-49c5-bd3d-dc375e9685fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:03:40.686463 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:03:40.686463 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:03:40.686463 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:03:40.686463 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:03:40.686463 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:03:40.686463 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:03:40.686463 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:03:40.686463 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:03:40.686463 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:03:40.686463 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:03:40.686463 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:03:40.686463 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:03:40.686463 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:03:40.686463 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:03:40.686463 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:03:40.687926 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:03:40.687926 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:03:40.687926 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:03:40.687926 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:03:40.687926 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:03:40.687926 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:03:40.687926 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:03:40.687926 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:03:40.687926 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:03:40.687926 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:03:40.687926 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:03:40.687926 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:03:40.687926 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:03:40.687926 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:03:40.687926 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:03:40.687926 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:03:40.687926 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:03:40.689011 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:03:40.689011 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:03:40.689011 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:03:40.689222 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8d856-7cf0-452b-a039-1045decd4a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:40.689222 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8d856-7cf0-452b-a039-1045decd4a09 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:40.689680 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 9/18] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:03:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:03:40.689759 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8d856-7cf0-452b-a039-1045decd4a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:40.689759 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8d856-7cf0-452b-a039-1045decd4a09 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:40.689759 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8d856-7cf0-452b-a039-1045decd4a09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:40.690797 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8d856-7cf0-452b-a039-1045decd4a09 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:40.692396 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 10/19] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:03:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:03:40.693398 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f84828-a0cf-49c5-bd3d-dc375e9685fe None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:40.698500 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8d856-7cf0-452b-a039-1045decd4a09 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:40.752835 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:40.780479 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:40.801893 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f84828-a0cf-49c5-bd3d-dc375e9685fe None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:40.802086 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8d856-7cf0-452b-a039-1045decd4a09 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:40.836180 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f076c-784c-45c4-814d-e9b7a0d57c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:40.836787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f076c-784c-45c4-814d-e9b7a0d57c37 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:40.837069 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f076c-784c-45c4-814d-e9b7a0d57c37 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:40.837347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f076c-784c-45c4-814d-e9b7a0d57c37 None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:40.838000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f076c-784c-45c4-814d-e9b7a0d57c37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:03:40.838304 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f076c-784c-45c4-814d-e9b7a0d57c37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:40.838510 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09bd25-0c00-416d-bedf-9192f8b832a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:40.839120 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09bd25-0c00-416d-bedf-9192f8b832a4 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:40.839404 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09bd25-0c00-416d-bedf-9192f8b832a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:40.839680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09bd25-0c00-416d-bedf-9192f8b832a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:40.839782 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f076c-784c-45c4-814d-e9b7a0d57c37 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:40.840408 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f09bd25-0c00-416d-bedf-9192f8b832a4 None admin] RBAC: Adding query filter params (role.id=edc551338adb4ae88bdafc591ad69582, scope.domain.id=default, user.id=cf2ffbbfceaa4c36a9027a844dd4920a) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:03:40.840716 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f09bd25-0c00-416d-bedf-9192f8b832a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:40.842132 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f09bd25-0c00-416d-bedf-9192f8b832a4 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:40.849156 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 11/20] 10.222.0.79 () {56 vars in 1322 bytes} [Wed Aug 31 19:03:40 2022] GET /identity/v3/role_assignments?user.id=cf2ffbbfceaa4c36a9027a844dd4920a&scope.domain.id=default&role.id=edc551338adb4ae88bdafc591ad69582 => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:03:40.858820 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 10/21] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:03:42.968139 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63329288-d7a4-4a33-9bb1-bced3d1aa412 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:42.968646 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63329288-d7a4-4a33-9bb1-bced3d1aa412 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:42.968743 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63329288-d7a4-4a33-9bb1-bced3d1aa412 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:42.970187 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 12/22] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:03:42.975358 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b667a4-7f55-423a-8dd8-ba9d0cc335ed None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:42.976208 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b667a4-7f55-423a-8dd8-ba9d0cc335ed None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:42.976708 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b667a4-7f55-423a-8dd8-ba9d0cc335ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:43.011556 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-a1b667a4-7f55-423a-8dd8-ba9d0cc335ed None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:03:43.013103 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-a1b667a4-7f55-423a-8dd8-ba9d0cc335ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:03:43.098266 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 11/23] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:03:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:03:43.417441 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669b794-dda4-437a-82b3-78aece57af47 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:43.418220 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669b794-dda4-437a-82b3-78aece57af47 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:43.418735 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669b794-dda4-437a-82b3-78aece57af47 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:43.420557 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 13/24] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:03:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:03:43.426140 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6372d4-abe1-4f18-a24a-c4e13b8a516a None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:43.426688 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6372d4-abe1-4f18-a24a-c4e13b8a516a None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:43.427181 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6372d4-abe1-4f18-a24a-c4e13b8a516a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:43.455431 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-3f6372d4-abe1-4f18-a24a-c4e13b8a516a None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:03:43.457486 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-3f6372d4-abe1-4f18-a24a-c4e13b8a516a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:03:43.509376 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:43.544717 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 12/25] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:03:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:03:43.550850 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669b794-dda4-437a-82b3-78aece57af47 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:43.625019 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d73e8b-5f2e-4954-b7b4-73aaedca875b None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:43.625356 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d73e8b-5f2e-4954-b7b4-73aaedca875b None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:43.625577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d73e8b-5f2e-4954-b7b4-73aaedca875b None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:43.627201 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 13/26] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:03:43.632510 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641dfcc4-18db-423c-8073-5be29db35284 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:43.632800 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641dfcc4-18db-423c-8073-5be29db35284 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:43.633075 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641dfcc4-18db-423c-8073-5be29db35284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:43.674636 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-641dfcc4-18db-423c-8073-5be29db35284 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:03:43.676276 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-641dfcc4-18db-423c-8073-5be29db35284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:03:43.725856 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669b794-dda4-437a-82b3-78aece57af47 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:43.801473 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e9a52-55d9-45d1-b546-717a706cdac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:43.802506 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e9a52-55d9-45d1-b546-717a706cdac6 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:43.802993 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e9a52-55d9-45d1-b546-717a706cdac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:43.803489 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e9a52-55d9-45d1-b546-717a706cdac6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:43.826778 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e9a52-55d9-45d1-b546-717a706cdac6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:03:43.832959 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-906e9a52-55d9-45d1-b546-717a706cdac6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:03:43.832959 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:03:43.832959 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:03:43.832959 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:03:43.832959 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:03:43.832959 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:03:43.832959 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:03:43.832959 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:03:43.832959 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:03:43.832959 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:03:43.832959 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:03:43.832959 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:03:43.832959 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:03:43.832959 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:03:43.832959 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:03:43.832959 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:03:43.833799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:03:43.833799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:03:43.833799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:03:43.833799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:03:43.833799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:03:43.833799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:03:43.833799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:03:43.833799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:03:43.833799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:03:43.833799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:03:43.833799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:03:43.833799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:03:43.833799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:03:43.833799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:03:43.833799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:03:43.833799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:03:43.834564 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:03:43.834564 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:03:43.834564 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:03:43.834564 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:03:43.834564 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:03:43.834564 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:03:43.834564 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:03:43.834564 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:03:43.834564 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:03:43.834564 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:03:43.834564 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:03:43.834564 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:03:43.837044 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 14/27] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 19:03:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:03:43.843443 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e9a52-55d9-45d1-b546-717a706cdac6 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:43.853332 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 14/28] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:03:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:03:43.858809 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:43.930642 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79a840-79ac-461e-bb25-b030be106b5c None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:43.931184 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79a840-79ac-461e-bb25-b030be106b5c None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:43.931671 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79a840-79ac-461e-bb25-b030be106b5c None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:43.933455 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 15/29] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:03:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:03:43.955034 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b7986-1301-435c-8b52-df9e73997ce2 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:43.955638 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b7986-1301-435c-8b52-df9e73997ce2 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:43.956107 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b7986-1301-435c-8b52-df9e73997ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:43.989022 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-ea8b7986-1301-435c-8b52-df9e73997ce2 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:03:43.991036 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-ea8b7986-1301-435c-8b52-df9e73997ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:03:44.025244 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e9a52-55d9-45d1-b546-717a706cdac6 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:44.089029 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1376dc8-a94f-4a4f-92d2-a19089adcb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:44.090008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1376dc8-a94f-4a4f-92d2-a19089adcb2f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:44.090501 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1376dc8-a94f-4a4f-92d2-a19089adcb2f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:44.091088 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1376dc8-a94f-4a4f-92d2-a19089adcb2f None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:44.091979 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1376dc8-a94f-4a4f-92d2-a19089adcb2f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:03:44.092473 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1376dc8-a94f-4a4f-92d2-a19089adcb2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:44.095080 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1376dc8-a94f-4a4f-92d2-a19089adcb2f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:44.106111 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 16/30] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:03:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:03:44.107290 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b7986-1301-435c-8b52-df9e73997ce2 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:44.114141 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 15/31] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:03:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:03:44.121656 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1376dc8-a94f-4a4f-92d2-a19089adcb2f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:44.194902 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:44.290199 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:44.350495 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b7986-1301-435c-8b52-df9e73997ce2 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:44.363916 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1376dc8-a94f-4a4f-92d2-a19089adcb2f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:44.415219 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99192a49-231e-4aa5-9e21-591a98283a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:44.415943 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99192a49-231e-4aa5-9e21-591a98283a02 None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:44.416226 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99192a49-231e-4aa5-9e21-591a98283a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:44.416497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99192a49-231e-4aa5-9e21-591a98283a02 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:44.417173 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99192a49-231e-4aa5-9e21-591a98283a02 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:44.418592 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99192a49-231e-4aa5-9e21-591a98283a02 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:44.422789 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023e4e9-b009-46c0-823d-67065361b351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:44.423667 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023e4e9-b009-46c0-823d-67065361b351 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:44.424107 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023e4e9-b009-46c0-823d-67065361b351 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:44.424521 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023e4e9-b009-46c0-823d-67065361b351 None admin] PATH_INFO: `/v3/users/cf2ffbbfceaa4c36a9027a844dd4920a` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:44.426114 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023e4e9-b009-46c0-823d-67065361b351 None admin] RBAC: Authorizing `identity:get_user(user_id=cf2ffbbfceaa4c36a9027a844dd4920a)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:44.427826 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023e4e9-b009-46c0-823d-67065361b351 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:44.429483 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 16/32] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:03:44 2022] GET /identity/v3/users/cf2ffbbfceaa4c36a9027a844dd4920a => generated 247 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:03:44.430276 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023e4e9-b009-46c0-823d-67065361b351 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:44.542137 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023e4e9-b009-46c0-823d-67065361b351 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:44.546936 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 17/33] 10.222.0.79 () {60 vars in 1131 bytes} [Wed Aug 31 19:03:44 2022] POST /identity/v3/roles => generated 219 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:03:44.548226 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99192a49-231e-4aa5-9e21-591a98283a02 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:44.580063 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b8fe0-a226-4377-8654-cf6e23711d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:44.580795 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b8fe0-a226-4377-8654-cf6e23711d8b None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:44.581272 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b8fe0-a226-4377-8654-cf6e23711d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:44.582300 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b8fe0-a226-4377-8654-cf6e23711d8b None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:44.583220 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015b8fe0-a226-4377-8654-cf6e23711d8b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:44.584982 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015b8fe0-a226-4377-8654-cf6e23711d8b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:44.594822 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:44.659869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:44.666371 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99192a49-231e-4aa5-9e21-591a98283a02 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:44.719137 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80f1df-6f2c-402d-ab27-882338a0e013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:44.720134 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80f1df-6f2c-402d-ab27-882338a0e013 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:44.720619 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80f1df-6f2c-402d-ab27-882338a0e013 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:44.721061 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80f1df-6f2c-402d-ab27-882338a0e013 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:44.724864 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 17/34] 10.222.0.79 () {60 vars in 1131 bytes} [Wed Aug 31 19:03:44 2022] POST /identity/v3/roles => generated 225 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:03:44.726385 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b8fe0-a226-4377-8654-cf6e23711d8b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:44.734024 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c80f1df-6f2c-402d-ab27-882338a0e013 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:44.736173 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c80f1df-6f2c-402d-ab27-882338a0e013 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:44.754290 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-2c80f1df-6f2c-402d-ab27-882338a0e013 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:03:44.754290 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:03:44.754290 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:03:44.754290 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:03:44.754290 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:03:44.754290 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:03:44.754290 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:03:44.754290 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:03:44.754290 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:03:44.754290 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:03:44.754290 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:03:44.754290 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:03:44.754290 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:03:44.754290 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:03:44.754290 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:03:44.754290 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:03:44.755317 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:03:44.755317 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:03:44.755317 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:03:44.755317 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:03:44.755317 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:03:44.755317 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:03:44.755317 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:03:44.755317 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:03:44.755317 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:03:44.755317 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:03:44.755317 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:03:44.755317 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:03:44.755317 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:03:44.755317 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:03:44.755317 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:03:44.755317 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:03:44.755317 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:03:44.756127 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:03:44.756127 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:03:44.756127 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:03:44.757645 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 18/35] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:03:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:03:44.767918 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80f1df-6f2c-402d-ab27-882338a0e013 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:44.897386 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b8fe0-a226-4377-8654-cf6e23711d8b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:44.902278 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80f1df-6f2c-402d-ab27-882338a0e013 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:44.938632 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590a3a3-0738-4056-a88f-f7d356d878b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:44.939433 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590a3a3-0738-4056-a88f-f7d356d878b1 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:44.939722 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590a3a3-0738-4056-a88f-f7d356d878b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:44.939934 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb4e2a8-37ea-4797-825e-f363a55351ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:44.940044 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590a3a3-0738-4056-a88f-f7d356d878b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:44.940488 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4e2a8-37ea-4797-825e-f363a55351ec None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:44.940771 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4e2a8-37ea-4797-825e-f363a55351ec None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:44.941084 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4e2a8-37ea-4797-825e-f363a55351ec None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:44.941329 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590a3a3-0738-4056-a88f-f7d356d878b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:44.941759 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb4e2a8-37ea-4797-825e-f363a55351ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:03:44.942066 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb4e2a8-37ea-4797-825e-f363a55351ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:44.943102 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590a3a3-0738-4056-a88f-f7d356d878b1 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:44.943529 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb4e2a8-37ea-4797-825e-f363a55351ec None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:44.944799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 18/36] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:03:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:03:44.946218 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2528c01-31ae-4669-9c0d-78c0951e1b84 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:44.951311 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2528c01-31ae-4669-9c0d-78c0951e1b84 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:44.951610 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2528c01-31ae-4669-9c0d-78c0951e1b84 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:44.953219 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 19/37] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:03:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:03:44.953977 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2528c01-31ae-4669-9c0d-78c0951e1b84 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:44.963531 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 19/38] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:03:44.965003 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006976d3-d86e-41ce-800a-dbb1c50ed3bc None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:44.965297 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006976d3-d86e-41ce-800a-dbb1c50ed3bc None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:44.965570 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006976d3-d86e-41ce-800a-dbb1c50ed3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:44.993298 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-006976d3-d86e-41ce-800a-dbb1c50ed3bc None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:03:44.994972 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-006976d3-d86e-41ce-800a-dbb1c50ed3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:03:44.998039 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:45.045608 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:45.080479 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 20/39] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:03:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:03:45.081407 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006976d3-d86e-41ce-800a-dbb1c50ed3bc None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:45.090098 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2528c01-31ae-4669-9c0d-78c0951e1b84 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:45.126023 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c3fbe-f269-4cd8-a8c3-b2143b6afcfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:45.126719 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c3fbe-f269-4cd8-a8c3-b2143b6afcfd None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:45.126992 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c3fbe-f269-4cd8-a8c3-b2143b6afcfd None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:45.127273 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c3fbe-f269-4cd8-a8c3-b2143b6afcfd None admin] PATH_INFO: `/v3/domains/default/users/cf2ffbbfceaa4c36a9027a844dd4920a/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:45.129368 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c3fbe-f269-4cd8-a8c3-b2143b6afcfd None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=cf2ffbbfceaa4c36a9027a844dd4920a, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:45.130847 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c3fbe-f269-4cd8-a8c3-b2143b6afcfd None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:45.146774 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 20/40] 10.222.0.79 () {58 vars in 1361 bytes} [Wed Aug 31 19:03:44 2022] PUT /identity/v3/domains/default/users/cf2ffbbfceaa4c36a9027a844dd4920a/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:03:45.154113 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d76f7f-d3d8-4fb2-8cf8-c2820f83b859 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:45.154113 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d76f7f-d3d8-4fb2-8cf8-c2820f83b859 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:45.154113 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d76f7f-d3d8-4fb2-8cf8-c2820f83b859 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:45.154113 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 21/41] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:03:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:03:45.158488 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e0745-62ac-4c81-bf40-78b92a0d9cf9 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:45.158488 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e0745-62ac-4c81-bf40-78b92a0d9cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:45.158488 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e0745-62ac-4c81-bf40-78b92a0d9cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:45.181358 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-376e0745-62ac-4c81-bf40-78b92a0d9cf9 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:03:45.183302 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-376e0745-62ac-4c81-bf40-78b92a0d9cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:03:45.207841 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006976d3-d86e-41ce-800a-dbb1c50ed3bc None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:45.261062 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ed9ab-a50a-4746-9f5f-17ec72db3b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:45.262288 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ed9ab-a50a-4746-9f5f-17ec72db3b4c None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:45.262673 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ed9ab-a50a-4746-9f5f-17ec72db3b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:45.263113 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ed9ab-a50a-4746-9f5f-17ec72db3b4c None admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:45.264689 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0ed9ab-a50a-4746-9f5f-17ec72db3b4c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:45.266792 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0ed9ab-a50a-4746-9f5f-17ec72db3b4c None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:45.272408 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 22/42] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:03:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:03:45.280655 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:45.307322 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 21/43] 10.222.0.79 () {60 vars in 1141 bytes} [Wed Aug 31 19:03:45 2022] POST /identity/v3/projects => generated 301 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:03:45.353592 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e0745-62ac-4c81-bf40-78b92a0d9cf9 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:45.422172 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:45.479831 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e0745-62ac-4c81-bf40-78b92a0d9cf9 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:45.518601 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96910096-14aa-4620-a735-5b2ed4415cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:45.519810 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96910096-14aa-4620-a735-5b2ed4415cd8 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:45.520095 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96910096-14aa-4620-a735-5b2ed4415cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:45.520399 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96910096-14aa-4620-a735-5b2ed4415cd8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:45.521546 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96910096-14aa-4620-a735-5b2ed4415cd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:45.523144 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96910096-14aa-4620-a735-5b2ed4415cd8 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:45.525131 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 23/44] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:03:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:03:45.530762 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ed9ab-a50a-4746-9f5f-17ec72db3b4c None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:45.562267 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96910096-14aa-4620-a735-5b2ed4415cd8 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:45.648010 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ed9ab-a50a-4746-9f5f-17ec72db3b4c None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:45.686321 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0704abab-2e7b-4d59-9b12-439508caa658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:45.686872 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704abab-2e7b-4d59-9b12-439508caa658 None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:45.687150 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704abab-2e7b-4d59-9b12-439508caa658 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:45.687422 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704abab-2e7b-4d59-9b12-439508caa658 None admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:45.688100 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0704abab-2e7b-4d59-9b12-439508caa658 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:45.689587 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0704abab-2e7b-4d59-9b12-439508caa658 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:45.719365 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 22/45] 10.222.0.79 () {60 vars in 1141 bytes} [Wed Aug 31 19:03:45 2022] POST /identity/v3/projects => generated 312 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:03:45.791286 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96910096-14aa-4620-a735-5b2ed4415cd8 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:45.821523 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:45.838383 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d441fd8-894d-40f3-8512-9dba934fd296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:45.839052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d441fd8-894d-40f3-8512-9dba934fd296 None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:45.839338 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d441fd8-894d-40f3-8512-9dba934fd296 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:45.839619 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d441fd8-894d-40f3-8512-9dba934fd296 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:45.840324 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d441fd8-894d-40f3-8512-9dba934fd296 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:45.841720 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d441fd8-894d-40f3-8512-9dba934fd296 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:45.859231 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 24/46] 10.222.0.79 () {60 vars in 1131 bytes} [Wed Aug 31 19:03:45 2022] POST /identity/v3/roles => generated 223 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:03:47.124728 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcdc84d-bd1a-4532-8bc5-7f543ef1d6fd None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:47.125251 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcdc84d-bd1a-4532-8bc5-7f543ef1d6fd None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:47.125251 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcdc84d-bd1a-4532-8bc5-7f543ef1d6fd None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:47.126649 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 23/47] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:03:47.132040 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625e6bb-001d-4a64-8dac-b966785bbd36 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:47.132950 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625e6bb-001d-4a64-8dac-b966785bbd36 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:47.132950 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625e6bb-001d-4a64-8dac-b966785bbd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:47.150334 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-9625e6bb-001d-4a64-8dac-b966785bbd36 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:03:47.151544 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9625e6bb-001d-4a64-8dac-b966785bbd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:03:47.221430 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 25/48] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:03:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:03:47.490012 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcdc84d-bd1a-4532-8bc5-7f543ef1d6fd None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:47.534498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:47.594577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcdc84d-bd1a-4532-8bc5-7f543ef1d6fd None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:47.627096 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b4a0e-6782-463c-ae1b-050d695ca284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:47.627725 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b4a0e-6782-463c-ae1b-050d695ca284 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:47.628003 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b4a0e-6782-463c-ae1b-050d695ca284 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:47.628784 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b4a0e-6782-463c-ae1b-050d695ca284 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:47.640580 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b4a0e-6782-463c-ae1b-050d695ca284 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:03:47.647249 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-2a1b4a0e-6782-463c-ae1b-050d695ca284 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:03:47.647249 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:03:47.647249 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:03:47.647249 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:03:47.647249 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:03:47.647249 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:03:47.647249 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:03:47.647249 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:03:47.647249 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:03:47.647249 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:03:47.647249 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:03:47.647249 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:03:47.647249 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:03:47.647249 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:03:47.647249 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:03:47.647249 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:03:47.648072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:03:47.648072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:03:47.648072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:03:47.648072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:03:47.648072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:03:47.648072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:03:47.648072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:03:47.648072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:03:47.648072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:03:47.648072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:03:47.648072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:03:47.648072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:03:47.648072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:03:47.648072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:03:47.648072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:03:47.648072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:03:47.649036 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:03:47.649036 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:03:47.649036 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:03:47.649036 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:03:47.649036 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:03:47.649036 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:03:47.649036 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:03:47.649036 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:03:47.649036 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:03:47.649036 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:03:47.649036 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:03:47.649036 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:03:47.649036 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 24/49] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 19:03:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:03:47.654142 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9625e6bb-001d-4a64-8dac-b966785bbd36 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:47.656233 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b97b0-fa5c-4c85-b429-6722b4bd1caa None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:47.656694 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b97b0-fa5c-4c85-b429-6722b4bd1caa None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:47.656969 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b97b0-fa5c-4c85-b429-6722b4bd1caa None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:47.658281 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 25/50] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:03:47.663165 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fd9bb-b8e8-49cb-b25c-e7b1522a2115 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:47.663452 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fd9bb-b8e8-49cb-b25c-e7b1522a2115 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:47.663729 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fd9bb-b8e8-49cb-b25c-e7b1522a2115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:47.681780 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-9e2fd9bb-b8e8-49cb-b25c-e7b1522a2115 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:03:47.683060 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-9e2fd9bb-b8e8-49cb-b25c-e7b1522a2115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:03:47.751611 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 26/51] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:03:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:03:47.755269 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9625e6bb-001d-4a64-8dac-b966785bbd36 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:47.765962 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:47.790441 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19feec0-6774-482a-b251-8ccdce2ebc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:47.791104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19feec0-6774-482a-b251-8ccdce2ebc09 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:47.791382 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19feec0-6774-482a-b251-8ccdce2ebc09 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:47.791654 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19feec0-6774-482a-b251-8ccdce2ebc09 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:47.792320 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19feec0-6774-482a-b251-8ccdce2ebc09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:03:47.792621 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19feec0-6774-482a-b251-8ccdce2ebc09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:47.793984 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19feec0-6774-482a-b251-8ccdce2ebc09 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:47.802913 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 26/52] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:03:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:03:47.808500 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fd9bb-b8e8-49cb-b25c-e7b1522a2115 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:47.839543 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:47.915227 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fd9bb-b8e8-49cb-b25c-e7b1522a2115 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:48.025504 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19feec0-6774-482a-b251-8ccdce2ebc09 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:48.057061 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e18251-7a6c-417d-ad48-fa641f286587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:48.057707 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e18251-7a6c-417d-ad48-fa641f286587 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:48.057996 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e18251-7a6c-417d-ad48-fa641f286587 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:48.058276 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e18251-7a6c-417d-ad48-fa641f286587 None admin] PATH_INFO: `/v3/users/cf2ffbbfceaa4c36a9027a844dd4920a` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:48.059697 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e18251-7a6c-417d-ad48-fa641f286587 None admin] RBAC: Authorizing `identity:get_user(user_id=cf2ffbbfceaa4c36a9027a844dd4920a)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:48.061196 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e18251-7a6c-417d-ad48-fa641f286587 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:48.062845 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 27/53] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:03:47 2022] GET /identity/v3/users/cf2ffbbfceaa4c36a9027a844dd4920a => generated 247 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:03:48.068932 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e18251-7a6c-417d-ad48-fa641f286587 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:48.145141 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19feec0-6774-482a-b251-8ccdce2ebc09 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:48.169581 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:48.174262 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e18251-7a6c-417d-ad48-fa641f286587 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:48.181041 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3635d9c-7887-4665-baba-2fa50edc4a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:48.181683 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3635d9c-7887-4665-baba-2fa50edc4a35 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:48.181967 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3635d9c-7887-4665-baba-2fa50edc4a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:48.182243 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3635d9c-7887-4665-baba-2fa50edc4a35 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:48.183400 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3635d9c-7887-4665-baba-2fa50edc4a35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:48.184866 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3635d9c-7887-4665-baba-2fa50edc4a35 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:48.186484 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 27/54] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:03:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:03:48.192638 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3635d9c-7887-4665-baba-2fa50edc4a35 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:48.211876 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946a6b0-0c52-47ce-b9ca-02743447a8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:48.212570 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946a6b0-0c52-47ce-b9ca-02743447a8bb None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:48.212857 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946a6b0-0c52-47ce-b9ca-02743447a8bb None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:48.213144 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946a6b0-0c52-47ce-b9ca-02743447a8bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:48.214319 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946a6b0-0c52-47ce-b9ca-02743447a8bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:48.215828 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946a6b0-0c52-47ce-b9ca-02743447a8bb None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:48.217594 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 28/55] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:03:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:03:48.223225 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946a6b0-0c52-47ce-b9ca-02743447a8bb None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:48.235580 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:48.297939 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3635d9c-7887-4665-baba-2fa50edc4a35 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:48.329447 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946a6b0-0c52-47ce-b9ca-02743447a8bb None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:48.332041 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ef602-1537-406f-b3f5-8557c6bd91fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:48.332660 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ef602-1537-406f-b3f5-8557c6bd91fd None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:48.332946 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ef602-1537-406f-b3f5-8557c6bd91fd None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:48.333227 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ef602-1537-406f-b3f5-8557c6bd91fd None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:48.333889 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ef602-1537-406f-b3f5-8557c6bd91fd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:48.335502 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ef602-1537-406f-b3f5-8557c6bd91fd None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:48.366169 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b21f4-1401-49bc-8ec8-e06dc2c7aa86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:48.366812 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b21f4-1401-49bc-8ec8-e06dc2c7aa86 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:48.367096 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b21f4-1401-49bc-8ec8-e06dc2c7aa86 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:48.367312 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 28/56] 10.222.0.79 () {60 vars in 1140 bytes} [Wed Aug 31 19:03:48 2022] POST /identity/v3/projects => generated 298 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:03:48.367443 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b21f4-1401-49bc-8ec8-e06dc2c7aa86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:48.368131 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b21f4-1401-49bc-8ec8-e06dc2c7aa86 None admin] RBAC: Adding query filter params (role.id=edc551338adb4ae88bdafc591ad69582, scope.domain.id=default, user.id=cf2ffbbfceaa4c36a9027a844dd4920a) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:03:48.368441 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b21f4-1401-49bc-8ec8-e06dc2c7aa86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:48.369885 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b21f4-1401-49bc-8ec8-e06dc2c7aa86 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:48.382800 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 29/57] 10.222.0.79 () {56 vars in 1322 bytes} [Wed Aug 31 19:03:48 2022] GET /identity/v3/role_assignments?user.id=cf2ffbbfceaa4c36a9027a844dd4920a&scope.domain.id=default&role.id=edc551338adb4ae88bdafc591ad69582 => generated 530 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:03:50.301307 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e0e19-0549-4f0c-8840-ab81f7e62a22 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:50.301886 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e0e19-0549-4f0c-8840-ab81f7e62a22 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:50.301886 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e0e19-0549-4f0c-8840-ab81f7e62a22 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:50.303249 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 29/58] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:03:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:03:50.308343 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508204f-7897-4019-9820-602c94a94c4f None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:50.308761 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508204f-7897-4019-9820-602c94a94c4f None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:50.308907 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508204f-7897-4019-9820-602c94a94c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:50.327414 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-0508204f-7897-4019-9820-602c94a94c4f None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:03:50.328613 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-0508204f-7897-4019-9820-602c94a94c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:03:50.354697 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:50.395165 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 30/59] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:03:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:03:50.662004 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e0e19-0549-4f0c-8840-ab81f7e62a22 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:50.755341 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:50.765074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e0e19-0549-4f0c-8840-ab81f7e62a22 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:50.797306 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ed0de-70e2-4946-880e-c60dc4a778aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:50.797921 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ed0de-70e2-4946-880e-c60dc4a778aa None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:50.798199 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ed0de-70e2-4946-880e-c60dc4a778aa None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:50.798491 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ed0de-70e2-4946-880e-c60dc4a778aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:50.799587 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ed0de-70e2-4946-880e-c60dc4a778aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:50.801667 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ed0de-70e2-4946-880e-c60dc4a778aa None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:50.803255 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 30/60] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:03:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:03:50.808906 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508204f-7897-4019-9820-602c94a94c4f None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:50.904661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508204f-7897-4019-9820-602c94a94c4f None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:50.938900 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fadeb1e-82b1-48c8-9c86-a9582a0fce4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:50.939442 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadeb1e-82b1-48c8-9c86-a9582a0fce4d None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:50.939721 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadeb1e-82b1-48c8-9c86-a9582a0fce4d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:50.939993 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadeb1e-82b1-48c8-9c86-a9582a0fce4d None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:50.940634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fadeb1e-82b1-48c8-9c86-a9582a0fce4d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:50.942100 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fadeb1e-82b1-48c8-9c86-a9582a0fce4d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:50.973737 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 31/61] 10.222.0.79 () {60 vars in 1132 bytes} [Wed Aug 31 19:03:50 2022] POST /identity/v3/users => generated 275 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:03:53.868633 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44485cc-0b6a-4232-b7d6-c32a69789b07 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:53.869496 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44485cc-0b6a-4232-b7d6-c32a69789b07 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:53.869911 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44485cc-0b6a-4232-b7d6-c32a69789b07 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:53.871824 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 31/62] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:03:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:03:53.873708 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c372374-c98f-4c1e-bb9c-f75630aaaca4 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:53.874560 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c372374-c98f-4c1e-bb9c-f75630aaaca4 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:53.875031 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c372374-c98f-4c1e-bb9c-f75630aaaca4 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:53.876584 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 32/63] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:03:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:03:53.878814 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aaf2a6-223d-4eab-af0e-eaf0600649c6 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:53.879336 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aaf2a6-223d-4eab-af0e-eaf0600649c6 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:53.879798 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aaf2a6-223d-4eab-af0e-eaf0600649c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:53.886041 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34c017-6439-4508-ad9a-bb2e6d066829 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:53.888067 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34c017-6439-4508-ad9a-bb2e6d066829 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:53.889351 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34c017-6439-4508-ad9a-bb2e6d066829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:53.912149 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-81aaf2a6-223d-4eab-af0e-eaf0600649c6 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:03:53.913707 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-81aaf2a6-223d-4eab-af0e-eaf0600649c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:03:53.938876 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-ba34c017-6439-4508-ad9a-bb2e6d066829 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:03:53.941131 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-ba34c017-6439-4508-ad9a-bb2e6d066829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:03:53.966136 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:54.054109 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 33/64] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:03:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:03:54.064341 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 32/65] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:03:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:03:54.332494 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf80661-4297-4e0f-9ad0-c86d28a3740b None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:54.333171 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf80661-4297-4e0f-9ad0-c86d28a3740b None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:54.333655 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf80661-4297-4e0f-9ad0-c86d28a3740b None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:54.335256 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 34/66] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:03:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:03:54.340538 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636e4c9-46d9-4e97-b0fa-2fb2ab45784e None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:54.340825 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636e4c9-46d9-4e97-b0fa-2fb2ab45784e None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:54.341104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636e4c9-46d9-4e97-b0fa-2fb2ab45784e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:54.367627 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-b636e4c9-46d9-4e97-b0fa-2fb2ab45784e None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:03:54.368824 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b636e4c9-46d9-4e97-b0fa-2fb2ab45784e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:03:54.447100 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 33/67] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:03:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:03:54.496255 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf80661-4297-4e0f-9ad0-c86d28a3740b None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:54.540164 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26dd1b-3ea0-4ea9-a9e3-4a177efe709a None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:54.540454 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26dd1b-3ea0-4ea9-a9e3-4a177efe709a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:54.540734 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26dd1b-3ea0-4ea9-a9e3-4a177efe709a None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:54.543583 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 34/68] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:03:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:03:54.553554 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc2559-40ad-4323-a6c2-97b8e8aaab54 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:54.553833 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc2559-40ad-4323-a6c2-97b8e8aaab54 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:54.554113 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc2559-40ad-4323-a6c2-97b8e8aaab54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:54.581080 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-b9bc2559-40ad-4323-a6c2-97b8e8aaab54 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:03:54.582585 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b9bc2559-40ad-4323-a6c2-97b8e8aaab54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:03:54.604886 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:54.647554 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf80661-4297-4e0f-9ad0-c86d28a3740b None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:54.679878 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 35/69] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:03:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:03:54.681267 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc2559-40ad-4323-a6c2-97b8e8aaab54 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:54.696548 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130603d-ecf2-4acf-91ab-930af602cc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:54.697200 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130603d-ecf2-4acf-91ab-930af602cc68 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:54.697485 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130603d-ecf2-4acf-91ab-930af602cc68 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:54.697764 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130603d-ecf2-4acf-91ab-930af602cc68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:54.711967 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a130603d-ecf2-4acf-91ab-930af602cc68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:03:54.718628 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-a130603d-ecf2-4acf-91ab-930af602cc68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:03:54.718628 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:03:54.718628 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:03:54.718628 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:03:54.718628 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:03:54.718628 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:03:54.718628 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:03:54.718628 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:03:54.718628 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:03:54.718628 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:03:54.718628 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:03:54.718628 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:03:54.718628 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:03:54.718628 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:03:54.718628 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:03:54.718628 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:03:54.719467 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:03:54.719467 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:03:54.719467 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:03:54.719467 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:03:54.719467 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:03:54.719467 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:03:54.719467 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:03:54.719467 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:03:54.719467 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:03:54.719467 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:03:54.719467 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:03:54.719467 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:03:54.719467 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:03:54.719467 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:03:54.719467 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:03:54.719467 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:03:54.720230 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:03:54.720230 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:03:54.720230 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:03:54.720230 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:03:54.720230 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:03:54.720230 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:03:54.720230 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:03:54.720230 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:03:54.720230 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:03:54.720230 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:03:54.720230 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:03:54.720230 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:03:54.721917 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 35/70] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 19:03:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:03:54.728658 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130603d-ecf2-4acf-91ab-930af602cc68 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:54.754817 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:54.840213 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc2559-40ad-4323-a6c2-97b8e8aaab54 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:54.878962 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130603d-ecf2-4acf-91ab-930af602cc68 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:54.886217 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2cd21-9e73-4cd9-98df-c22b9fc2f3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:54.887482 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2cd21-9e73-4cd9-98df-c22b9fc2f3de None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:54.887947 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2cd21-9e73-4cd9-98df-c22b9fc2f3de None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:54.888397 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2cd21-9e73-4cd9-98df-c22b9fc2f3de None admin] PATH_INFO: `/v3/roles/member` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:54.901899 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2cd21-9e73-4cd9-98df-c22b9fc2f3de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:03:54.907227 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-49d2cd21-9e73-4cd9-98df-c22b9fc2f3de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:03:54.907227 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:03:54.907227 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:03:54.907227 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:03:54.907227 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:03:54.907227 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:03:54.907227 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:03:54.907227 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:03:54.907227 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:03:54.907227 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:03:54.907227 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:03:54.907227 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:03:54.907227 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:03:54.907227 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:03:54.907227 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:03:54.907227 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:03:54.908120 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:03:54.908120 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:03:54.908120 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:03:54.908120 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:03:54.908120 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:03:54.908120 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:03:54.908120 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:03:54.908120 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:03:54.908120 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:03:54.908120 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:03:54.908120 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:03:54.908120 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:03:54.908120 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:03:54.908120 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:03:54.908120 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:03:54.908120 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:03:54.908872 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:03:54.908872 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:03:54.908872 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:03:54.908872 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:03:54.908872 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:03:54.908872 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:03:54.908872 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:03:54.908872 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:03:54.908872 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:03:54.908872 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:03:54.908872 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:03:54.908872 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:03:54.911799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 36/71] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:03:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:03:54.912859 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2cd21-9e73-4cd9-98df-c22b9fc2f3de None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:54.924698 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b105769-5852-48e8-bacd-81630069743c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:54.925860 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b105769-5852-48e8-bacd-81630069743c None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:54.926166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b105769-5852-48e8-bacd-81630069743c None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:54.926910 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b105769-5852-48e8-bacd-81630069743c None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:54.927607 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b105769-5852-48e8-bacd-81630069743c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:03:54.928084 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:54.928266 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b105769-5852-48e8-bacd-81630069743c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:54.929986 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b105769-5852-48e8-bacd-81630069743c None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:54.945234 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 36/72] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:03:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:03:54.947050 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b105769-5852-48e8-bacd-81630069743c None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:55.025574 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:55.027288 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2cd21-9e73-4cd9-98df-c22b9fc2f3de None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:55.059244 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b105769-5852-48e8-bacd-81630069743c None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:55.063558 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3491d94-1d68-4dee-8599-f3da512db4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:55.064195 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3491d94-1d68-4dee-8599-f3da512db4ce None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:55.064480 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3491d94-1d68-4dee-8599-f3da512db4ce None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:55.064756 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3491d94-1d68-4dee-8599-f3da512db4ce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:55.077617 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3491d94-1d68-4dee-8599-f3da512db4ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:03:55.084858 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-c3491d94-1d68-4dee-8599-f3da512db4ce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:03:55.084858 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:03:55.084858 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:03:55.084858 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:03:55.084858 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:03:55.084858 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:03:55.084858 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:03:55.084858 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:03:55.084858 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:03:55.084858 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:03:55.084858 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:03:55.084858 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:03:55.084858 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:03:55.084858 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:03:55.084858 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:03:55.084858 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:03:55.085906 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:03:55.085906 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:03:55.085906 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:03:55.085906 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:03:55.085906 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:03:55.085906 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:03:55.085906 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:03:55.085906 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:03:55.085906 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:03:55.085906 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:03:55.085906 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:03:55.085906 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:03:55.085906 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:03:55.085906 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:03:55.085906 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:03:55.085906 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:03:55.092311 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:03:55.092311 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:03:55.092311 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:03:55.092311 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:03:55.092311 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:03:55.092311 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:03:55.092311 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:03:55.092311 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:03:55.092311 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:03:55.092311 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:03:55.092311 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:03:55.092311 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:03:55.092311 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 37/73] 10.222.0.79 () {56 vars in 1114 bytes} [Wed Aug 31 19:03:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:03:55.092311 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe546f42-2b44-46a7-be29-9c88c4c9066d None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:55.093594 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe546f42-2b44-46a7-be29-9c88c4c9066d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:55.093594 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe546f42-2b44-46a7-be29-9c88c4c9066d None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:55.093594 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 38/74] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:03:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:03:55.093594 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe546f42-2b44-46a7-be29-9c88c4c9066d None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:55.098185 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9360c-b388-4798-a3e5-ace89d90883d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:55.098830 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9360c-b388-4798-a3e5-ace89d90883d None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:55.099115 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9360c-b388-4798-a3e5-ace89d90883d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:55.099391 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9360c-b388-4798-a3e5-ace89d90883d None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:55.100067 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9360c-b388-4798-a3e5-ace89d90883d None admin] RBAC: Adding query filter params (name=member) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:03:55.100371 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9360c-b388-4798-a3e5-ace89d90883d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:55.101797 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9360c-b388-4798-a3e5-ace89d90883d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:55.110691 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 37/75] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 19:03:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:03:55.111503 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9360c-b388-4798-a3e5-ace89d90883d None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:55.168264 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:55.210850 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe546f42-2b44-46a7-be29-9c88c4c9066d None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:55.217191 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9360c-b388-4798-a3e5-ace89d90883d None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:55.246201 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e9224-b85f-45e0-9f8a-b638d8c22493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:55.246869 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e9224-b85f-45e0-9f8a-b638d8c22493 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:55.247151 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e9224-b85f-45e0-9f8a-b638d8c22493 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:55.247428 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e9224-b85f-45e0-9f8a-b638d8c22493 None admin] PATH_INFO: `/v3/users/cf2ffbbfceaa4c36a9027a844dd4920a` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:55.248571 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e9224-b85f-45e0-9f8a-b638d8c22493 None admin] RBAC: Authorizing `identity:get_user(user_id=cf2ffbbfceaa4c36a9027a844dd4920a)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:55.250328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e9224-b85f-45e0-9f8a-b638d8c22493 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:55.251962 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 39/76] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:03:55 2022] GET /identity/v3/users/cf2ffbbfceaa4c36a9027a844dd4920a => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:03:55.252717 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e9224-b85f-45e0-9f8a-b638d8c22493 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:55.257386 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:55.262935 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725312d-1e82-405b-ae5e-8ba3158839ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:55.263766 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725312d-1e82-405b-ae5e-8ba3158839ff None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:55.264052 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725312d-1e82-405b-ae5e-8ba3158839ff None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:55.264354 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725312d-1e82-405b-ae5e-8ba3158839ff None admin] PATH_INFO: `/v3/roles/member` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:55.279022 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7725312d-1e82-405b-ae5e-8ba3158839ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:03:55.289000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-7725312d-1e82-405b-ae5e-8ba3158839ff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:03:55.289000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:03:55.289000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:03:55.289000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:03:55.289000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:03:55.289000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:03:55.289000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:03:55.289000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:03:55.289000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:03:55.289000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:03:55.289000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:03:55.289000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:03:55.289000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:03:55.289000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:03:55.289000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:03:55.289000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:03:55.289945 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:03:55.289945 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:03:55.289945 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:03:55.289945 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:03:55.289945 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:03:55.289945 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:03:55.289945 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:03:55.289945 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:03:55.289945 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:03:55.289945 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:03:55.289945 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:03:55.289945 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:03:55.289945 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:03:55.289945 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:03:55.289945 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:03:55.289945 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:03:55.290755 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:03:55.290755 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:03:55.290755 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:03:55.290755 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:03:55.290755 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:03:55.290755 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:03:55.290755 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:03:55.290755 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:03:55.290755 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:03:55.290755 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:03:55.290755 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:03:55.290755 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:03:55.290755 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 38/77] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:03:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:03:55.292904 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e7d3f-1ec9-4de1-ba1b-8fa5397d952c None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:55.293385 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e7d3f-1ec9-4de1-ba1b-8fa5397d952c None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:55.293862 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e7d3f-1ec9-4de1-ba1b-8fa5397d952c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:55.314721 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-ca8e7d3f-1ec9-4de1-ba1b-8fa5397d952c None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:03:55.315949 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-ca8e7d3f-1ec9-4de1-ba1b-8fa5397d952c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:03:55.368299 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e9224-b85f-45e0-9f8a-b638d8c22493 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:55.383272 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 39/78] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:03:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:03:55.384133 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e7d3f-1ec9-4de1-ba1b-8fa5397d952c None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:55.407731 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe85eee9-1e8f-49aa-81a9-9451f156720c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:55.408417 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe85eee9-1e8f-49aa-81a9-9451f156720c None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:55.408619 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe85eee9-1e8f-49aa-81a9-9451f156720c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:55.408895 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe85eee9-1e8f-49aa-81a9-9451f156720c None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:55.410283 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe85eee9-1e8f-49aa-81a9-9451f156720c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:03:55.410387 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe85eee9-1e8f-49aa-81a9-9451f156720c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:55.411792 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe85eee9-1e8f-49aa-81a9-9451f156720c None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:55.417812 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:55.426783 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 40/79] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:03:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:03:55.427465 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe85eee9-1e8f-49aa-81a9-9451f156720c None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:55.490208 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e7d3f-1ec9-4de1-ba1b-8fa5397d952c None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:55.514316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:55.529290 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc3668-318f-406d-8fac-7a0039b12260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:55.529938 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc3668-318f-406d-8fac-7a0039b12260 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:55.530388 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc3668-318f-406d-8fac-7a0039b12260 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:55.530703 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc3668-318f-406d-8fac-7a0039b12260 None admin] PATH_INFO: `/v3/users/c9ec217226154f31b80930cdc63bd156` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:55.543108 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe85eee9-1e8f-49aa-81a9-9451f156720c None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:55.550121 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc3668-318f-406d-8fac-7a0039b12260 None admin] RBAC: Authorizing `identity:get_user(user_id=c9ec217226154f31b80930cdc63bd156)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:55.552020 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc3668-318f-406d-8fac-7a0039b12260 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:55.559402 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 40/80] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:03:55 2022] GET /identity/v3/users/c9ec217226154f31b80930cdc63bd156 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:03:55.559402 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc3668-318f-406d-8fac-7a0039b12260 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:55.583757 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6812a4-3393-498c-8849-f2bb1618fbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:55.584384 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6812a4-3393-498c-8849-f2bb1618fbae None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:55.584668 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6812a4-3393-498c-8849-f2bb1618fbae None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:55.584945 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6812a4-3393-498c-8849-f2bb1618fbae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:55.656498 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:55.658830 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6812a4-3393-498c-8849-f2bb1618fbae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:55.661259 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6812a4-3393-498c-8849-f2bb1618fbae None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:55.669908 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc3668-318f-406d-8fac-7a0039b12260 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:55.703987 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a4d1c-7670-427c-8329-038da7db77b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:55.704605 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a4d1c-7670-427c-8329-038da7db77b0 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:55.704887 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a4d1c-7670-427c-8329-038da7db77b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:55.705162 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a4d1c-7670-427c-8329-038da7db77b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:55.705833 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a4d1c-7670-427c-8329-038da7db77b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:03:55.706135 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a4d1c-7670-427c-8329-038da7db77b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:55.708051 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a4d1c-7670-427c-8329-038da7db77b0 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:55.716831 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 41/81] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 19:03:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:03:55.717651 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a4d1c-7670-427c-8329-038da7db77b0 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:55.761129 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:55.761446 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 41/82] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:03:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:03:55.762697 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6812a4-3393-498c-8849-f2bb1618fbae None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:55.826270 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a4d1c-7670-427c-8329-038da7db77b0 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:55.863807 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:55.864199 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8579a8-8585-442a-8e1f-374e8e4033f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:55.864843 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8579a8-8585-442a-8e1f-374e8e4033f9 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:55.865149 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8579a8-8585-442a-8e1f-374e8e4033f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:55.865742 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8579a8-8585-442a-8e1f-374e8e4033f9 None admin] PATH_INFO: `/v3/users/c9ec217226154f31b80930cdc63bd156` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:55.866921 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8579a8-8585-442a-8e1f-374e8e4033f9 None admin] RBAC: Authorizing `identity:get_user(user_id=c9ec217226154f31b80930cdc63bd156)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:55.867210 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6812a4-3393-498c-8849-f2bb1618fbae None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:55.871819 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8579a8-8585-442a-8e1f-374e8e4033f9 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:55.871819 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 42/83] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:03:55 2022] GET /identity/v3/users/c9ec217226154f31b80930cdc63bd156 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:03:55.871819 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8579a8-8585-442a-8e1f-374e8e4033f9 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:55.913827 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09676c1-c0bf-4671-a6db-04f8e167ba06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:55.914588 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09676c1-c0bf-4671-a6db-04f8e167ba06 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:55.914828 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09676c1-c0bf-4671-a6db-04f8e167ba06 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:55.915035 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09676c1-c0bf-4671-a6db-04f8e167ba06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:55.981207 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8579a8-8585-442a-8e1f-374e8e4033f9 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:55.990139 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09676c1-c0bf-4671-a6db-04f8e167ba06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:55.991685 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09676c1-c0bf-4671-a6db-04f8e167ba06 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:55.992893 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:56.019896 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e5373-8596-4e70-b4e5-5d0e819eea2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:56.020539 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e5373-8596-4e70-b4e5-5d0e819eea2c None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:56.020826 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e5373-8596-4e70-b4e5-5d0e819eea2c None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:56.021103 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e5373-8596-4e70-b4e5-5d0e819eea2c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:56.022238 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e5373-8596-4e70-b4e5-5d0e819eea2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:56.023754 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e5373-8596-4e70-b4e5-5d0e819eea2c None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:56.025381 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 43/84] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:03:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:03:56.026146 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e5373-8596-4e70-b4e5-5d0e819eea2c None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:56.096075 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:56.103457 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 42/85] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:03:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:03:56.104661 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09676c1-c0bf-4671-a6db-04f8e167ba06 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:56.127355 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e5373-8596-4e70-b4e5-5d0e819eea2c None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:56.167687 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f6ae88-cddf-45af-aee6-a9a7c8243377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:56.168241 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6ae88-cddf-45af-aee6-a9a7c8243377 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:56.168516 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6ae88-cddf-45af-aee6-a9a7c8243377 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:56.168791 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6ae88-cddf-45af-aee6-a9a7c8243377 None admin] PATH_INFO: `/v3/users/c9ec217226154f31b80930cdc63bd156` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:56.169922 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f6ae88-cddf-45af-aee6-a9a7c8243377 None admin] RBAC: Authorizing `identity:get_user(user_id=c9ec217226154f31b80930cdc63bd156)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:56.171392 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f6ae88-cddf-45af-aee6-a9a7c8243377 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:56.172974 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 44/86] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:03:56 2022] GET /identity/v3/users/c9ec217226154f31b80930cdc63bd156 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:03:56.177709 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f6ae88-cddf-45af-aee6-a9a7c8243377 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:56.209882 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09676c1-c0bf-4671-a6db-04f8e167ba06 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:56.222872 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:56.245738 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9bba4-95b8-4805-a9bf-edc2f391cfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:56.246380 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9bba4-95b8-4805-a9bf-edc2f391cfff None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:56.246698 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9bba4-95b8-4805-a9bf-edc2f391cfff None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:56.246981 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9bba4-95b8-4805-a9bf-edc2f391cfff None admin] PATH_INFO: `/v3/projects/898cfe9ce73e43bc84af8abd019b8d31` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:56.248120 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9bba4-95b8-4805-a9bf-edc2f391cfff None admin] RBAC: Authorizing `identity:get_project(project_id=898cfe9ce73e43bc84af8abd019b8d31)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:56.250384 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9bba4-95b8-4805-a9bf-edc2f391cfff None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:56.251450 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 43/87] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:03:56 2022] GET /identity/v3/projects/898cfe9ce73e43bc84af8abd019b8d31 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:03:56.252204 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9bba4-95b8-4805-a9bf-edc2f391cfff None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:56.292431 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f6ae88-cddf-45af-aee6-a9a7c8243377 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:56.320419 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:56.326585 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8968661-c805-4c1d-9fd3-d570c5b1dfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:56.327199 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8968661-c805-4c1d-9fd3-d570c5b1dfd7 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:56.327475 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8968661-c805-4c1d-9fd3-d570c5b1dfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:56.327745 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8968661-c805-4c1d-9fd3-d570c5b1dfd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:56.356874 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9bba4-95b8-4805-a9bf-edc2f391cfff None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:56.391920 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e84b11-9a4a-4a50-b867-f6309ed23af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:56.392536 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e84b11-9a4a-4a50-b867-f6309ed23af5 None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:56.392814 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e84b11-9a4a-4a50-b867-f6309ed23af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:56.393087 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e84b11-9a4a-4a50-b867-f6309ed23af5 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:56.393773 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e84b11-9a4a-4a50-b867-f6309ed23af5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:56.395235 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e84b11-9a4a-4a50-b867-f6309ed23af5 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:56.397687 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8968661-c805-4c1d-9fd3-d570c5b1dfd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:56.399261 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8968661-c805-4c1d-9fd3-d570c5b1dfd7 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:56.423772 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 44/88] 10.222.0.79 () {60 vars in 1132 bytes} [Wed Aug 31 19:03:56 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:03:56.424540 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e84b11-9a4a-4a50-b867-f6309ed23af5 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:56.451204 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:56.524613 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 45/89] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:03:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:03:56.525630 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8968661-c805-4c1d-9fd3-d570c5b1dfd7 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:56.559892 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e84b11-9a4a-4a50-b867-f6309ed23af5 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:56.593019 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:56.606852 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1634298-c252-4656-ac89-1efa1b0327b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:56.607516 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1634298-c252-4656-ac89-1efa1b0327b6 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:56.607797 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1634298-c252-4656-ac89-1efa1b0327b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:56.608076 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1634298-c252-4656-ac89-1efa1b0327b6 None admin] PATH_INFO: `/v3/projects/898cfe9ce73e43bc84af8abd019b8d31` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:56.609455 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1634298-c252-4656-ac89-1efa1b0327b6 None admin] RBAC: Authorizing `identity:get_project(project_id=898cfe9ce73e43bc84af8abd019b8d31)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:56.611746 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1634298-c252-4656-ac89-1efa1b0327b6 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:56.619353 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 45/90] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:03:56 2022] GET /identity/v3/projects/898cfe9ce73e43bc84af8abd019b8d31 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:03:56.620856 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1634298-c252-4656-ac89-1efa1b0327b6 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:56.657911 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8968661-c805-4c1d-9fd3-d570c5b1dfd7 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:56.715149 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4fefa2-321c-4f2a-80fb-8dd58981ffe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:56.716287 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fefa2-321c-4f2a-80fb-8dd58981ffe2 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:56.716738 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fefa2-321c-4f2a-80fb-8dd58981ffe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:56.717158 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fefa2-321c-4f2a-80fb-8dd58981ffe2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:56.739224 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:56.771624 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1634298-c252-4656-ac89-1efa1b0327b6 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:56.805338 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4fefa2-321c-4f2a-80fb-8dd58981ffe2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:56.806864 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4fefa2-321c-4f2a-80fb-8dd58981ffe2 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:56.820997 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3bab6c-42cf-4e3a-a46f-0244cdba5b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:56.822323 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bab6c-42cf-4e3a-a46f-0244cdba5b58 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:56.822832 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bab6c-42cf-4e3a-a46f-0244cdba5b58 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:56.823315 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bab6c-42cf-4e3a-a46f-0244cdba5b58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:56.824274 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3bab6c-42cf-4e3a-a46f-0244cdba5b58 None admin] RBAC: Adding query filter params (role.id=edc551338adb4ae88bdafc591ad69582, scope.project.id=898cfe9ce73e43bc84af8abd019b8d31, user.id=cf2ffbbfceaa4c36a9027a844dd4920a) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:03:56.824770 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3bab6c-42cf-4e3a-a46f-0244cdba5b58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:56.826595 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3bab6c-42cf-4e3a-a46f-0244cdba5b58 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:56.833379 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 46/91] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:03:56 2022] GET /identity/v3/role_assignments?user.id=cf2ffbbfceaa4c36a9027a844dd4920a&scope.project.id=898cfe9ce73e43bc84af8abd019b8d31&role.id=edc551338adb4ae88bdafc591ad69582 => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:03:56.834696 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3bab6c-42cf-4e3a-a46f-0244cdba5b58 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:56.946857 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:56.950585 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 46/92] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:03:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:03:56.951502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4fefa2-321c-4f2a-80fb-8dd58981ffe2 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:57.023135 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3bab6c-42cf-4e3a-a46f-0244cdba5b58 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:57.031376 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:57.064722 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f65893-86c6-41f2-bdf9-fe183d876cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:57.065729 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f65893-86c6-41f2-bdf9-fe183d876cab None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:57.066148 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f65893-86c6-41f2-bdf9-fe183d876cab None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:57.066583 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f65893-86c6-41f2-bdf9-fe183d876cab None admin] PATH_INFO: `/v3/projects/898cfe9ce73e43bc84af8abd019b8d31` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:57.067923 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f65893-86c6-41f2-bdf9-fe183d876cab None admin] RBAC: Authorizing `identity:get_project(project_id=898cfe9ce73e43bc84af8abd019b8d31)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:57.069879 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f65893-86c6-41f2-bdf9-fe183d876cab None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:57.071871 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 47/93] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:03:56 2022] GET /identity/v3/projects/898cfe9ce73e43bc84af8abd019b8d31 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:03:57.072860 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f65893-86c6-41f2-bdf9-fe183d876cab None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:57.140183 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4fefa2-321c-4f2a-80fb-8dd58981ffe2 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:57.180434 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f4f7c-e0ea-4fa8-8072-ba409af0bc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:57.181442 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f4f7c-e0ea-4fa8-8072-ba409af0bc4c None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:57.181935 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f4f7c-e0ea-4fa8-8072-ba409af0bc4c None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:57.182401 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f4f7c-e0ea-4fa8-8072-ba409af0bc4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:57.186576 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f4f7c-e0ea-4fa8-8072-ba409af0bc4c None admin] RBAC: Adding query filter params (role.id=27c44f922df34ac6bcb3794b111cb3da, scope.project.id=898cfe9ce73e43bc84af8abd019b8d31, user.id=c9ec217226154f31b80930cdc63bd156) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:03:57.187145 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f4f7c-e0ea-4fa8-8072-ba409af0bc4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:57.188847 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f4f7c-e0ea-4fa8-8072-ba409af0bc4c None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:57.202280 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 47/94] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:03:56 2022] GET /identity/v3/role_assignments?user.id=c9ec217226154f31b80930cdc63bd156&scope.project.id=898cfe9ce73e43bc84af8abd019b8d31&role.id=27c44f922df34ac6bcb3794b111cb3da => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:03:57.205531 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f4f7c-e0ea-4fa8-8072-ba409af0bc4c None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:57.298728 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f65893-86c6-41f2-bdf9-fe183d876cab None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:57.343372 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:57.367570 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c8343-6aa0-4c98-a31d-a419c06be653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:57.368239 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c8343-6aa0-4c98-a31d-a419c06be653 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:57.368582 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c8343-6aa0-4c98-a31d-a419c06be653 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:57.368933 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c8343-6aa0-4c98-a31d-a419c06be653 None admin] PATH_INFO: `/v3/projects/d9fbdc4a02a14d7a9e3e42b04a943d89` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:57.370163 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c8343-6aa0-4c98-a31d-a419c06be653 None admin] RBAC: Authorizing `identity:get_project(project_id=d9fbdc4a02a14d7a9e3e42b04a943d89)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:57.371685 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c8343-6aa0-4c98-a31d-a419c06be653 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:57.373392 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 48/95] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:03:57 2022] GET /identity/v3/projects/d9fbdc4a02a14d7a9e3e42b04a943d89 => generated 312 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:03:57.380232 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c8343-6aa0-4c98-a31d-a419c06be653 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:03:57.477701 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f4f7c-e0ea-4fa8-8072-ba409af0bc4c None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:57.487712 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c8343-6aa0-4c98-a31d-a419c06be653 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:03:57.498087 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:57.561947 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90641cf-b4da-49d5-8fd7-97bb0330d65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:57.562509 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90641cf-b4da-49d5-8fd7-97bb0330d65d None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:57.562795 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90641cf-b4da-49d5-8fd7-97bb0330d65d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:57.563066 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90641cf-b4da-49d5-8fd7-97bb0330d65d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:57.564337 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90641cf-b4da-49d5-8fd7-97bb0330d65d None admin] RBAC: Adding query filter params (role.id=d01cf7e1efe04d8c8f8d09667717555c, scope.project.id=898cfe9ce73e43bc84af8abd019b8d31, user.id=c9ec217226154f31b80930cdc63bd156) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:03:57.564651 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90641cf-b4da-49d5-8fd7-97bb0330d65d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:57.575055 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90641cf-b4da-49d5-8fd7-97bb0330d65d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:57.578038 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6496d3-6a4e-4ad9-bd31-7fb58407ad01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:03:57.578695 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6496d3-6a4e-4ad9-bd31-7fb58407ad01 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:57.578991 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6496d3-6a4e-4ad9-bd31-7fb58407ad01 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:57.579272 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6496d3-6a4e-4ad9-bd31-7fb58407ad01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:57.580087 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6496d3-6a4e-4ad9-bd31-7fb58407ad01 None admin] RBAC: Adding query filter params (role.id=27c44f922df34ac6bcb3794b111cb3da, scope.project.id=d9fbdc4a02a14d7a9e3e42b04a943d89, user.id=c9ec217226154f31b80930cdc63bd156) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:03:57.580410 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6496d3-6a4e-4ad9-bd31-7fb58407ad01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:03:57.582714 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6496d3-6a4e-4ad9-bd31-7fb58407ad01 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:03:57.589253 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 48/96] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:03:57 2022] GET /identity/v3/role_assignments?user.id=c9ec217226154f31b80930cdc63bd156&scope.project.id=898cfe9ce73e43bc84af8abd019b8d31&role.id=d01cf7e1efe04d8c8f8d09667717555c => generated 259 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:03:57.597558 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 49/97] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:03:57 2022] GET /identity/v3/role_assignments?user.id=c9ec217226154f31b80930cdc63bd156&scope.project.id=d9fbdc4a02a14d7a9e3e42b04a943d89&role.id=27c44f922df34ac6bcb3794b111cb3da => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:03:59.498292 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1b036-680f-4376-896f-e759a11c23ba None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:59.498874 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1b036-680f-4376-896f-e759a11c23ba None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:59.498874 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1b036-680f-4376-896f-e759a11c23ba None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:59.500352 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 49/98] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:03:59.512112 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00f62f-c228-4353-bb5b-55a13ce0f853 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:59.512582 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00f62f-c228-4353-bb5b-55a13ce0f853 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:59.512653 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00f62f-c228-4353-bb5b-55a13ce0f853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:59.547013 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-da00f62f-c228-4353-bb5b-55a13ce0f853 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:03:59.548219 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-da00f62f-c228-4353-bb5b-55a13ce0f853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:03:59.619695 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af6d0e-23b1-40d7-92d8-ae5e396f833e None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:59.620328 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af6d0e-23b1-40d7-92d8-ae5e396f833e None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:59.620827 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af6d0e-23b1-40d7-92d8-ae5e396f833e None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:59.622377 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 50/99] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:03:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:03:59.627690 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d29e48-fcee-4708-936b-9ddc022bf8dd None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:59.628477 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d29e48-fcee-4708-936b-9ddc022bf8dd None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:59.628958 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d29e48-fcee-4708-936b-9ddc022bf8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:59.629243 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:03:59.651322 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-79d29e48-fcee-4708-936b-9ddc022bf8dd None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:03:59.652536 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-79d29e48-fcee-4708-936b-9ddc022bf8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:03:59.658101 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 50/100] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:03:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:03:59.748622 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 51/101] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:03:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:03:59.939866 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78ec44-b1ab-4402-9443-2886028c6d93 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:59.941067 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78ec44-b1ab-4402-9443-2886028c6d93 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:59.941546 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78ec44-b1ab-4402-9443-2886028c6d93 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:59.943140 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 51/102] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:03:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:03:59.948895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c539675-bd43-4bc6-b49b-50db4e2df8ac None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:03:59.949182 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c539675-bd43-4bc6-b49b-50db4e2df8ac None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:03:59.949460 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c539675-bd43-4bc6-b49b-50db4e2df8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:03:59.972873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-0c539675-bd43-4bc6-b49b-50db4e2df8ac None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:03:59.974068 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-0c539675-bd43-4bc6-b49b-50db4e2df8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:00.070965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 52/103] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:03:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:00.144070 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ccd56-4872-4ac3-a9d1-a8f2ec6bab21 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:00.144070 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ccd56-4872-4ac3-a9d1-a8f2ec6bab21 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:00.144070 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ccd56-4872-4ac3-a9d1-a8f2ec6bab21 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:00.144070 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 52/104] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:00.149777 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5f174-7549-4a75-9388-fdc6da28e2a5 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:00.150068 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5f174-7549-4a75-9388-fdc6da28e2a5 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:00.150420 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5f174-7549-4a75-9388-fdc6da28e2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:00.174723 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-33e5f174-7549-4a75-9388-fdc6da28e2a5 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:00.176452 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-33e5f174-7549-4a75-9388-fdc6da28e2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:00.193494 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27af1b-b0f8-4b9a-8b99-7798bbbc822d None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:00.193817 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27af1b-b0f8-4b9a-8b99-7798bbbc822d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:00.194052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27af1b-b0f8-4b9a-8b99-7798bbbc822d None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:00.195425 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 53/105] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:00.200780 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa192e-b392-4015-9507-9ff46dd93b1d None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:00.201311 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa192e-b392-4015-9507-9ff46dd93b1d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:00.201781 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa192e-b392-4015-9507-9ff46dd93b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:00.214215 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:00.235465 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-befa192e-b392-4015-9507-9ff46dd93b1d None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:00.237038 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-befa192e-b392-4015-9507-9ff46dd93b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:00.261162 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 53/106] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:00.291447 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5f174-7549-4a75-9388-fdc6da28e2a5 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:00.389629 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 54/107] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:04:00.390516 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa192e-b392-4015-9507-9ff46dd93b1d None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:00.475558 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5f174-7549-4a75-9388-fdc6da28e2a5 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:00.524050 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b082e-c37b-49f1-a1f5-614fad874493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:00.524859 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b082e-c37b-49f1-a1f5-614fad874493 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:00.525148 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b082e-c37b-49f1-a1f5-614fad874493 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:00.525429 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b082e-c37b-49f1-a1f5-614fad874493 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:00.547468 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b082e-c37b-49f1-a1f5-614fad874493 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:00.554020 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-305b082e-c37b-49f1-a1f5-614fad874493 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:04:00.554020 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:00.554020 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:00.554020 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:00.554020 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:00.554020 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:00.554020 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:00.554020 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:00.554020 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:00.554020 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:00.554020 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:00.554020 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:00.554020 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:00.554020 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:00.554020 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:00.554020 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:00.554928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:00.554928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:00.554928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:00.554928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:00.554928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:00.554928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:00.554928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:00.554928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:00.554928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:00.554928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:00.554928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:00.554928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:00.554928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:00.554928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:00.554928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:00.554928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:00.556640 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:00.556640 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:00.556640 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:00.556640 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:00.556640 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:00.556640 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:00.556640 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:00.556640 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:00.556640 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:00.556640 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:00.556640 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:04:00.556640 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:04:00.556640 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 54/108] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:04:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:04:00.556640 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b082e-c37b-49f1-a1f5-614fad874493 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:00.568619 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa192e-b392-4015-9507-9ff46dd93b1d None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:00.586032 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:00.592930 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:00.606809 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2da1c5-82a3-4cb9-8baf-62ced1338773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:00.607456 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2da1c5-82a3-4cb9-8baf-62ced1338773 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:00.607736 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2da1c5-82a3-4cb9-8baf-62ced1338773 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:00.608009 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2da1c5-82a3-4cb9-8baf-62ced1338773 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:00.609115 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2da1c5-82a3-4cb9-8baf-62ced1338773 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:00.610610 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2da1c5-82a3-4cb9-8baf-62ced1338773 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:00.612351 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 55/109] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:04:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:00.614170 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12deca-acd4-410f-b66b-f50a74c0b2c9 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:00.614451 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12deca-acd4-410f-b66b-f50a74c0b2c9 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:00.614744 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12deca-acd4-410f-b66b-f50a74c0b2c9 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:00.616059 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 56/110] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:00.616698 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12deca-acd4-410f-b66b-f50a74c0b2c9 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:00.693829 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b082e-c37b-49f1-a1f5-614fad874493 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:00.731833 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c71964-99d3-46dd-aa67-4f44d0c75067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:00.732553 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c71964-99d3-46dd-aa67-4f44d0c75067 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:00.732838 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c71964-99d3-46dd-aa67-4f44d0c75067 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:00.733112 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c71964-99d3-46dd-aa67-4f44d0c75067 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:00.740799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12deca-acd4-410f-b66b-f50a74c0b2c9 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:00.747935 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c71964-99d3-46dd-aa67-4f44d0c75067 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:00.752719 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-d1c71964-99d3-46dd-aa67-4f44d0c75067 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:04:00.752719 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:00.752719 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:00.752719 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:00.752719 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:00.752719 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:00.752719 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:00.752719 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:00.752719 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:00.752719 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:00.752719 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:00.752719 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:00.752719 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:00.752719 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:00.752719 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:00.752719 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:00.754273 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:00.754273 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:00.754273 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:00.754273 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:00.754273 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:00.754273 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:00.754273 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:00.754273 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:00.754273 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:00.754273 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:00.754273 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:00.754273 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:00.754273 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:00.754273 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:00.754273 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:00.754273 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:00.760482 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:00.760482 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:00.760482 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:00.760482 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:00.760482 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:00.760482 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:00.760482 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:00.760482 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:00.760482 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:00.760482 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:00.760482 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:04:00.760482 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:04:00.760482 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 55/111] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 19:04:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:00.760482 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c71964-99d3-46dd-aa67-4f44d0c75067 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:00.777012 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f2f5e-9970-45f4-9cfa-f56bdc466aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:00.777649 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f2f5e-9970-45f4-9cfa-f56bdc466aec None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:00.777927 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f2f5e-9970-45f4-9cfa-f56bdc466aec None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:00.778199 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f2f5e-9970-45f4-9cfa-f56bdc466aec None admin] PATH_INFO: `/v3/roles/member` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:00.788477 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f2f5e-9970-45f4-9cfa-f56bdc466aec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:00.793465 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-342f2f5e-9970-45f4-9cfa-f56bdc466aec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:04:00.793465 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:00.793465 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:00.793465 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:00.793465 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:00.793465 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:00.793465 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:00.793465 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:00.793465 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:00.793465 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:00.793465 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:00.793465 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:00.793465 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:00.793465 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:00.793465 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:00.793465 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:00.795441 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:00.795441 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:00.795441 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:00.795441 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:00.795441 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:00.795441 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:00.795441 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:00.795441 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:00.795441 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:00.795441 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:00.795441 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:00.795441 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:00.795441 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:00.795441 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:00.795441 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:00.795441 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:00.796859 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:00.796859 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:00.796859 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:00.796859 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:00.796859 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:00.796859 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:00.796859 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:00.796859 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:00.796859 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:00.796859 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:00.796859 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:04:00.796859 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:04:00.796859 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 57/112] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:04:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:00.796859 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f2f5e-9970-45f4-9cfa-f56bdc466aec None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:00.845047 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:00.853176 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:00.870427 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c71964-99d3-46dd-aa67-4f44d0c75067 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:00.903890 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f2f5e-9970-45f4-9cfa-f56bdc466aec None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:00.905525 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba23c86-6219-4493-b151-48004fe66992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:00.906108 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba23c86-6219-4493-b151-48004fe66992 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:00.906393 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba23c86-6219-4493-b151-48004fe66992 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:00.906694 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba23c86-6219-4493-b151-48004fe66992 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:00.907378 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba23c86-6219-4493-b151-48004fe66992 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:00.907701 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba23c86-6219-4493-b151-48004fe66992 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:00.909134 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba23c86-6219-4493-b151-48004fe66992 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:00.917251 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 56/113] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 19:04:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:00.918619 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9926f4d-93c4-4552-bf17-de04a191d834 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:00.919160 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9926f4d-93c4-4552-bf17-de04a191d834 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:00.919160 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9926f4d-93c4-4552-bf17-de04a191d834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:00.937162 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-d9926f4d-93c4-4552-bf17-de04a191d834 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:00.938340 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d9926f4d-93c4-4552-bf17-de04a191d834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:00.940180 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048e0e3-9f89-4f8a-b6d9-8f2416347349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:00.941514 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048e0e3-9f89-4f8a-b6d9-8f2416347349 None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:00.941791 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048e0e3-9f89-4f8a-b6d9-8f2416347349 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:00.942065 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048e0e3-9f89-4f8a-b6d9-8f2416347349 None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:00.942775 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048e0e3-9f89-4f8a-b6d9-8f2416347349 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:00.944409 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048e0e3-9f89-4f8a-b6d9-8f2416347349 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:00.974674 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 58/114] 10.222.0.79 () {60 vars in 1141 bytes} [Wed Aug 31 19:04:00 2022] POST /identity/v3/projects => generated 302 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:04:00.975518 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048e0e3-9f89-4f8a-b6d9-8f2416347349 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:01.023403 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 57/115] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:01.024647 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9926f4d-93c4-4552-bf17-de04a191d834 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:01.110305 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:01.118235 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048e0e3-9f89-4f8a-b6d9-8f2416347349 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:01.137405 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:01.161130 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c16205-be4e-43f8-a724-bb9e09851a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:01.162031 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c16205-be4e-43f8-a724-bb9e09851a63 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:01.162453 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c16205-be4e-43f8-a724-bb9e09851a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:01.162971 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c16205-be4e-43f8-a724-bb9e09851a63 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:01.164081 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9926f4d-93c4-4552-bf17-de04a191d834 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:01.176491 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c16205-be4e-43f8-a724-bb9e09851a63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:01.182916 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-03c16205-be4e-43f8-a724-bb9e09851a63 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:04:01.182916 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:01.182916 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:01.182916 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:01.182916 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:01.182916 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:01.182916 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:01.182916 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:01.182916 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:01.182916 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:01.182916 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:01.182916 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:01.182916 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:01.182916 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:01.182916 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:01.182916 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:01.183756 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:01.183756 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:01.183756 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:01.183756 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:01.183756 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:01.183756 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:01.183756 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:01.183756 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:01.183756 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:01.183756 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:01.183756 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:01.183756 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:01.183756 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:01.183756 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:01.183756 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:01.183756 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:01.184498 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:01.184498 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:01.184498 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:01.184498 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:01.184498 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:01.184498 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:01.184498 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:01.184498 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:01.184498 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:01.184498 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:01.184498 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:04:01.184498 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:04:01.187782 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 59/116] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:04:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:01.188673 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c16205-be4e-43f8-a724-bb9e09851a63 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:01.203821 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95c234-91d3-4e30-841d-b95ba5eed802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:01.204530 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95c234-91d3-4e30-841d-b95ba5eed802 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:01.204924 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95c234-91d3-4e30-841d-b95ba5eed802 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:01.205308 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95c234-91d3-4e30-841d-b95ba5eed802 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:01.206040 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b95c234-91d3-4e30-841d-b95ba5eed802 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:01.206382 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b95c234-91d3-4e30-841d-b95ba5eed802 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:01.207888 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b95c234-91d3-4e30-841d-b95ba5eed802 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:01.219338 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 58/117] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:04:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:01.219338 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95c234-91d3-4e30-841d-b95ba5eed802 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:01.324186 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c16205-be4e-43f8-a724-bb9e09851a63 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:01.361774 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b7f02-15a8-40b6-afa7-cbe79638df28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:01.362400 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b7f02-15a8-40b6-afa7-cbe79638df28 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:01.363237 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b7f02-15a8-40b6-afa7-cbe79638df28 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:01.363512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b7f02-15a8-40b6-afa7-cbe79638df28 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:01.364228 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b7f02-15a8-40b6-afa7-cbe79638df28 None admin] RBAC: Adding query filter params (name=member) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:01.364535 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b7f02-15a8-40b6-afa7-cbe79638df28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:01.365956 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b7f02-15a8-40b6-afa7-cbe79638df28 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:01.375493 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 60/118] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 19:04:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:01.376641 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b7f02-15a8-40b6-afa7-cbe79638df28 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:01.377495 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95c234-91d3-4e30-841d-b95ba5eed802 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:01.400198 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:01.420501 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c574a-1ae7-4d6c-b55d-c71b83c1712a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:01.421137 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c574a-1ae7-4d6c-b55d-c71b83c1712a None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:01.421417 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c574a-1ae7-4d6c-b55d-c71b83c1712a None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:01.421691 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c574a-1ae7-4d6c-b55d-c71b83c1712a None admin] PATH_INFO: `/v3/users/7299559d155748cda97ae968f028afad` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:01.432226 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:01.438708 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56c574a-1ae7-4d6c-b55d-c71b83c1712a None admin] RBAC: Authorizing `identity:get_user(user_id=7299559d155748cda97ae968f028afad)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:01.440190 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56c574a-1ae7-4d6c-b55d-c71b83c1712a None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:01.442104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 59/119] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:04:01 2022] GET /identity/v3/users/7299559d155748cda97ae968f028afad => generated 289 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:01.443470 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c574a-1ae7-4d6c-b55d-c71b83c1712a None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:01.494420 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b7f02-15a8-40b6-afa7-cbe79638df28 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:01.536059 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb70c7-d11d-4906-a610-b225ff87b75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:01.536691 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb70c7-d11d-4906-a610-b225ff87b75b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:01.536974 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb70c7-d11d-4906-a610-b225ff87b75b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:01.537283 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb70c7-d11d-4906-a610-b225ff87b75b None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:01.537975 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb70c7-d11d-4906-a610-b225ff87b75b None admin] RBAC: Adding query filter params (name=member) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:01.538284 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb70c7-d11d-4906-a610-b225ff87b75b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:01.539866 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb70c7-d11d-4906-a610-b225ff87b75b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:01.555424 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 61/120] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 19:04:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:01.560798 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb70c7-d11d-4906-a610-b225ff87b75b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:01.568399 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c574a-1ae7-4d6c-b55d-c71b83c1712a None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:01.616048 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af4162-8d23-4aa1-95f8-cddf41bd2405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:01.616700 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af4162-8d23-4aa1-95f8-cddf41bd2405 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:01.616989 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af4162-8d23-4aa1-95f8-cddf41bd2405 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:01.617266 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af4162-8d23-4aa1-95f8-cddf41bd2405 None admin] PATH_INFO: `/v3/users/cf2ffbbfceaa4c36a9027a844dd4920a` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:01.618441 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af4162-8d23-4aa1-95f8-cddf41bd2405 None admin] RBAC: Authorizing `identity:get_user(user_id=cf2ffbbfceaa4c36a9027a844dd4920a)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:01.619977 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af4162-8d23-4aa1-95f8-cddf41bd2405 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:01.621963 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 60/121] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:04:01 2022] GET /identity/v3/users/cf2ffbbfceaa4c36a9027a844dd4920a => generated 247 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:01.622447 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af4162-8d23-4aa1-95f8-cddf41bd2405 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:01.655272 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:01.678383 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb70c7-d11d-4906-a610-b225ff87b75b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:01.695519 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:01.714840 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be035d7-0444-4489-9a4d-6e6139a6d418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:01.715484 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be035d7-0444-4489-9a4d-6e6139a6d418 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:01.715767 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be035d7-0444-4489-9a4d-6e6139a6d418 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:01.716039 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be035d7-0444-4489-9a4d-6e6139a6d418 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:01.727413 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be035d7-0444-4489-9a4d-6e6139a6d418 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:01.732741 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-1be035d7-0444-4489-9a4d-6e6139a6d418 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:04:01.732741 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:01.732741 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:01.732741 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:01.732741 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:01.732741 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:01.732741 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:01.732741 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:01.732741 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:01.732741 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:01.732741 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:01.732741 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:01.732741 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:01.732741 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:01.732741 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:01.732741 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:01.733724 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:01.733724 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:01.733724 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:01.733724 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:01.733724 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:01.733724 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:01.733724 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:01.733724 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:01.733724 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:01.733724 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:01.733724 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:01.733724 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:01.733724 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:01.733724 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:01.733724 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:01.733724 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:01.734878 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:01.734878 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:01.734878 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:01.734878 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:01.734878 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:01.734878 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:01.734878 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:01.734878 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:01.734878 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:01.734878 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:01.734878 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:04:01.734878 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:04:01.734878 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 62/122] 10.222.0.79 () {56 vars in 1114 bytes} [Wed Aug 31 19:04:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:01.734878 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be035d7-0444-4489-9a4d-6e6139a6d418 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:01.746260 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af4162-8d23-4aa1-95f8-cddf41bd2405 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:01.783688 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d13a4a-16c9-412a-8853-1fad39f81df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:01.784725 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d13a4a-16c9-412a-8853-1fad39f81df0 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:01.785160 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d13a4a-16c9-412a-8853-1fad39f81df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:01.785562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d13a4a-16c9-412a-8853-1fad39f81df0 None admin] PATH_INFO: `/v3/users/c9ec217226154f31b80930cdc63bd156` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:01.786938 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d13a4a-16c9-412a-8853-1fad39f81df0 None admin] RBAC: Authorizing `identity:get_user(user_id=c9ec217226154f31b80930cdc63bd156)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:01.788847 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d13a4a-16c9-412a-8853-1fad39f81df0 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:01.790668 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 61/123] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:04:01 2022] GET /identity/v3/users/c9ec217226154f31b80930cdc63bd156 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:01.795332 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d13a4a-16c9-412a-8853-1fad39f81df0 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:01.854085 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be035d7-0444-4489-9a4d-6e6139a6d418 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:01.892354 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb43457-76cd-4028-af4e-d7abaf77d6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:01.892975 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb43457-76cd-4028-af4e-d7abaf77d6c5 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:01.893257 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb43457-76cd-4028-af4e-d7abaf77d6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:01.893533 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb43457-76cd-4028-af4e-d7abaf77d6c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:01.904824 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:01.911637 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d13a4a-16c9-412a-8853-1fad39f81df0 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:01.945849 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:01.954490 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23887ec9-3256-412f-8a09-aef015eccb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:01.955318 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23887ec9-3256-412f-8a09-aef015eccb18 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:01.956109 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23887ec9-3256-412f-8a09-aef015eccb18 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:01.956924 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23887ec9-3256-412f-8a09-aef015eccb18 None admin] PATH_INFO: `/v3/users/c9ec217226154f31b80930cdc63bd156` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:01.958293 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23887ec9-3256-412f-8a09-aef015eccb18 None admin] RBAC: Authorizing `identity:get_user(user_id=c9ec217226154f31b80930cdc63bd156)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:01.960459 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23887ec9-3256-412f-8a09-aef015eccb18 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:01.966795 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 62/124] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:04:01 2022] GET /identity/v3/users/c9ec217226154f31b80930cdc63bd156 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:01.966795 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23887ec9-3256-412f-8a09-aef015eccb18 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:01.987561 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb43457-76cd-4028-af4e-d7abaf77d6c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:01.989138 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb43457-76cd-4028-af4e-d7abaf77d6c5 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:02.078027 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23887ec9-3256-412f-8a09-aef015eccb18 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:02.105416 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 63/125] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:04:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:04:02.106299 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb43457-76cd-4028-af4e-d7abaf77d6c5 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:02.119030 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96e0ea-a925-4ed3-b510-055d18e8dc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:02.119755 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96e0ea-a925-4ed3-b510-055d18e8dc43 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:02.120099 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96e0ea-a925-4ed3-b510-055d18e8dc43 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:02.120435 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96e0ea-a925-4ed3-b510-055d18e8dc43 None admin] PATH_INFO: `/v3/projects/898cfe9ce73e43bc84af8abd019b8d31` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:02.121608 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a96e0ea-a925-4ed3-b510-055d18e8dc43 None admin] RBAC: Authorizing `identity:get_project(project_id=898cfe9ce73e43bc84af8abd019b8d31)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:02.123151 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a96e0ea-a925-4ed3-b510-055d18e8dc43 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:02.124954 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 63/126] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:04:01 2022] GET /identity/v3/projects/898cfe9ce73e43bc84af8abd019b8d31 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:02.130908 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96e0ea-a925-4ed3-b510-055d18e8dc43 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:02.156809 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:02.219618 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:02.234701 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb43457-76cd-4028-af4e-d7abaf77d6c5 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:02.255219 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96e0ea-a925-4ed3-b510-055d18e8dc43 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:02.274435 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417b47e-5b24-477c-9156-955c350b5036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:02.275077 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417b47e-5b24-477c-9156-955c350b5036 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:02.275359 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417b47e-5b24-477c-9156-955c350b5036 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:02.275638 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417b47e-5b24-477c-9156-955c350b5036 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:02.276318 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9417b47e-5b24-477c-9156-955c350b5036 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:02.276625 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9417b47e-5b24-477c-9156-955c350b5036 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:02.278020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9417b47e-5b24-477c-9156-955c350b5036 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:02.286923 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 64/127] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:04:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:02.286923 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417b47e-5b24-477c-9156-955c350b5036 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:02.299740 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d696b03a-2967-4ef6-a55f-7799ec9f6c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:02.301239 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d696b03a-2967-4ef6-a55f-7799ec9f6c8d None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:02.301701 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d696b03a-2967-4ef6-a55f-7799ec9f6c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:02.302156 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d696b03a-2967-4ef6-a55f-7799ec9f6c8d None admin] PATH_INFO: `/v3/projects/898cfe9ce73e43bc84af8abd019b8d31` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:02.303951 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d696b03a-2967-4ef6-a55f-7799ec9f6c8d None admin] RBAC: Authorizing `identity:get_project(project_id=898cfe9ce73e43bc84af8abd019b8d31)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:02.306526 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d696b03a-2967-4ef6-a55f-7799ec9f6c8d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:02.310515 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 64/128] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:04:02 2022] GET /identity/v3/projects/898cfe9ce73e43bc84af8abd019b8d31 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:02.311524 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d696b03a-2967-4ef6-a55f-7799ec9f6c8d None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:02.412950 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417b47e-5b24-477c-9156-955c350b5036 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:02.414770 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:02.423391 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d696b03a-2967-4ef6-a55f-7799ec9f6c8d None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:02.456643 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca02079-96d8-43e2-9b7b-606efd6f5bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:02.457279 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca02079-96d8-43e2-9b7b-606efd6f5bc5 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:02.457563 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca02079-96d8-43e2-9b7b-606efd6f5bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:02.457837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca02079-96d8-43e2-9b7b-606efd6f5bc5 None admin] PATH_INFO: `/v3/projects/d9fbdc4a02a14d7a9e3e42b04a943d89` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:02.459002 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca02079-96d8-43e2-9b7b-606efd6f5bc5 None admin] RBAC: Authorizing `identity:get_project(project_id=d9fbdc4a02a14d7a9e3e42b04a943d89)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:02.460457 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca02079-96d8-43e2-9b7b-606efd6f5bc5 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:02.462089 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 65/129] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:04:02 2022] GET /identity/v3/projects/d9fbdc4a02a14d7a9e3e42b04a943d89 => generated 312 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:02.467093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca02079-96d8-43e2-9b7b-606efd6f5bc5 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:02.475777 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f444011-3f32-4f2b-b69b-bf912b457bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:02.476522 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f444011-3f32-4f2b-b69b-bf912b457bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:02.476815 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f444011-3f32-4f2b-b69b-bf912b457bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:02.477339 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f444011-3f32-4f2b-b69b-bf912b457bd1 None admin] PATH_INFO: `/v3/projects/898cfe9ce73e43bc84af8abd019b8d31` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:02.478483 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f444011-3f32-4f2b-b69b-bf912b457bd1 None admin] RBAC: Authorizing `identity:get_project(project_id=898cfe9ce73e43bc84af8abd019b8d31)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:02.479924 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f444011-3f32-4f2b-b69b-bf912b457bd1 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:02.481783 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 65/130] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:04:02 2022] GET /identity/v3/projects/898cfe9ce73e43bc84af8abd019b8d31 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:02.482409 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f444011-3f32-4f2b-b69b-bf912b457bd1 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:02.486155 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:02.594225 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca02079-96d8-43e2-9b7b-606efd6f5bc5 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:02.604790 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f444011-3f32-4f2b-b69b-bf912b457bd1 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:02.637851 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00393dbf-b7d8-4802-aefa-d7e368743346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:02.638640 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00393dbf-b7d8-4802-aefa-d7e368743346 None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:02.638880 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00393dbf-b7d8-4802-aefa-d7e368743346 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:02.639172 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00393dbf-b7d8-4802-aefa-d7e368743346 None admin] PATH_INFO: `/v3/projects/898cfe9ce73e43bc84af8abd019b8d31/users/cf2ffbbfceaa4c36a9027a844dd4920a/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:02.640823 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7d6b0-8d67-4c83-8cb2-32086fa19fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:02.641027 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00393dbf-b7d8-4802-aefa-d7e368743346 None admin] RBAC: Authorizing `identity:create_grant(project_id=898cfe9ce73e43bc84af8abd019b8d31, user_id=cf2ffbbfceaa4c36a9027a844dd4920a, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:02.641462 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7d6b0-8d67-4c83-8cb2-32086fa19fe5 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:02.641744 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7d6b0-8d67-4c83-8cb2-32086fa19fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:02.642020 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7d6b0-8d67-4c83-8cb2-32086fa19fe5 None admin] PATH_INFO: `/v3/users/c9ec217226154f31b80930cdc63bd156` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:02.642560 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00393dbf-b7d8-4802-aefa-d7e368743346 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:02.643322 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7d6b0-8d67-4c83-8cb2-32086fa19fe5 None admin] RBAC: Authorizing `identity:get_user(user_id=c9ec217226154f31b80930cdc63bd156)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:02.644794 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7d6b0-8d67-4c83-8cb2-32086fa19fe5 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:02.651231 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 66/131] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:04:02 2022] GET /identity/v3/users/c9ec217226154f31b80930cdc63bd156 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:02.651231 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7d6b0-8d67-4c83-8cb2-32086fa19fe5 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:02.661780 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 66/132] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 19:04:02 2022] PUT /identity/v3/projects/898cfe9ce73e43bc84af8abd019b8d31/users/cf2ffbbfceaa4c36a9027a844dd4920a/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:04:02.663288 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00393dbf-b7d8-4802-aefa-d7e368743346 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:02.713322 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:02.751558 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:02.792806 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7d6b0-8d67-4c83-8cb2-32086fa19fe5 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:02.836904 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e526c1f-b227-42c1-8131-3f448d809647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:02.837687 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e526c1f-b227-42c1-8131-3f448d809647 None admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:02.837975 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e526c1f-b227-42c1-8131-3f448d809647 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:02.838253 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e526c1f-b227-42c1-8131-3f448d809647 None admin] PATH_INFO: `/v3/projects/898cfe9ce73e43bc84af8abd019b8d31/users/c9ec217226154f31b80930cdc63bd156/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:02.841858 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e526c1f-b227-42c1-8131-3f448d809647 None admin] RBAC: Authorizing `identity:create_grant(project_id=898cfe9ce73e43bc84af8abd019b8d31, user_id=c9ec217226154f31b80930cdc63bd156, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:02.843433 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e526c1f-b227-42c1-8131-3f448d809647 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:02.848510 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00393dbf-b7d8-4802-aefa-d7e368743346 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:02.863747 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 67/133] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 19:04:02 2022] PUT /identity/v3/projects/898cfe9ce73e43bc84af8abd019b8d31/users/c9ec217226154f31b80930cdc63bd156/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:04:02.865558 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e526c1f-b227-42c1-8131-3f448d809647 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:02.907276 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade1cf3-3ebe-4070-bcf0-89e2707df2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:02.908512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade1cf3-3ebe-4070-bcf0-89e2707df2af None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:02.908512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade1cf3-3ebe-4070-bcf0-89e2707df2af None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:02.908512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade1cf3-3ebe-4070-bcf0-89e2707df2af None admin] PATH_INFO: `/v3/projects/d9fbdc4a02a14d7a9e3e42b04a943d89/users/c9ec217226154f31b80930cdc63bd156/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:02.914310 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade1cf3-3ebe-4070-bcf0-89e2707df2af None admin] RBAC: Authorizing `identity:create_grant(project_id=d9fbdc4a02a14d7a9e3e42b04a943d89, user_id=c9ec217226154f31b80930cdc63bd156, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:02.915813 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade1cf3-3ebe-4070-bcf0-89e2707df2af None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:02.949251 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 67/134] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 19:04:02 2022] PUT /identity/v3/projects/d9fbdc4a02a14d7a9e3e42b04a943d89/users/c9ec217226154f31b80930cdc63bd156/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:04:02.950077 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade1cf3-3ebe-4070-bcf0-89e2707df2af None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:03.001463 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e526c1f-b227-42c1-8131-3f448d809647 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:03.056031 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:03.067306 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73acf30-7e8d-4513-a15c-e0bc4d6fced7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:03.067952 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73acf30-7e8d-4513-a15c-e0bc4d6fced7 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:03.068238 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73acf30-7e8d-4513-a15c-e0bc4d6fced7 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:03.068578 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73acf30-7e8d-4513-a15c-e0bc4d6fced7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:03.069360 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73acf30-7e8d-4513-a15c-e0bc4d6fced7 None admin] RBAC: Adding query filter params (role.id=35835d27c5d14dbbb20c5e3f646a40a9, scope.project.id=898cfe9ce73e43bc84af8abd019b8d31, user.id=7299559d155748cda97ae968f028afad) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:03.070544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73acf30-7e8d-4513-a15c-e0bc4d6fced7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:03.072324 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73acf30-7e8d-4513-a15c-e0bc4d6fced7 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:03.082754 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 68/135] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:04:02 2022] GET /identity/v3/role_assignments?user.id=7299559d155748cda97ae968f028afad&scope.project.id=898cfe9ce73e43bc84af8abd019b8d31&role.id=35835d27c5d14dbbb20c5e3f646a40a9 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:03.084928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5d598-b5e4-4d5c-beb9-d3129f264f43 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:03.085259 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5d598-b5e4-4d5c-beb9-d3129f264f43 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:03.085551 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5d598-b5e4-4d5c-beb9-d3129f264f43 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:03.087333 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 69/136] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:03.093338 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1681d-1906-49f0-b2d8-b771ba2e54c9 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:03.093715 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1681d-1906-49f0-b2d8-b771ba2e54c9 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:03.094120 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1681d-1906-49f0-b2d8-b771ba2e54c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:03.121820 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-4dd1681d-1906-49f0-b2d8-b771ba2e54c9 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:03.123723 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:03.124264 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-4dd1681d-1906-49f0-b2d8-b771ba2e54c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:03.139326 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade1cf3-3ebe-4070-bcf0-89e2707df2af None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:03.188775 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683f67a-b71d-4bff-9f97-914d9a1f2d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:03.189465 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683f67a-b71d-4bff-9f97-914d9a1f2d63 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:03.189819 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683f67a-b71d-4bff-9f97-914d9a1f2d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:03.190166 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683f67a-b71d-4bff-9f97-914d9a1f2d63 None admin] PATH_INFO: `/v3/projects/898cfe9ce73e43bc84af8abd019b8d31` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:03.192354 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683f67a-b71d-4bff-9f97-914d9a1f2d63 None admin] RBAC: Authorizing `identity:get_project(project_id=898cfe9ce73e43bc84af8abd019b8d31)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:03.194653 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683f67a-b71d-4bff-9f97-914d9a1f2d63 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:03.197217 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 68/137] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:04:02 2022] GET /identity/v3/projects/898cfe9ce73e43bc84af8abd019b8d31 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:03.203082 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683f67a-b71d-4bff-9f97-914d9a1f2d63 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:03.224271 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 70/138] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:03.320612 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683f67a-b71d-4bff-9f97-914d9a1f2d63 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:03.358377 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bc344-255b-4ddc-99ec-12c64ae5651f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:03.359085 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bc344-255b-4ddc-99ec-12c64ae5651f None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:03.359372 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bc344-255b-4ddc-99ec-12c64ae5651f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:03.359650 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bc344-255b-4ddc-99ec-12c64ae5651f None admin] PATH_INFO: `/v3/projects/898cfe9ce73e43bc84af8abd019b8d31/users/c9ec217226154f31b80930cdc63bd156/roles/d01cf7e1efe04d8c8f8d09667717555c` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:03.361837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198bc344-255b-4ddc-99ec-12c64ae5651f None admin] RBAC: Authorizing `identity:create_grant(project_id=898cfe9ce73e43bc84af8abd019b8d31, user_id=c9ec217226154f31b80930cdc63bd156, role_id=d01cf7e1efe04d8c8f8d09667717555c)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:03.363378 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198bc344-255b-4ddc-99ec-12c64ae5651f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:03.380647 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 69/139] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 19:04:03 2022] PUT /identity/v3/projects/898cfe9ce73e43bc84af8abd019b8d31/users/c9ec217226154f31b80930cdc63bd156/roles/d01cf7e1efe04d8c8f8d09667717555c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:04:03.671598 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1681d-1906-49f0-b2d8-b771ba2e54c9 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:03.790212 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1681d-1906-49f0-b2d8-b771ba2e54c9 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:03.821319 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:03.834707 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203a722-ea99-4f3c-9be8-ad04323adfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:03.835360 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203a722-ea99-4f3c-9be8-ad04323adfff None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:03.835636 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203a722-ea99-4f3c-9be8-ad04323adfff None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:03.835906 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203a722-ea99-4f3c-9be8-ad04323adfff None admin] PATH_INFO: `/v3/domains/default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:03.837034 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203a722-ea99-4f3c-9be8-ad04323adfff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:03.838484 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203a722-ea99-4f3c-9be8-ad04323adfff None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:03.840079 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 71/140] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:04:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:03.846262 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bc344-255b-4ddc-99ec-12c64ae5651f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:03.868261 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:03.975358 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bc344-255b-4ddc-99ec-12c64ae5651f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:04.026793 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0248c8e-d274-40f1-aa99-667d5a56440e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:04.027430 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0248c8e-d274-40f1-aa99-667d5a56440e None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:04.027713 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0248c8e-d274-40f1-aa99-667d5a56440e None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:04.027991 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0248c8e-d274-40f1-aa99-667d5a56440e None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:04.028677 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0248c8e-d274-40f1-aa99-667d5a56440e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:04.030158 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0248c8e-d274-40f1-aa99-667d5a56440e None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:04.060333 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 70/141] 10.222.0.79 () {60 vars in 1132 bytes} [Wed Aug 31 19:04:03 2022] POST /identity/v3/users => generated 283 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:04:05.493859 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79923243-f4d7-47b7-ae23-b552180b648f None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:05.494377 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79923243-f4d7-47b7-ae23-b552180b648f None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:05.494547 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79923243-f4d7-47b7-ae23-b552180b648f None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:05.495973 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 72/142] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:05.502109 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22338944-56fa-4495-bd06-69ba1fa799a8 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:05.503063 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22338944-56fa-4495-bd06-69ba1fa799a8 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:05.503542 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22338944-56fa-4495-bd06-69ba1fa799a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:05.529620 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-22338944-56fa-4495-bd06-69ba1fa799a8 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:05.531203 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-22338944-56fa-4495-bd06-69ba1fa799a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:05.623490 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 71/143] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:04:05.676501 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c185edb-6bdc-4581-bdee-c8e9d5dc73aa None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:05.676798 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c185edb-6bdc-4581-bdee-c8e9d5dc73aa None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:05.677063 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c185edb-6bdc-4581-bdee-c8e9d5dc73aa None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:05.678587 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 73/144] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:05.685530 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9e0b9-5b2c-412f-a10b-abc6dc48be1d None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:05.685821 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9e0b9-5b2c-412f-a10b-abc6dc48be1d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:05.686102 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9e0b9-5b2c-412f-a10b-abc6dc48be1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:05.694996 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:05.713644 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-dee9e0b9-5b2c-412f-a10b-abc6dc48be1d None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:05.715416 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-dee9e0b9-5b2c-412f-a10b-abc6dc48be1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:05.815582 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 72/145] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:06.110509 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c185edb-6bdc-4581-bdee-c8e9d5dc73aa None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:06.196321 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97b5e6-4e2d-43b8-a31c-eb7ddd13479a None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:06.196658 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97b5e6-4e2d-43b8-a31c-eb7ddd13479a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:06.196875 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97b5e6-4e2d-43b8-a31c-eb7ddd13479a None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:06.198257 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 73/146] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:04:06.203532 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8769d-314f-4a12-a23c-f9138d21b9bc None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:06.203882 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8769d-314f-4a12-a23c-f9138d21b9bc None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:06.204161 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8769d-314f-4a12-a23c-f9138d21b9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:06.240013 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-d1b8769d-314f-4a12-a23c-f9138d21b9bc None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:06.241203 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d1b8769d-314f-4a12-a23c-f9138d21b9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:06.299198 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c185edb-6bdc-4581-bdee-c8e9d5dc73aa None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:06.365597 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 74/147] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:04:06.367587 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8769d-314f-4a12-a23c-f9138d21b9bc None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:06.431206 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eee0ea-00cf-4089-8d72-87054361ef74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:06.431867 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eee0ea-00cf-4089-8d72-87054361ef74 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:06.432150 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eee0ea-00cf-4089-8d72-87054361ef74 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:06.432426 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eee0ea-00cf-4089-8d72-87054361ef74 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:06.447684 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eee0ea-00cf-4089-8d72-87054361ef74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:06.456983 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-f2eee0ea-00cf-4089-8d72-87054361ef74 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:04:06.456983 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:06.456983 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:06.456983 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:06.456983 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:06.456983 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:06.456983 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:06.456983 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:06.456983 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:06.456983 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:06.456983 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:06.456983 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:06.456983 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:06.456983 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:06.456983 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:06.456983 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:06.457863 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:06.457863 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:06.457863 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:06.457863 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:06.457863 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:06.457863 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:06.457863 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:06.457863 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:06.457863 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:06.457863 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:06.457863 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:06.457863 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:06.457863 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:06.457863 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:06.457863 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:06.457863 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:06.458648 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:06.458648 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:06.458648 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:06.458648 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:06.458648 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:06.458648 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:06.458648 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:06.458648 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:06.458648 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:06.458648 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:06.458648 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:04:06.458648 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:04:06.458648 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 74/148] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 19:04:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:06.461683 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:06.471509 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eee0ea-00cf-4089-8d72-87054361ef74 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:06.518641 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8769d-314f-4a12-a23c-f9138d21b9bc None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:06.557042 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:06.577306 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1f58f-10e1-4b11-9948-ade0aba3897b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:06.578051 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1f58f-10e1-4b11-9948-ade0aba3897b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:06.578337 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1f58f-10e1-4b11-9948-ade0aba3897b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:06.578636 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1f58f-10e1-4b11-9948-ade0aba3897b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:06.597928 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f1f58f-10e1-4b11-9948-ade0aba3897b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:06.611818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-a8f1f58f-10e1-4b11-9948-ade0aba3897b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:04:06.611818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:06.611818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:06.611818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:06.611818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:06.611818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:06.611818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:06.611818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:06.611818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:06.611818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:06.611818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:06.611818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:06.611818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:06.611818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:06.611818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:06.611818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:06.613285 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:06.613285 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:06.613285 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:06.613285 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:06.613285 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:06.613285 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:06.613285 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:06.613285 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:06.613285 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:06.613285 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:06.613285 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:06.613285 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:06.613285 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:06.613285 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:06.613285 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:06.613285 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:06.614041 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:06.614041 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:06.614041 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:06.614041 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:06.614041 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:06.614041 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:06.614041 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:06.614041 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:06.614041 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:06.614041 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:06.614041 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:04:06.614041 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:04:06.614041 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 75/149] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:04:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:04:06.619898 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1f58f-10e1-4b11-9948-ade0aba3897b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:06.625742 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eee0ea-00cf-4089-8d72-87054361ef74 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:06.691180 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f409411-d291-464d-baa4-8ea6adfb796e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:06.691818 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f409411-d291-464d-baa4-8ea6adfb796e None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:06.692101 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f409411-d291-464d-baa4-8ea6adfb796e None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:06.692374 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f409411-d291-464d-baa4-8ea6adfb796e None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:06.693059 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f409411-d291-464d-baa4-8ea6adfb796e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:06.693363 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f409411-d291-464d-baa4-8ea6adfb796e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:06.694795 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f409411-d291-464d-baa4-8ea6adfb796e None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:06.703928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 75/150] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:04:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:06.714366 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f409411-d291-464d-baa4-8ea6adfb796e None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:06.774481 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1f58f-10e1-4b11-9948-ade0aba3897b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:06.818979 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:06.830500 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b74bc3-4710-43a1-b437-1326ba2912f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:06.831900 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b74bc3-4710-43a1-b437-1326ba2912f0 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:06.832391 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b74bc3-4710-43a1-b437-1326ba2912f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:06.832895 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b74bc3-4710-43a1-b437-1326ba2912f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:06.833768 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b74bc3-4710-43a1-b437-1326ba2912f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:06.834407 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b74bc3-4710-43a1-b437-1326ba2912f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:06.836017 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b74bc3-4710-43a1-b437-1326ba2912f0 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:06.850751 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 76/151] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 19:04:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:06.853191 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb549f01-6e43-4dbb-9b52-c1be6ff6c4d9 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:06.853905 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb549f01-6e43-4dbb-9b52-c1be6ff6c4d9 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:06.854544 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb549f01-6e43-4dbb-9b52-c1be6ff6c4d9 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:06.856676 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 77/152] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:06.863289 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb549f01-6e43-4dbb-9b52-c1be6ff6c4d9 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:06.872380 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f409411-d291-464d-baa4-8ea6adfb796e None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:06.891245 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:06.911876 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135a47e-4e8c-4af9-96cf-6a8a5279a09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:06.912911 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135a47e-4e8c-4af9-96cf-6a8a5279a09d None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:06.913403 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135a47e-4e8c-4af9-96cf-6a8a5279a09d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:06.913873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135a47e-4e8c-4af9-96cf-6a8a5279a09d None admin] PATH_INFO: `/v3/users/cf2ffbbfceaa4c36a9027a844dd4920a` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:06.915324 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3135a47e-4e8c-4af9-96cf-6a8a5279a09d None admin] RBAC: Authorizing `identity:get_user(user_id=cf2ffbbfceaa4c36a9027a844dd4920a)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:06.917042 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3135a47e-4e8c-4af9-96cf-6a8a5279a09d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:06.918877 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 76/153] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:04:06 2022] GET /identity/v3/users/cf2ffbbfceaa4c36a9027a844dd4920a => generated 247 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:06.920321 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c115f7c-886d-440c-9001-2edf705ca7fe None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:06.920838 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c115f7c-886d-440c-9001-2edf705ca7fe None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:06.921409 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c115f7c-886d-440c-9001-2edf705ca7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:06.942253 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-1c115f7c-886d-440c-9001-2edf705ca7fe None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:06.943812 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1c115f7c-886d-440c-9001-2edf705ca7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:07.034363 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 77/154] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:07.040894 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c115f7c-886d-440c-9001-2edf705ca7fe None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:07.044104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb549f01-6e43-4dbb-9b52-c1be6ff6c4d9 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:07.129429 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c190fcb-3e36-49b8-a02e-343c55369ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:07.130404 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c190fcb-3e36-49b8-a02e-343c55369ae9 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:07.130917 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c190fcb-3e36-49b8-a02e-343c55369ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:07.131386 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c190fcb-3e36-49b8-a02e-343c55369ae9 None admin] PATH_INFO: `/v3/users/c9ec217226154f31b80930cdc63bd156` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:07.133172 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c190fcb-3e36-49b8-a02e-343c55369ae9 None admin] RBAC: Authorizing `identity:get_user(user_id=c9ec217226154f31b80930cdc63bd156)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:07.136447 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c190fcb-3e36-49b8-a02e-343c55369ae9 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:07.141686 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 78/155] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:04:06 2022] GET /identity/v3/users/c9ec217226154f31b80930cdc63bd156 => generated 275 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:07.148161 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c190fcb-3e36-49b8-a02e-343c55369ae9 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:07.248291 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:07.263850 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c115f7c-886d-440c-9001-2edf705ca7fe None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:07.294610 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:07.336871 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c190fcb-3e36-49b8-a02e-343c55369ae9 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:07.337908 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5304a35-da3e-4e6e-9607-ebef6e2279f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:07.338826 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5304a35-da3e-4e6e-9607-ebef6e2279f6 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:07.339324 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5304a35-da3e-4e6e-9607-ebef6e2279f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:07.339797 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5304a35-da3e-4e6e-9607-ebef6e2279f6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:07.361551 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5304a35-da3e-4e6e-9607-ebef6e2279f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:07.369049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-a5304a35-da3e-4e6e-9607-ebef6e2279f6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:04:07.369049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:07.369049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:07.369049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:07.369049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:07.369049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:07.369049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:07.369049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:07.369049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:07.369049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:07.369049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:07.369049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:07.369049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:07.369049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:07.369049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:07.369049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:07.369929 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:07.369929 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:07.369929 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:07.369929 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:07.369929 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:07.369929 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:07.369929 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:07.369929 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:07.369929 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:07.369929 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:07.369929 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:07.369929 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:07.369929 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:07.369929 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:07.369929 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:07.369929 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:07.370955 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:07.370955 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:07.370955 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:07.370955 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:07.370955 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:07.370955 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:07.370955 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:07.370955 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:07.370955 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:07.370955 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:07.370955 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:04:07.370955 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:04:07.373571 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 78/156] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:04:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:07.379104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab983e-dc6b-41d5-8a3b-79871eb6ba9b None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:07.379687 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab983e-dc6b-41d5-8a3b-79871eb6ba9b None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:07.380714 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab983e-dc6b-41d5-8a3b-79871eb6ba9b None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:07.382212 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 79/157] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:07.383212 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab983e-dc6b-41d5-8a3b-79871eb6ba9b None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:07.467238 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42adede6-3b51-4f6f-ab37-300836cb8ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:07.467871 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adede6-3b51-4f6f-ab37-300836cb8ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:07.468150 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adede6-3b51-4f6f-ab37-300836cb8ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:07.468423 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adede6-3b51-4f6f-ab37-300836cb8ab6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:07.497533 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab983e-dc6b-41d5-8a3b-79871eb6ba9b None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:07.569529 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5feb9-9e16-48e6-8b38-3e43b57ee463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:07.571012 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5feb9-9e16-48e6-8b38-3e43b57ee463 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:07.574444 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5feb9-9e16-48e6-8b38-3e43b57ee463 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:07.574969 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5feb9-9e16-48e6-8b38-3e43b57ee463 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:07.666943 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:07.678060 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42adede6-3b51-4f6f-ab37-300836cb8ab6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:07.680253 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42adede6-3b51-4f6f-ab37-300836cb8ab6 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:07.722681 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5feb9-9e16-48e6-8b38-3e43b57ee463 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:07.725258 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5feb9-9e16-48e6-8b38-3e43b57ee463 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:07.802141 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:07.904816 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 80/158] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:04:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:04:07.913686 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5feb9-9e16-48e6-8b38-3e43b57ee463 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:07.955676 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 79/159] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:04:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 813 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:04:07.957419 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a96747-041e-4ab2-8582-628c50d6f085 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:07.957915 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a96747-041e-4ab2-8582-628c50d6f085 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:07.958395 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a96747-041e-4ab2-8582-628c50d6f085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:07.992208 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-08a96747-041e-4ab2-8582-628c50d6f085 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:07.995598 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-08a96747-041e-4ab2-8582-628c50d6f085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:08.042707 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:08.085085 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5feb9-9e16-48e6-8b38-3e43b57ee463 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:08.162151 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbefcf39-daa4-44d9-97ce-79dda1bae076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:08.164428 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbefcf39-daa4-44d9-97ce-79dda1bae076 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:08.165601 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbefcf39-daa4-44d9-97ce-79dda1bae076 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:08.166097 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbefcf39-daa4-44d9-97ce-79dda1bae076 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:08.168522 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbefcf39-daa4-44d9-97ce-79dda1bae076 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:08.169228 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbefcf39-daa4-44d9-97ce-79dda1bae076 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:08.171444 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbefcf39-daa4-44d9-97ce-79dda1bae076 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:08.176997 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 80/160] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:08.178568 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a96747-041e-4ab2-8582-628c50d6f085 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:08.197093 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 81/161] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 19:04:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:08.198708 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbefcf39-daa4-44d9-97ce-79dda1bae076 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:08.350225 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:08.365422 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbefcf39-daa4-44d9-97ce-79dda1bae076 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:08.396348 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a96747-041e-4ab2-8582-628c50d6f085 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:08.408312 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9340af-f37e-425f-87f8-19476c1684f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:08.410838 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9340af-f37e-425f-87f8-19476c1684f2 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:08.411343 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9340af-f37e-425f-87f8-19476c1684f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:08.411825 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9340af-f37e-425f-87f8-19476c1684f2 None admin] PATH_INFO: `/v3/projects/898cfe9ce73e43bc84af8abd019b8d31` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:08.413337 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9340af-f37e-425f-87f8-19476c1684f2 None admin] RBAC: Authorizing `identity:get_project(project_id=898cfe9ce73e43bc84af8abd019b8d31)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:08.415049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9340af-f37e-425f-87f8-19476c1684f2 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:08.417374 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 82/162] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:04:08 2022] GET /identity/v3/projects/898cfe9ce73e43bc84af8abd019b8d31 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:08.418361 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9340af-f37e-425f-87f8-19476c1684f2 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:08.435679 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:08.523754 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5587a-acda-4088-8c56-30d5634ffb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:08.524443 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5587a-acda-4088-8c56-30d5634ffb27 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:08.524731 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5587a-acda-4088-8c56-30d5634ffb27 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:08.525004 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5587a-acda-4088-8c56-30d5634ffb27 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:08.537466 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9340af-f37e-425f-87f8-19476c1684f2 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:08.563969 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5587a-acda-4088-8c56-30d5634ffb27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:08.573277 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de81421-bc56-43ab-8ade-b8ba58a45cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:08.574562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de81421-bc56-43ab-8ade-b8ba58a45cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:08.575065 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de81421-bc56-43ab-8ade-b8ba58a45cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:08.575573 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de81421-bc56-43ab-8ade-b8ba58a45cc0 None admin] PATH_INFO: `/v3/projects/898cfe9ce73e43bc84af8abd019b8d31` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:08.577012 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de81421-bc56-43ab-8ade-b8ba58a45cc0 None admin] RBAC: Authorizing `identity:get_project(project_id=898cfe9ce73e43bc84af8abd019b8d31)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:08.578717 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de81421-bc56-43ab-8ade-b8ba58a45cc0 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:08.579261 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-ded5587a-acda-4088-8c56-30d5634ffb27 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:04:08.579261 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:08.579261 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:08.579261 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:08.579261 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:08.579261 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:08.579261 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:08.579261 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:08.579261 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:08.579261 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:08.579261 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:08.579261 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:08.579261 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:08.579261 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:08.579261 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:08.579261 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:08.580110 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:08.580110 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:08.580110 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:08.580110 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:08.580110 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:08.580110 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:08.580110 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:08.580110 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:08.580110 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:08.580110 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:08.580110 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:08.580110 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:08.580110 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:08.580110 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:08.580110 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:08.580110 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:08.580885 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:08.580885 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:08.580885 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:08.580885 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:08.580885 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:08.580885 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:08.580885 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:08.580885 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:08.580885 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:08.580885 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:08.580885 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:04:08.580885 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:04:08.582146 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 81/163] 10.222.0.79 () {56 vars in 1114 bytes} [Wed Aug 31 19:04:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 403 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:08.584513 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 83/164] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:04:08 2022] GET /identity/v3/projects/898cfe9ce73e43bc84af8abd019b8d31 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:08.585954 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca61f1-6f8e-49c6-8762-4459e7323961 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:08.586477 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca61f1-6f8e-49c6-8762-4459e7323961 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:08.586949 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca61f1-6f8e-49c6-8762-4459e7323961 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:08.588416 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 84/165] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:08.589604 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca61f1-6f8e-49c6-8762-4459e7323961 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:08.590873 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5587a-acda-4088-8c56-30d5634ffb27 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:08.681954 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:08.714006 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5587a-acda-4088-8c56-30d5634ffb27 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:08.718033 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca61f1-6f8e-49c6-8762-4459e7323961 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:08.751805 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347634c5-8aa3-4ff9-94ba-059816156019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:08.752435 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347634c5-8aa3-4ff9-94ba-059816156019 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:08.752714 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347634c5-8aa3-4ff9-94ba-059816156019 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:08.753502 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347634c5-8aa3-4ff9-94ba-059816156019 None admin] PATH_INFO: `/v3/users/7299559d155748cda97ae968f028afad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:08.754060 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816429d-cd2b-4764-ab25-483741da0654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:08.754664 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347634c5-8aa3-4ff9-94ba-059816156019 None admin] RBAC: Authorizing `identity:get_user(user_id=7299559d155748cda97ae968f028afad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:08.754766 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816429d-cd2b-4764-ab25-483741da0654 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:08.754966 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816429d-cd2b-4764-ab25-483741da0654 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:08.755244 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816429d-cd2b-4764-ab25-483741da0654 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:08.756013 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816429d-cd2b-4764-ab25-483741da0654 None admin] RBAC: Adding query filter params (role.id=27c44f922df34ac6bcb3794b111cb3da, scope.project.id=898cfe9ce73e43bc84af8abd019b8d31, user.id=c9ec217226154f31b80930cdc63bd156) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:08.756201 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347634c5-8aa3-4ff9-94ba-059816156019 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:08.756324 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816429d-cd2b-4764-ab25-483741da0654 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:08.757763 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816429d-cd2b-4764-ab25-483741da0654 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:08.757910 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 82/166] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:04:08 2022] GET /identity/v3/users/7299559d155748cda97ae968f028afad => generated 289 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:08.759000 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6c9f2-4406-4227-997b-bb7beafddda0 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:08.759296 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6c9f2-4406-4227-997b-bb7beafddda0 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:08.759573 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6c9f2-4406-4227-997b-bb7beafddda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:08.778185 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 85/167] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:04:08 2022] GET /identity/v3/role_assignments?user.id=c9ec217226154f31b80930cdc63bd156&scope.project.id=898cfe9ce73e43bc84af8abd019b8d31&role.id=27c44f922df34ac6bcb3794b111cb3da => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:08.778185 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816429d-cd2b-4764-ab25-483741da0654 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:08.779222 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-27e6c9f2-4406-4227-997b-bb7beafddda0 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:08.780457 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-27e6c9f2-4406-4227-997b-bb7beafddda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:08.789703 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:08.861938 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 83/168] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:08.867125 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6c9f2-4406-4227-997b-bb7beafddda0 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:08.902925 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816429d-cd2b-4764-ab25-483741da0654 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:08.951894 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f193e-9b97-4a41-8f1c-36a8502e9ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:08.952608 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f193e-9b97-4a41-8f1c-36a8502e9ae3 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:08.952723 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f193e-9b97-4a41-8f1c-36a8502e9ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:08.953006 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f193e-9b97-4a41-8f1c-36a8502e9ae3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:08.953711 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774f193e-9b97-4a41-8f1c-36a8502e9ae3 None admin] RBAC: Adding query filter params (role.id=edc551338adb4ae88bdafc591ad69582, scope.project.id=898cfe9ce73e43bc84af8abd019b8d31, user.id=cf2ffbbfceaa4c36a9027a844dd4920a) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:08.954182 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774f193e-9b97-4a41-8f1c-36a8502e9ae3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:08.955502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774f193e-9b97-4a41-8f1c-36a8502e9ae3 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:08.959518 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:08.964204 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 86/169] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:04:08 2022] GET /identity/v3/role_assignments?user.id=cf2ffbbfceaa4c36a9027a844dd4920a&scope.project.id=898cfe9ce73e43bc84af8abd019b8d31&role.id=edc551338adb4ae88bdafc591ad69582 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:08.965001 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f193e-9b97-4a41-8f1c-36a8502e9ae3 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:09.008291 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6c9f2-4406-4227-997b-bb7beafddda0 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:09.064659 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30193d37-b18e-434e-b0c9-42637ed736b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:09.066505 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30193d37-b18e-434e-b0c9-42637ed736b2 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:09.066862 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30193d37-b18e-434e-b0c9-42637ed736b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:09.067209 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30193d37-b18e-434e-b0c9-42637ed736b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:09.068277 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30193d37-b18e-434e-b0c9-42637ed736b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:09.068654 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30193d37-b18e-434e-b0c9-42637ed736b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:09.070144 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30193d37-b18e-434e-b0c9-42637ed736b2 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:09.084601 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 84/170] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:04:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:09.084601 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa57cc-77a4-4237-81c7-092846f3dbc5 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:09.084601 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa57cc-77a4-4237-81c7-092846f3dbc5 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:09.084601 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa57cc-77a4-4237-81c7-092846f3dbc5 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:09.086208 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 85/171] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:09.087795 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c5e7c-87b1-4df5-852c-75fcd1e1baa0 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:09.087795 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c5e7c-87b1-4df5-852c-75fcd1e1baa0 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:09.087795 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c5e7c-87b1-4df5-852c-75fcd1e1baa0 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:09.092477 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 86/172] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:09.092477 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c5e7c-87b1-4df5-852c-75fcd1e1baa0 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:09.112499 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:09.127045 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f193e-9b97-4a41-8f1c-36a8502e9ae3 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:09.174510 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe001145-e9d1-42f5-9cdb-2cceb235d5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:09.175191 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe001145-e9d1-42f5-9cdb-2cceb235d5ca None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:09.175472 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe001145-e9d1-42f5-9cdb-2cceb235d5ca None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:09.175748 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe001145-e9d1-42f5-9cdb-2cceb235d5ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:09.187463 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe001145-e9d1-42f5-9cdb-2cceb235d5ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:09.193497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-fe001145-e9d1-42f5-9cdb-2cceb235d5ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:04:09.193497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:09.193497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:09.193497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:09.193497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:09.193497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:09.193497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:09.193497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:09.193497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:09.193497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:09.193497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:09.193497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:09.193497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:09.193497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:09.193497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:09.193497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:09.194377 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:09.194377 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:09.194377 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:09.194377 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:09.194377 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:09.194377 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:09.194377 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:09.194377 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:09.194377 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:09.194377 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:09.194377 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:09.194377 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:09.194377 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:09.194377 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:09.194377 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:09.194377 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:09.195290 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:09.195290 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:09.195290 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:09.195290 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:09.195290 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:09.195290 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:09.195290 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:09.195290 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:09.195290 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:09.195290 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:09.195290 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:04:09.195290 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:04:09.195290 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 87/173] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:04:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:09.195940 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe001145-e9d1-42f5-9cdb-2cceb235d5ca None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:09.212381 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c5e7c-87b1-4df5-852c-75fcd1e1baa0 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:09.246919 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad5f86d-098a-4fd6-ad9e-b760b238f850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:09.247548 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5f86d-098a-4fd6-ad9e-b760b238f850 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:09.247825 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5f86d-098a-4fd6-ad9e-b760b238f850 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:09.248090 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5f86d-098a-4fd6-ad9e-b760b238f850 None admin] PATH_INFO: `/v3/projects/898cfe9ce73e43bc84af8abd019b8d31` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:09.249189 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad5f86d-098a-4fd6-ad9e-b760b238f850 None admin] RBAC: Authorizing `identity:get_project(project_id=898cfe9ce73e43bc84af8abd019b8d31)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:09.250652 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad5f86d-098a-4fd6-ad9e-b760b238f850 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:09.252279 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 87/174] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:04:09 2022] GET /identity/v3/projects/898cfe9ce73e43bc84af8abd019b8d31 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:09.253391 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a183b9-6cd4-4bdd-a012-db90723cae4c None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:09.253674 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a183b9-6cd4-4bdd-a012-db90723cae4c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:09.253935 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a183b9-6cd4-4bdd-a012-db90723cae4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:09.263477 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:09.272138 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-01a183b9-6cd4-4bdd-a012-db90723cae4c None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:09.273303 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-01a183b9-6cd4-4bdd-a012-db90723cae4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:09.305424 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe001145-e9d1-42f5-9cdb-2cceb235d5ca None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:09.339183 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49fcba-048b-4ed5-85af-040315873284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:09.339821 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49fcba-048b-4ed5-85af-040315873284 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:09.340100 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49fcba-048b-4ed5-85af-040315873284 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:09.340374 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49fcba-048b-4ed5-85af-040315873284 None admin] PATH_INFO: `/v3/users/c9ec217226154f31b80930cdc63bd156` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:09.340552 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 88/175] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:09.341520 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49fcba-048b-4ed5-85af-040315873284 None admin] RBAC: Authorizing `identity:get_user(user_id=c9ec217226154f31b80930cdc63bd156)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:09.343033 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49fcba-048b-4ed5-85af-040315873284 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:09.343882 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad684e9-3a2c-4b18-82ec-ac5087cf7a9d None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:09.344166 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad684e9-3a2c-4b18-82ec-ac5087cf7a9d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:09.344446 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad684e9-3a2c-4b18-82ec-ac5087cf7a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:09.344624 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 88/176] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:04:09 2022] GET /identity/v3/users/c9ec217226154f31b80930cdc63bd156 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:09.345375 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49fcba-048b-4ed5-85af-040315873284 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:09.350644 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:09.364781 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-9ad684e9-3a2c-4b18-82ec-ac5087cf7a9d None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:09.365961 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9ad684e9-3a2c-4b18-82ec-ac5087cf7a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:09.435863 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 89/177] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:09.436629 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad684e9-3a2c-4b18-82ec-ac5087cf7a9d None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:09.494537 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49fcba-048b-4ed5-85af-040315873284 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:09.522836 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:09.540498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc1676-cc3f-4f6b-8a2a-3aeaa631136f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:09.541152 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc1676-cc3f-4f6b-8a2a-3aeaa631136f None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:09.541434 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc1676-cc3f-4f6b-8a2a-3aeaa631136f None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:09.541709 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc1676-cc3f-4f6b-8a2a-3aeaa631136f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:09.552475 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc1676-cc3f-4f6b-8a2a-3aeaa631136f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:09.557928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-2adc1676-cc3f-4f6b-8a2a-3aeaa631136f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:04:09.557928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:09.557928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:09.557928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:09.557928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:09.557928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:09.557928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:09.557928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:09.557928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:09.557928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:09.557928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:09.557928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:09.557928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:09.557928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:09.557928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:09.557928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:09.558848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:09.558848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:09.558848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:09.558848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:09.558848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:09.558848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:09.558848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:09.558848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:09.558848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:09.558848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:09.558848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:09.558848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:09.558848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:09.558848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:09.558848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:09.558848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:09.559617 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:09.559617 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:09.559617 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:09.559617 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:09.559617 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:09.559617 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:09.559617 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:09.559617 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:09.559617 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:09.559617 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:09.559617 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:04:09.559617 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:04:09.559617 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 89/178] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 19:04:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:09.560280 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc1676-cc3f-4f6b-8a2a-3aeaa631136f None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:09.567365 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad684e9-3a2c-4b18-82ec-ac5087cf7a9d None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:09.607390 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:09.616275 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d3f38-0676-434f-8f41-95274148c687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:09.617372 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d3f38-0676-434f-8f41-95274148c687 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:09.617954 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d3f38-0676-434f-8f41-95274148c687 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:09.618415 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d3f38-0676-434f-8f41-95274148c687 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:09.619565 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d3f38-0676-434f-8f41-95274148c687 None admin] RBAC: Adding query filter params (name=member) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:09.620491 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d3f38-0676-434f-8f41-95274148c687 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:09.622087 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d3f38-0676-434f-8f41-95274148c687 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:09.634088 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 90/179] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 19:04:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:09.634088 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d3f38-0676-434f-8f41-95274148c687 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:09.672375 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc1676-cc3f-4f6b-8a2a-3aeaa631136f None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:09.711718 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ca1a2-34d7-4941-912b-110c495c01cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:09.712741 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ca1a2-34d7-4941-912b-110c495c01cd None admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:09.713021 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ca1a2-34d7-4941-912b-110c495c01cd None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:09.713294 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ca1a2-34d7-4941-912b-110c495c01cd None admin] PATH_INFO: `/v3/projects/898cfe9ce73e43bc84af8abd019b8d31/users/7299559d155748cda97ae968f028afad/roles/35835d27c5d14dbbb20c5e3f646a40a9` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:09.715415 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ca1a2-34d7-4941-912b-110c495c01cd None admin] RBAC: Authorizing `identity:create_grant(project_id=898cfe9ce73e43bc84af8abd019b8d31, user_id=7299559d155748cda97ae968f028afad, role_id=35835d27c5d14dbbb20c5e3f646a40a9)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:09.716851 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ca1a2-34d7-4941-912b-110c495c01cd None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:09.730027 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 90/180] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 19:04:09 2022] PUT /identity/v3/projects/898cfe9ce73e43bc84af8abd019b8d31/users/7299559d155748cda97ae968f028afad/roles/35835d27c5d14dbbb20c5e3f646a40a9 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:04:09.730856 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ca1a2-34d7-4941-912b-110c495c01cd None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:09.737291 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d3f38-0676-434f-8f41-95274148c687 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:09.774332 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5092b6-3529-460c-b61a-3d5567b05783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:09.774906 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5092b6-3529-460c-b61a-3d5567b05783 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:09.775182 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5092b6-3529-460c-b61a-3d5567b05783 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:09.775449 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5092b6-3529-460c-b61a-3d5567b05783 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:09.810704 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:09.845307 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:09.855253 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5092b6-3529-460c-b61a-3d5567b05783 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:09.857499 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5092b6-3529-460c-b61a-3d5567b05783 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:09.877660 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ca1a2-34d7-4941-912b-110c495c01cd None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:09.913744 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee50e9-04b3-483f-ac1b-16a63efa8729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:09.914341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee50e9-04b3-483f-ac1b-16a63efa8729 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:09.914655 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee50e9-04b3-483f-ac1b-16a63efa8729 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:09.914926 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee50e9-04b3-483f-ac1b-16a63efa8729 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:09.915596 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee50e9-04b3-483f-ac1b-16a63efa8729 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:09.915894 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee50e9-04b3-483f-ac1b-16a63efa8729 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:09.917294 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee50e9-04b3-483f-ac1b-16a63efa8729 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:09.930822 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 91/181] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:04:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:09.930822 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee50e9-04b3-483f-ac1b-16a63efa8729 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:09.981058 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 91/182] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:04:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:04:09.981058 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5092b6-3529-460c-b61a-3d5567b05783 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:10.040866 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee50e9-04b3-483f-ac1b-16a63efa8729 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:10.051830 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:10.077112 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:10.079223 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba6299-d873-4cd7-ba4b-573bdf461a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:10.079928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba6299-d873-4cd7-ba4b-573bdf461a26 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:10.080206 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba6299-d873-4cd7-ba4b-573bdf461a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:10.080470 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba6299-d873-4cd7-ba4b-573bdf461a26 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:10.082085 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba6299-d873-4cd7-ba4b-573bdf461a26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:10.083809 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba6299-d873-4cd7-ba4b-573bdf461a26 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:10.085526 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 92/183] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:04:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:10.086963 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5092b6-3529-460c-b61a-3d5567b05783 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:10.087486 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba6299-d873-4cd7-ba4b-573bdf461a26 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:10.123992 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2578e93-f51f-464c-82ad-1c228746535f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:10.124883 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2578e93-f51f-464c-82ad-1c228746535f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:10.125131 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2578e93-f51f-464c-82ad-1c228746535f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:10.125481 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2578e93-f51f-464c-82ad-1c228746535f None admin] PATH_INFO: `/v3/users/c9ec217226154f31b80930cdc63bd156` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:10.126723 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2578e93-f51f-464c-82ad-1c228746535f None admin] RBAC: Authorizing `identity:get_user(user_id=c9ec217226154f31b80930cdc63bd156)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:10.128771 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2578e93-f51f-464c-82ad-1c228746535f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:10.135049 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 92/184] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:04:09 2022] GET /identity/v3/users/c9ec217226154f31b80930cdc63bd156 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:10.135049 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2578e93-f51f-464c-82ad-1c228746535f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:10.201661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba6299-d873-4cd7-ba4b-573bdf461a26 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:10.241946 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408d816-52b6-48b0-98da-88f5567b5223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:10.242614 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408d816-52b6-48b0-98da-88f5567b5223 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:10.242938 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408d816-52b6-48b0-98da-88f5567b5223 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:10.243214 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408d816-52b6-48b0-98da-88f5567b5223 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:10.246608 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2578e93-f51f-464c-82ad-1c228746535f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:10.254118 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7408d816-52b6-48b0-98da-88f5567b5223 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:10.259683 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-7408d816-52b6-48b0-98da-88f5567b5223 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:04:10.259683 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:10.259683 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:10.259683 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:10.259683 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:10.259683 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:10.259683 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:10.259683 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:10.259683 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:10.259683 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:10.259683 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:10.259683 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:10.259683 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:10.259683 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:10.259683 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:10.259683 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:10.260583 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:10.260583 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:10.260583 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:10.260583 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:10.260583 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:10.260583 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:10.260583 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:10.260583 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:10.260583 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:10.260583 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:10.260583 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:10.260583 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:10.260583 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:10.260583 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:10.260583 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:10.260583 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:10.261369 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:10.261369 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:10.261369 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:10.261369 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:10.261369 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:10.261369 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:10.261369 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:10.261369 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:10.261369 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:10.261369 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:10.261369 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:04:10.261369 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:04:10.261369 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 93/185] 10.222.0.79 () {56 vars in 1114 bytes} [Wed Aug 31 19:04:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:10.262102 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408d816-52b6-48b0-98da-88f5567b5223 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:10.291859 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c42c5e-07fe-46e8-be9c-acb0ed802b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:10.292414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c42c5e-07fe-46e8-be9c-acb0ed802b6b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:10.292686 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c42c5e-07fe-46e8-be9c-acb0ed802b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:10.292956 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c42c5e-07fe-46e8-be9c-acb0ed802b6b None admin] PATH_INFO: `/v3/users/a79bf5e395cf4869831e1e617132317f` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:10.304525 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:10.306697 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c42c5e-07fe-46e8-be9c-acb0ed802b6b None admin] RBAC: Authorizing `identity:get_user(user_id=a79bf5e395cf4869831e1e617132317f)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:10.308239 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c42c5e-07fe-46e8-be9c-acb0ed802b6b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:10.314485 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 93/186] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:04:10 2022] GET /identity/v3/users/a79bf5e395cf4869831e1e617132317f => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:10.314485 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c42c5e-07fe-46e8-be9c-acb0ed802b6b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:10.338235 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:10.375226 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408d816-52b6-48b0-98da-88f5567b5223 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:10.416997 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8cd7b-9198-4fc2-9aa8-97c2b8ded499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:10.417975 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8cd7b-9198-4fc2-9aa8-97c2b8ded499 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:10.418465 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8cd7b-9198-4fc2-9aa8-97c2b8ded499 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:10.418851 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8cd7b-9198-4fc2-9aa8-97c2b8ded499 None admin] PATH_INFO: `/v3/projects/898cfe9ce73e43bc84af8abd019b8d31` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:10.419985 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab8cd7b-9198-4fc2-9aa8-97c2b8ded499 None admin] RBAC: Authorizing `identity:get_project(project_id=898cfe9ce73e43bc84af8abd019b8d31)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:10.421190 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c42c5e-07fe-46e8-be9c-acb0ed802b6b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:10.421431 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab8cd7b-9198-4fc2-9aa8-97c2b8ded499 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:10.428061 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 94/187] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:04:10 2022] GET /identity/v3/projects/898cfe9ce73e43bc84af8abd019b8d31 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:10.428061 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8cd7b-9198-4fc2-9aa8-97c2b8ded499 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:10.462865 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e697fd77-bd2f-4055-b846-429faca43419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:10.463615 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697fd77-bd2f-4055-b846-429faca43419 None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:10.463991 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697fd77-bd2f-4055-b846-429faca43419 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:10.464367 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697fd77-bd2f-4055-b846-429faca43419 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:10.465124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e697fd77-bd2f-4055-b846-429faca43419 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:10.466712 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e697fd77-bd2f-4055-b846-429faca43419 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:10.489866 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 94/188] 10.222.0.79 () {60 vars in 1132 bytes} [Wed Aug 31 19:04:10 2022] POST /identity/v3/users => generated 297 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:04:10.490906 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e697fd77-bd2f-4055-b846-429faca43419 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:10.556631 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8cd7b-9198-4fc2-9aa8-97c2b8ded499 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:10.568732 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:10.609489 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2f768-b9ba-49d9-a5a2-e08900379181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:10.610398 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2f768-b9ba-49d9-a5a2-e08900379181 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:10.610841 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2f768-b9ba-49d9-a5a2-e08900379181 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:10.611255 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2f768-b9ba-49d9-a5a2-e08900379181 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:10.611910 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:10.647256 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e697fd77-bd2f-4055-b846-429faca43419 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:10.683118 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f56e1f-6a77-4b1c-9461-e2d0bc088b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:10.683988 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f56e1f-6a77-4b1c-9461-e2d0bc088b98 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:10.684448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f56e1f-6a77-4b1c-9461-e2d0bc088b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:10.684880 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f56e1f-6a77-4b1c-9461-e2d0bc088b98 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:10.685707 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f56e1f-6a77-4b1c-9461-e2d0bc088b98 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:10.686059 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f56e1f-6a77-4b1c-9461-e2d0bc088b98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:10.687621 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f56e1f-6a77-4b1c-9461-e2d0bc088b98 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:10.696796 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 95/189] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:04:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:10.697649 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f56e1f-6a77-4b1c-9461-e2d0bc088b98 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:10.705639 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2f768-b9ba-49d9-a5a2-e08900379181 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:10.705639 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2f768-b9ba-49d9-a5a2-e08900379181 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:10.826777 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 95/190] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:04:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:04:10.827910 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2f768-b9ba-49d9-a5a2-e08900379181 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:10.839327 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:10.854400 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f56e1f-6a77-4b1c-9461-e2d0bc088b98 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:10.895826 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa8823-e0f0-40e8-95cf-98bfd98ff1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:10.896448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa8823-e0f0-40e8-95cf-98bfd98ff1f9 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:10.896727 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa8823-e0f0-40e8-95cf-98bfd98ff1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:10.896993 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa8823-e0f0-40e8-95cf-98bfd98ff1f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:10.909937 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:10.956496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2f768-b9ba-49d9-a5a2-e08900379181 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:10.985816 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa8823-e0f0-40e8-95cf-98bfd98ff1f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:10.988594 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa8823-e0f0-40e8-95cf-98bfd98ff1f9 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:10.998064 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe598b4-c458-419f-b234-2e4272c78732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:10.998845 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe598b4-c458-419f-b234-2e4272c78732 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:10.999678 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe598b4-c458-419f-b234-2e4272c78732 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:11.000057 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe598b4-c458-419f-b234-2e4272c78732 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:11.000910 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe598b4-c458-419f-b234-2e4272c78732 None admin] RBAC: Adding query filter params (role.id=d01cf7e1efe04d8c8f8d09667717555c, scope.project.id=898cfe9ce73e43bc84af8abd019b8d31, user.id=c9ec217226154f31b80930cdc63bd156) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:11.001685 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe598b4-c458-419f-b234-2e4272c78732 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:11.003907 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe598b4-c458-419f-b234-2e4272c78732 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:11.011254 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 96/191] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:04:10 2022] GET /identity/v3/role_assignments?user.id=c9ec217226154f31b80930cdc63bd156&scope.project.id=898cfe9ce73e43bc84af8abd019b8d31&role.id=d01cf7e1efe04d8c8f8d09667717555c => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:11.015319 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe598b4-c458-419f-b234-2e4272c78732 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:11.154801 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:11.188469 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe598b4-c458-419f-b234-2e4272c78732 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:11.197195 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 96/192] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:04:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:04:11.198144 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa8823-e0f0-40e8-95cf-98bfd98ff1f9 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:11.231384 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8af0f4-164f-4948-bdc7-38b38b300921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:11.232040 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8af0f4-164f-4948-bdc7-38b38b300921 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:11.232328 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8af0f4-164f-4948-bdc7-38b38b300921 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:11.232604 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8af0f4-164f-4948-bdc7-38b38b300921 None admin] PATH_INFO: `/v3/users/a79bf5e395cf4869831e1e617132317f` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:11.233942 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8af0f4-164f-4948-bdc7-38b38b300921 None admin] RBAC: Authorizing `identity:get_user(user_id=a79bf5e395cf4869831e1e617132317f)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:11.235503 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8af0f4-164f-4948-bdc7-38b38b300921 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:11.237742 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 97/193] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:04:11 2022] GET /identity/v3/users/a79bf5e395cf4869831e1e617132317f => generated 283 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:11.238558 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8af0f4-164f-4948-bdc7-38b38b300921 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:11.264570 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:11.344361 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa8823-e0f0-40e8-95cf-98bfd98ff1f9 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:11.364642 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8af0f4-164f-4948-bdc7-38b38b300921 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:11.404566 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610aff8b-edce-4a3a-9b56-f3873748b110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:11.405435 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610aff8b-edce-4a3a-9b56-f3873748b110 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:11.405661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610aff8b-edce-4a3a-9b56-f3873748b110 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:11.405938 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610aff8b-edce-4a3a-9b56-f3873748b110 None admin] PATH_INFO: `/v3/projects/3aa248dc3fd34facaa9b43a30893c924` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:11.407281 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610aff8b-edce-4a3a-9b56-f3873748b110 None admin] RBAC: Authorizing `identity:get_project(project_id=3aa248dc3fd34facaa9b43a30893c924)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:11.408813 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610aff8b-edce-4a3a-9b56-f3873748b110 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:11.411234 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44bd1db-0488-4171-a233-de6d7f37c861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:11.412115 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bd1db-0488-4171-a233-de6d7f37c861 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:11.412598 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bd1db-0488-4171-a233-de6d7f37c861 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:11.413025 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 98/194] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:04:11 2022] GET /identity/v3/projects/3aa248dc3fd34facaa9b43a30893c924 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:11.413500 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bd1db-0488-4171-a233-de6d7f37c861 None admin] PATH_INFO: `/v3/projects/d9fbdc4a02a14d7a9e3e42b04a943d89` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:11.413622 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610aff8b-edce-4a3a-9b56-f3873748b110 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:11.419283 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44bd1db-0488-4171-a233-de6d7f37c861 None admin] RBAC: Authorizing `identity:get_project(project_id=d9fbdc4a02a14d7a9e3e42b04a943d89)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:11.421019 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44bd1db-0488-4171-a233-de6d7f37c861 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:11.423409 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 97/195] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:04:11 2022] GET /identity/v3/projects/d9fbdc4a02a14d7a9e3e42b04a943d89 => generated 312 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:11.424409 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44bd1db-0488-4171-a233-de6d7f37c861 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:11.430634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:11.547851 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610aff8b-edce-4a3a-9b56-f3873748b110 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:11.591855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24136d1a-efbf-45ec-a835-6722bc493298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:11.592761 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24136d1a-efbf-45ec-a835-6722bc493298 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:11.593337 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24136d1a-efbf-45ec-a835-6722bc493298 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:11.593614 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24136d1a-efbf-45ec-a835-6722bc493298 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:11.664687 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44bd1db-0488-4171-a233-de6d7f37c861 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:11.678478 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:11.688721 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24136d1a-efbf-45ec-a835-6722bc493298 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:11.690205 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24136d1a-efbf-45ec-a835-6722bc493298 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:11.710190 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:11.729988 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed9c59-015e-4223-a170-b855147795ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:11.730636 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed9c59-015e-4223-a170-b855147795ab None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:11.730919 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed9c59-015e-4223-a170-b855147795ab None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:11.731191 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed9c59-015e-4223-a170-b855147795ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:11.731998 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed9c59-015e-4223-a170-b855147795ab None admin] RBAC: Adding query filter params (role.id=edc551338adb4ae88bdafc591ad69582, scope.project.id=3aa248dc3fd34facaa9b43a30893c924, user.id=a79bf5e395cf4869831e1e617132317f) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:11.732308 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed9c59-015e-4223-a170-b855147795ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:11.733764 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed9c59-015e-4223-a170-b855147795ab None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:11.739585 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 98/196] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:04:11 2022] GET /identity/v3/role_assignments?user.id=a79bf5e395cf4869831e1e617132317f&scope.project.id=3aa248dc3fd34facaa9b43a30893c924&role.id=edc551338adb4ae88bdafc591ad69582 => generated 259 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:11.740371 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed9c59-015e-4223-a170-b855147795ab None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:11.877863 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 99/197] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:04:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:04:11.883661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24136d1a-efbf-45ec-a835-6722bc493298 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:11.914090 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed9c59-015e-4223-a170-b855147795ab None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:11.973196 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c432240-213a-4d6d-9f77-0b241ee96853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:11.973816 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c432240-213a-4d6d-9f77-0b241ee96853 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:11.974096 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c432240-213a-4d6d-9f77-0b241ee96853 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:11.974370 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c432240-213a-4d6d-9f77-0b241ee96853 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:11.975210 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c432240-213a-4d6d-9f77-0b241ee96853 None admin] RBAC: Adding query filter params (role.id=27c44f922df34ac6bcb3794b111cb3da, scope.project.id=d9fbdc4a02a14d7a9e3e42b04a943d89, user.id=c9ec217226154f31b80930cdc63bd156) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:11.975522 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c432240-213a-4d6d-9f77-0b241ee96853 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:11.977247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c432240-213a-4d6d-9f77-0b241ee96853 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:11.988303 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 99/198] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:04:11 2022] GET /identity/v3/role_assignments?user.id=c9ec217226154f31b80930cdc63bd156&scope.project.id=d9fbdc4a02a14d7a9e3e42b04a943d89&role.id=27c44f922df34ac6bcb3794b111cb3da => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:11.994189 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24136d1a-efbf-45ec-a835-6722bc493298 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:12.003351 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:12.046363 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a119345-6e31-4192-b0da-d8b35cef186f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:12.047060 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a119345-6e31-4192-b0da-d8b35cef186f None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:12.047335 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a119345-6e31-4192-b0da-d8b35cef186f None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:12.047604 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a119345-6e31-4192-b0da-d8b35cef186f None admin] PATH_INFO: `/v3/projects/3aa248dc3fd34facaa9b43a30893c924` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:12.048768 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a119345-6e31-4192-b0da-d8b35cef186f None admin] RBAC: Authorizing `identity:get_project(project_id=3aa248dc3fd34facaa9b43a30893c924)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:12.050798 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a119345-6e31-4192-b0da-d8b35cef186f None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:12.052478 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 100/199] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:04:11 2022] GET /identity/v3/projects/3aa248dc3fd34facaa9b43a30893c924 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:04:12.058953 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c432240-213a-4d6d-9f77-0b241ee96853 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:12.135301 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:12.211685 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c432240-213a-4d6d-9f77-0b241ee96853 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:12.238603 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad188cd-b865-4354-b1fd-c4632fd96f2e None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:12.238966 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad188cd-b865-4354-b1fd-c4632fd96f2e None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:12.239153 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad188cd-b865-4354-b1fd-c4632fd96f2e None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:12.240422 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 101/200] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:04:12.245923 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf88ac6-441c-4477-b38a-69adce4cb0e0 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:12.246203 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf88ac6-441c-4477-b38a-69adce4cb0e0 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:12.246490 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf88ac6-441c-4477-b38a-69adce4cb0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:12.264159 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ceda95-1e7b-433a-a951-c9ad46ddab2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:12.264781 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ceda95-1e7b-433a-a951-c9ad46ddab2c None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:12.265059 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ceda95-1e7b-433a-a951-c9ad46ddab2c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:12.265338 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ceda95-1e7b-433a-a951-c9ad46ddab2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:12.266079 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ceda95-1e7b-433a-a951-c9ad46ddab2c None admin] RBAC: Adding query filter params (role.id=d01cf7e1efe04d8c8f8d09667717555c, scope.project.id=3aa248dc3fd34facaa9b43a30893c924, user.id=a79bf5e395cf4869831e1e617132317f) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:12.266387 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ceda95-1e7b-433a-a951-c9ad46ddab2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:12.266591 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-bdf88ac6-441c-4477-b38a-69adce4cb0e0 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:12.267714 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-bdf88ac6-441c-4477-b38a-69adce4cb0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:12.267883 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ceda95-1e7b-433a-a951-c9ad46ddab2c None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:12.277494 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 100/201] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:04:12 2022] GET /identity/v3/role_assignments?user.id=a79bf5e395cf4869831e1e617132317f&scope.project.id=3aa248dc3fd34facaa9b43a30893c924&role.id=d01cf7e1efe04d8c8f8d09667717555c => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:12.349815 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 102/202] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:12.632267 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ceda95-1e7b-433a-a951-c9ad46ddab2c None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:12.756820 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:12.760647 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ceda95-1e7b-433a-a951-c9ad46ddab2c None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:12.797520 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b1457-e5af-4314-8f4b-acbd9a414ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:12.798072 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b1457-e5af-4314-8f4b-acbd9a414ffd None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:12.798350 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b1457-e5af-4314-8f4b-acbd9a414ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:12.798652 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b1457-e5af-4314-8f4b-acbd9a414ffd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:12.813488 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876b1457-e5af-4314-8f4b-acbd9a414ffd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:12.818994 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-876b1457-e5af-4314-8f4b-acbd9a414ffd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:04:12.818994 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:12.818994 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:12.818994 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:12.818994 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:12.818994 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:12.818994 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:12.818994 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:12.818994 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:12.818994 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:12.818994 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:12.818994 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:12.818994 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:12.818994 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:12.818994 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:12.818994 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:12.820414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:12.820414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:12.820414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:12.820414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:12.820414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:12.820414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:12.820414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:12.820414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:12.820414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:12.820414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:12.820414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:12.820414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:12.820414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:12.820414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:12.820414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:12.820414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:12.821187 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:12.821187 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:12.821187 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:12.821187 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:12.821187 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:12.821187 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:12.821187 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:12.821187 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:12.821187 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:12.821187 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:12.821187 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:04:12.821187 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:04:12.823238 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 101/203] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:04:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:12.828197 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf88ac6-441c-4477-b38a-69adce4cb0e0 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:12.978620 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf88ac6-441c-4477-b38a-69adce4cb0e0 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:12.981902 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:13.024111 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad05b5-5d9c-4906-b60d-c76666fe0c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:13.024736 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad05b5-5d9c-4906-b60d-c76666fe0c19 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:13.025080 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad05b5-5d9c-4906-b60d-c76666fe0c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:13.025350 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad05b5-5d9c-4906-b60d-c76666fe0c19 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:13.026077 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad05b5-5d9c-4906-b60d-c76666fe0c19 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:13.026360 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad05b5-5d9c-4906-b60d-c76666fe0c19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:13.027776 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad05b5-5d9c-4906-b60d-c76666fe0c19 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:13.039974 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 103/204] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 19:04:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:13.046006 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b1457-e5af-4314-8f4b-acbd9a414ffd None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:13.161823 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18b4eb-1c3d-432b-a55d-ce9331a060d0 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:13.162148 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18b4eb-1c3d-432b-a55d-ce9331a060d0 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:13.162368 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18b4eb-1c3d-432b-a55d-ce9331a060d0 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:13.163956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 104/205] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:04:13.169248 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbb55c-d804-4a0e-b0d8-c3e1be56730a None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:13.169527 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbb55c-d804-4a0e-b0d8-c3e1be56730a None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:13.169803 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbb55c-d804-4a0e-b0d8-c3e1be56730a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:13.193896 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b1457-e5af-4314-8f4b-acbd9a414ffd None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:13.195772 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-16fbb55c-d804-4a0e-b0d8-c3e1be56730a None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:13.196983 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-16fbb55c-d804-4a0e-b0d8-c3e1be56730a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:13.270234 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a05f0e-ce1e-4faf-9d90-5b8521c2df20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:13.270910 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a05f0e-ce1e-4faf-9d90-5b8521c2df20 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:13.271190 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a05f0e-ce1e-4faf-9d90-5b8521c2df20 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:13.271467 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a05f0e-ce1e-4faf-9d90-5b8521c2df20 None admin] PATH_INFO: `/v3/users/7299559d155748cda97ae968f028afad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:13.272608 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a05f0e-ce1e-4faf-9d90-5b8521c2df20 None admin] RBAC: Authorizing `identity:get_user(user_id=7299559d155748cda97ae968f028afad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:13.274115 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a05f0e-ce1e-4faf-9d90-5b8521c2df20 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:13.275799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 102/206] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:04:13 2022] GET /identity/v3/users/7299559d155748cda97ae968f028afad => generated 289 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:13.283089 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a05f0e-ce1e-4faf-9d90-5b8521c2df20 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:13.286059 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 105/207] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:04:13.312007 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd808d88-5fb4-4e6b-b702-8744af32b98e None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:13.312609 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd808d88-5fb4-4e6b-b702-8744af32b98e None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:13.313079 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd808d88-5fb4-4e6b-b702-8744af32b98e None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:13.314693 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 106/208] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:13.320529 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f6935-c16f-4d2b-a8ff-38fa6d5284b0 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:13.321064 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f6935-c16f-4d2b-a8ff-38fa6d5284b0 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:13.321533 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f6935-c16f-4d2b-a8ff-38fa6d5284b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:13.340634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-791f6935-c16f-4d2b-a8ff-38fa6d5284b0 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:13.342149 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-791f6935-c16f-4d2b-a8ff-38fa6d5284b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:13.354508 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:13.465156 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a05f0e-ce1e-4faf-9d90-5b8521c2df20 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:13.489580 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 107/209] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:13.518541 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2f1c6-ff52-4ca0-a729-b32b98172cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:13.519537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2f1c6-ff52-4ca0-a729-b32b98172cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:13.520124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2f1c6-ff52-4ca0-a729-b32b98172cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:13.520653 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2f1c6-ff52-4ca0-a729-b32b98172cd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:13.585229 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f6935-c16f-4d2b-a8ff-38fa6d5284b0 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:13.624216 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2f1c6-ff52-4ca0-a729-b32b98172cd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:13.625695 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2f1c6-ff52-4ca0-a729-b32b98172cd2 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:13.637945 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:13.687748 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:13.737892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f6935-c16f-4d2b-a8ff-38fa6d5284b0 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:13.813419 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7fb65-6464-465b-a53d-792334e881d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:13.814061 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7fb65-6464-465b-a53d-792334e881d1 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:13.814327 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7fb65-6464-465b-a53d-792334e881d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:13.814789 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7fb65-6464-465b-a53d-792334e881d1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:13.837869 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 103/210] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:04:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:04:13.842577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c7fb65-6464-465b-a53d-792334e881d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:13.848063 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-c7c7fb65-6464-465b-a53d-792334e881d1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:04:13.848063 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:13.848063 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:13.848063 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:13.848063 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:13.848063 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:13.848063 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:13.848063 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:13.848063 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:13.848063 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:13.848063 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:13.848063 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:13.848063 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:13.848063 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:13.848063 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:13.848063 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:13.848927 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:13.848927 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:13.848927 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:13.848927 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:13.848927 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:13.848927 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:13.848927 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:13.848927 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:13.848927 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:13.848927 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:13.848927 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:13.848927 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:13.848927 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:13.848927 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:13.848927 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:13.848927 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:13.849704 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:13.849704 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:13.849704 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:13.849704 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:13.849704 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:13.849704 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:13.849704 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:13.849704 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:13.849704 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:13.849704 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:13.849704 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:04:13.849704 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:04:13.850375 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2f1c6-ff52-4ca0-a729-b32b98172cd2 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:13.852883 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 108/211] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:04:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:13.858768 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7fb65-6464-465b-a53d-792334e881d1 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:13.986049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:14.003751 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2f1c6-ff52-4ca0-a729-b32b98172cd2 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:14.008175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7fb65-6464-465b-a53d-792334e881d1 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:14.039412 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:14.046777 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90efa46e-2ef7-462a-bd1a-028a051a4527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:14.047640 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90efa46e-2ef7-462a-bd1a-028a051a4527 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:14.048090 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90efa46e-2ef7-462a-bd1a-028a051a4527 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:14.048567 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90efa46e-2ef7-462a-bd1a-028a051a4527 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:14.049344 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90efa46e-2ef7-462a-bd1a-028a051a4527 None admin] RBAC: Adding query filter params (name=member) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:14.050253 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90efa46e-2ef7-462a-bd1a-028a051a4527 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:14.051550 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3e55a-962f-4b70-b784-569847e10466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:14.052017 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90efa46e-2ef7-462a-bd1a-028a051a4527 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:14.052864 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3e55a-962f-4b70-b784-569847e10466 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:14.053587 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3e55a-962f-4b70-b784-569847e10466 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:14.054480 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3e55a-962f-4b70-b784-569847e10466 None admin] PATH_INFO: `/v3/projects/898cfe9ce73e43bc84af8abd019b8d31` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:14.055915 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c3e55a-962f-4b70-b784-569847e10466 None admin] RBAC: Authorizing `identity:get_project(project_id=898cfe9ce73e43bc84af8abd019b8d31)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:14.057563 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c3e55a-962f-4b70-b784-569847e10466 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:14.060021 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 104/212] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:04:13 2022] GET /identity/v3/projects/898cfe9ce73e43bc84af8abd019b8d31 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:14.061235 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3e55a-962f-4b70-b784-569847e10466 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:14.067662 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 109/213] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 19:04:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:14.068590 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90efa46e-2ef7-462a-bd1a-028a051a4527 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:14.187769 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90efa46e-2ef7-462a-bd1a-028a051a4527 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:14.201405 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3e55a-962f-4b70-b784-569847e10466 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:14.225321 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a13384-0105-44a4-89b7-4c036dcf85ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:14.226029 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a13384-0105-44a4-89b7-4c036dcf85ed None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:14.226378 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a13384-0105-44a4-89b7-4c036dcf85ed None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:14.226758 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a13384-0105-44a4-89b7-4c036dcf85ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:14.227841 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a13384-0105-44a4-89b7-4c036dcf85ed None admin] RBAC: Adding query filter params (role.id=35835d27c5d14dbbb20c5e3f646a40a9, scope.project.id=898cfe9ce73e43bc84af8abd019b8d31, user.id=7299559d155748cda97ae968f028afad) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:14.228213 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a13384-0105-44a4-89b7-4c036dcf85ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:14.229785 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a13384-0105-44a4-89b7-4c036dcf85ed None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:14.236045 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 110/214] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:04:14 2022] GET /identity/v3/role_assignments?user.id=7299559d155748cda97ae968f028afad&scope.project.id=898cfe9ce73e43bc84af8abd019b8d31&role.id=35835d27c5d14dbbb20c5e3f646a40a9 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:14.243451 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a13384-0105-44a4-89b7-4c036dcf85ed None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:14.249500 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3fb8df-1e42-42bf-be5d-989adced102f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:14.250450 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fb8df-1e42-42bf-be5d-989adced102f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:14.250943 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fb8df-1e42-42bf-be5d-989adced102f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:14.251390 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fb8df-1e42-42bf-be5d-989adced102f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:14.252790 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3fb8df-1e42-42bf-be5d-989adced102f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:14.254594 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3fb8df-1e42-42bf-be5d-989adced102f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:14.257360 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 105/215] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:04:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:14.263950 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3fb8df-1e42-42bf-be5d-989adced102f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:14.273033 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:14.363532 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:14.421324 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3fb8df-1e42-42bf-be5d-989adced102f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:14.457792 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a13384-0105-44a4-89b7-4c036dcf85ed None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:14.471078 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215366a-8118-4261-8580-45e2153b226a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:14.472446 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215366a-8118-4261-8580-45e2153b226a None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:14.472968 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215366a-8118-4261-8580-45e2153b226a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:14.473159 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215366a-8118-4261-8580-45e2153b226a None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:14.473830 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6215366a-8118-4261-8580-45e2153b226a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:14.475901 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6215366a-8118-4261-8580-45e2153b226a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:14.501056 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 106/216] 10.222.0.79 () {60 vars in 1132 bytes} [Wed Aug 31 19:04:14 2022] POST /identity/v3/users => generated 297 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:04:14.502494 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cf142-9b95-443e-b701-1869ff89cf72 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:14.502704 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cf142-9b95-443e-b701-1869ff89cf72 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:14.503532 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cf142-9b95-443e-b701-1869ff89cf72 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:14.505508 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 107/217] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:14.511399 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2bb3d9-9e3b-400f-af30-0f7506f17640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:14.512223 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bb3d9-9e3b-400f-af30-0f7506f17640 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:14.512543 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bb3d9-9e3b-400f-af30-0f7506f17640 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:14.512822 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bb3d9-9e3b-400f-af30-0f7506f17640 None admin] PATH_INFO: `/v3/users/65770af5315f4185b11b6f7efc9fd9d0` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:14.513264 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d7552-7461-4ac1-b8f7-ad4b53ff6d53 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:14.513916 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d7552-7461-4ac1-b8f7-ad4b53ff6d53 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:14.514424 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d7552-7461-4ac1-b8f7-ad4b53ff6d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:14.533683 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2bb3d9-9e3b-400f-af30-0f7506f17640 None admin] RBAC: Authorizing `identity:get_user(user_id=65770af5315f4185b11b6f7efc9fd9d0)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:14.537542 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2bb3d9-9e3b-400f-af30-0f7506f17640 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:14.540683 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 111/218] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:04:14 2022] GET /identity/v3/users/65770af5315f4185b11b6f7efc9fd9d0 => generated 297 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:14.549984 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2bb3d9-9e3b-400f-af30-0f7506f17640 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:14.553334 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-097d7552-7461-4ac1-b8f7-ad4b53ff6d53 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:14.554927 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-097d7552-7461-4ac1-b8f7-ad4b53ff6d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:14.652360 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:14.673339 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 108/219] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:14.697938 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2bb3d9-9e3b-400f-af30-0f7506f17640 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:14.735352 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903723e1-958f-481a-84c3-b057a495f1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:14.735964 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903723e1-958f-481a-84c3-b057a495f1f6 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:14.736247 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903723e1-958f-481a-84c3-b057a495f1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:14.736519 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903723e1-958f-481a-84c3-b057a495f1f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:14.813650 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903723e1-958f-481a-84c3-b057a495f1f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:14.815191 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903723e1-958f-481a-84c3-b057a495f1f6 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:14.821403 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87245eb9-ab89-49eb-a57b-9f25ffee29ef None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:14.821692 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87245eb9-ab89-49eb-a57b-9f25ffee29ef None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:14.821970 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87245eb9-ab89-49eb-a57b-9f25ffee29ef None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:14.823619 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 109/220] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:14.830983 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842a795-f7de-4e93-af4d-5800191d4f89 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:14.831876 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842a795-f7de-4e93-af4d-5800191d4f89 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:14.832155 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842a795-f7de-4e93-af4d-5800191d4f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:14.863616 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-f842a795-f7de-4e93-af4d-5800191d4f89 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:14.864864 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f842a795-f7de-4e93-af4d-5800191d4f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:14.902030 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:14.937446 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:14.943414 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 112/221] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:04:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:04:14.950249 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903723e1-958f-481a-84c3-b057a495f1f6 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:14.978486 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 110/222] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:14.978486 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842a795-f7de-4e93-af4d-5800191d4f89 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:15.085538 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903723e1-958f-481a-84c3-b057a495f1f6 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:15.093343 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842a795-f7de-4e93-af4d-5800191d4f89 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:15.132890 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28c512-6b84-4aff-8aab-a88b1465f9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:15.133534 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28c512-6b84-4aff-8aab-a88b1465f9a0 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:15.133809 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28c512-6b84-4aff-8aab-a88b1465f9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:15.134080 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28c512-6b84-4aff-8aab-a88b1465f9a0 None admin] PATH_INFO: `/v3/projects/3aa248dc3fd34facaa9b43a30893c924` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:15.135257 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b28c512-6b84-4aff-8aab-a88b1465f9a0 None admin] RBAC: Authorizing `identity:get_project(project_id=3aa248dc3fd34facaa9b43a30893c924)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:15.136704 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b28c512-6b84-4aff-8aab-a88b1465f9a0 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:15.138687 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 113/223] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:04:14 2022] GET /identity/v3/projects/3aa248dc3fd34facaa9b43a30893c924 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:04:15.144498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28c512-6b84-4aff-8aab-a88b1465f9a0 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:15.168225 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb8707-7c46-47be-bd3d-f06f081ef650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:15.168882 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb8707-7c46-47be-bd3d-f06f081ef650 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:15.169161 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb8707-7c46-47be-bd3d-f06f081ef650 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:15.169538 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb8707-7c46-47be-bd3d-f06f081ef650 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:15.191344 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:15.203094 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb8707-7c46-47be-bd3d-f06f081ef650 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:15.208618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-20fb8707-7c46-47be-bd3d-f06f081ef650 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:04:15.208618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:15.208618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:15.208618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:15.208618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:15.208618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:15.208618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:15.208618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:15.208618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:15.208618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:15.208618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:15.208618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:15.208618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:15.208618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:15.208618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:15.208618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:15.209528 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:15.209528 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:15.209528 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:15.209528 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:15.209528 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:15.209528 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:15.209528 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:15.209528 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:15.209528 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:15.209528 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:15.209528 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:15.209528 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:15.209528 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:15.209528 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:15.209528 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:15.209528 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:15.210317 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:15.210317 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:15.210317 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:15.210317 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:15.210317 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:15.210317 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:15.210317 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:15.210317 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:15.210317 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:15.210317 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:15.210317 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:04:15.210317 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:04:15.213590 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 111/224] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 19:04:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:15.223435 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb8707-7c46-47be-bd3d-f06f081ef650 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:15.258854 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28c512-6b84-4aff-8aab-a88b1465f9a0 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:15.273483 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:15.310737 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d948fdf-bb11-4d6c-b9fe-8b8727a3415f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:15.311389 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d948fdf-bb11-4d6c-b9fe-8b8727a3415f None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:15.311669 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d948fdf-bb11-4d6c-b9fe-8b8727a3415f None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:15.311942 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d948fdf-bb11-4d6c-b9fe-8b8727a3415f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:15.312687 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d948fdf-bb11-4d6c-b9fe-8b8727a3415f None admin] RBAC: Adding query filter params (role.id=27c44f922df34ac6bcb3794b111cb3da, scope.project.id=3aa248dc3fd34facaa9b43a30893c924, user.id=65770af5315f4185b11b6f7efc9fd9d0) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:15.312996 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d948fdf-bb11-4d6c-b9fe-8b8727a3415f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:15.314522 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d948fdf-bb11-4d6c-b9fe-8b8727a3415f None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:15.321261 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 114/225] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:04:15 2022] GET /identity/v3/role_assignments?user.id=65770af5315f4185b11b6f7efc9fd9d0&scope.project.id=3aa248dc3fd34facaa9b43a30893c924&role.id=27c44f922df34ac6bcb3794b111cb3da => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:15.322105 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d948fdf-bb11-4d6c-b9fe-8b8727a3415f None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:15.373551 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb8707-7c46-47be-bd3d-f06f081ef650 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:15.414437 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0cdd6-f9df-42f6-ba26-17d7a7d766f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:15.415087 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0cdd6-f9df-42f6-ba26-17d7a7d766f0 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:15.415366 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0cdd6-f9df-42f6-ba26-17d7a7d766f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:15.415636 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0cdd6-f9df-42f6-ba26-17d7a7d766f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:15.416588 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b0cdd6-f9df-42f6-ba26-17d7a7d766f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:15.417160 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b0cdd6-f9df-42f6-ba26-17d7a7d766f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:15.418904 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b0cdd6-f9df-42f6-ba26-17d7a7d766f0 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:15.429617 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 112/226] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:04:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:15.437838 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0cdd6-f9df-42f6-ba26-17d7a7d766f0 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:15.463848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d948fdf-bb11-4d6c-b9fe-8b8727a3415f None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:15.465686 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:15.524453 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e3091-905b-456c-9134-4a53ce40c914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:15.525098 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e3091-905b-456c-9134-4a53ce40c914 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:15.525379 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e3091-905b-456c-9134-4a53ce40c914 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:15.525645 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e3091-905b-456c-9134-4a53ce40c914 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:15.542507 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e3091-905b-456c-9134-4a53ce40c914 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:15.542744 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-cc7e3091-905b-456c-9134-4a53ce40c914 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:04:15.542744 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:15.542744 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:15.542744 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:15.542744 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:15.542744 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:15.542744 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:15.542744 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:15.542744 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:15.542744 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:15.542744 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:15.542744 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:15.542744 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:15.542744 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:15.542744 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:15.542744 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:15.544341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:15.544341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:15.544341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:15.544341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:15.544341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:15.544341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:15.544341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:15.544341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:15.544341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:15.544341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:15.544341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:15.544341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:15.544341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:15.544341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:15.544341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:15.544341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:15.545890 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:15.545890 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:15.545890 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:15.545890 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:15.545890 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:15.545890 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:15.545890 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:15.545890 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:15.545890 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:15.545890 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:15.545890 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:04:15.545890 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:04:15.545890 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 115/227] 10.222.0.79 () {56 vars in 1114 bytes} [Wed Aug 31 19:04:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:15.566502 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:15.568070 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0cdd6-f9df-42f6-ba26-17d7a7d766f0 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:15.571138 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e3091-905b-456c-9134-4a53ce40c914 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:15.631233 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d476b25-9141-40f9-b73d-e6c1a27f0c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:15.631791 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d476b25-9141-40f9-b73d-e6c1a27f0c2e None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:15.632070 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d476b25-9141-40f9-b73d-e6c1a27f0c2e None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:15.632343 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d476b25-9141-40f9-b73d-e6c1a27f0c2e None admin] PATH_INFO: `/v3/users/a79bf5e395cf4869831e1e617132317f` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:15.635487 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d476b25-9141-40f9-b73d-e6c1a27f0c2e None admin] RBAC: Authorizing `identity:get_user(user_id=a79bf5e395cf4869831e1e617132317f)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:15.636935 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d476b25-9141-40f9-b73d-e6c1a27f0c2e None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:15.642758 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 113/228] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:04:15 2022] GET /identity/v3/users/a79bf5e395cf4869831e1e617132317f => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:15.645478 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d476b25-9141-40f9-b73d-e6c1a27f0c2e None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:15.758281 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e3091-905b-456c-9134-4a53ce40c914 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:15.818573 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca406905-c849-4b51-b108-cdcdceb0edf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:15.819191 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca406905-c849-4b51-b108-cdcdceb0edf0 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:15.819474 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca406905-c849-4b51-b108-cdcdceb0edf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:15.819751 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca406905-c849-4b51-b108-cdcdceb0edf0 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:15.821524 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca406905-c849-4b51-b108-cdcdceb0edf0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:15.821840 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca406905-c849-4b51-b108-cdcdceb0edf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:15.823246 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca406905-c849-4b51-b108-cdcdceb0edf0 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:15.828494 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d476b25-9141-40f9-b73d-e6c1a27f0c2e None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:15.849552 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 116/229] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:04:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:15.856843 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca406905-c849-4b51-b108-cdcdceb0edf0 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:15.894196 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:15.901246 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f695b-aa04-48af-be23-44272714a318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:15.901898 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f695b-aa04-48af-be23-44272714a318 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:15.902180 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f695b-aa04-48af-be23-44272714a318 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:15.902442 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f695b-aa04-48af-be23-44272714a318 None admin] PATH_INFO: `/v3/projects/3aa248dc3fd34facaa9b43a30893c924` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:15.903723 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f695b-aa04-48af-be23-44272714a318 None admin] RBAC: Authorizing `identity:get_project(project_id=3aa248dc3fd34facaa9b43a30893c924)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:15.906387 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f695b-aa04-48af-be23-44272714a318 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:15.908082 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 114/230] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:04:15 2022] GET /identity/v3/projects/3aa248dc3fd34facaa9b43a30893c924 => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:15.916691 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f695b-aa04-48af-be23-44272714a318 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:15.972117 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:16.035781 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca406905-c849-4b51-b108-cdcdceb0edf0 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:16.097468 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f695b-aa04-48af-be23-44272714a318 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:16.129183 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ba7d5-32a2-4986-af6e-0d58d9a1c345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:16.130179 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ba7d5-32a2-4986-af6e-0d58d9a1c345 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:16.130659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ba7d5-32a2-4986-af6e-0d58d9a1c345 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:16.131133 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ba7d5-32a2-4986-af6e-0d58d9a1c345 None admin] PATH_INFO: `/v3/users/a79bf5e395cf4869831e1e617132317f` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:16.139144 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ba7d5-32a2-4986-af6e-0d58d9a1c345 None admin] RBAC: Authorizing `identity:get_user(user_id=a79bf5e395cf4869831e1e617132317f)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:16.140834 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ba7d5-32a2-4986-af6e-0d58d9a1c345 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:16.142954 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 117/231] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:04:15 2022] GET /identity/v3/users/a79bf5e395cf4869831e1e617132317f => generated 283 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:04:16.151483 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ba7d5-32a2-4986-af6e-0d58d9a1c345 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:16.170288 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298051a-ed8e-4ff5-abbd-c85fe0bdb7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:16.172453 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298051a-ed8e-4ff5-abbd-c85fe0bdb7b7 None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:16.172908 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298051a-ed8e-4ff5-abbd-c85fe0bdb7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:16.174110 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298051a-ed8e-4ff5-abbd-c85fe0bdb7b7 None admin] PATH_INFO: `/v3/projects/3aa248dc3fd34facaa9b43a30893c924/users/a79bf5e395cf4869831e1e617132317f/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:16.178506 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6298051a-ed8e-4ff5-abbd-c85fe0bdb7b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=3aa248dc3fd34facaa9b43a30893c924, user_id=a79bf5e395cf4869831e1e617132317f, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:16.180889 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6298051a-ed8e-4ff5-abbd-c85fe0bdb7b7 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:16.212056 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 115/232] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 19:04:15 2022] PUT /identity/v3/projects/3aa248dc3fd34facaa9b43a30893c924/users/a79bf5e395cf4869831e1e617132317f/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:04:16.315616 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:16.327127 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ba7d5-32a2-4986-af6e-0d58d9a1c345 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:16.380023 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d120634-d784-4e3f-a86a-6b53f9327630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:16.381014 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d120634-d784-4e3f-a86a-6b53f9327630 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:16.381528 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d120634-d784-4e3f-a86a-6b53f9327630 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:16.381977 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d120634-d784-4e3f-a86a-6b53f9327630 None admin] PATH_INFO: `/v3/projects/3aa248dc3fd34facaa9b43a30893c924` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:16.387331 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d120634-d784-4e3f-a86a-6b53f9327630 None admin] RBAC: Authorizing `identity:get_project(project_id=3aa248dc3fd34facaa9b43a30893c924)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:16.389094 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d120634-d784-4e3f-a86a-6b53f9327630 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:16.391042 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 118/233] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:04:16 2022] GET /identity/v3/projects/3aa248dc3fd34facaa9b43a30893c924 => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:04:16.400514 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298051a-ed8e-4ff5-abbd-c85fe0bdb7b7 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:16.501018 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:16.508077 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298051a-ed8e-4ff5-abbd-c85fe0bdb7b7 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:16.548055 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d471c-57cf-457a-a6fd-841667637321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:16.548776 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d471c-57cf-457a-a6fd-841667637321 None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:16.549053 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d471c-57cf-457a-a6fd-841667637321 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:16.549378 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d471c-57cf-457a-a6fd-841667637321 None admin] PATH_INFO: `/v3/projects/3aa248dc3fd34facaa9b43a30893c924/users/a79bf5e395cf4869831e1e617132317f/roles/d01cf7e1efe04d8c8f8d09667717555c` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:16.552870 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d471c-57cf-457a-a6fd-841667637321 None admin] RBAC: Authorizing `identity:create_grant(project_id=3aa248dc3fd34facaa9b43a30893c924, user_id=a79bf5e395cf4869831e1e617132317f, role_id=d01cf7e1efe04d8c8f8d09667717555c)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:16.554443 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d471c-57cf-457a-a6fd-841667637321 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:16.570143 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 116/234] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 19:04:16 2022] PUT /identity/v3/projects/3aa248dc3fd34facaa9b43a30893c924/users/a79bf5e395cf4869831e1e617132317f/roles/d01cf7e1efe04d8c8f8d09667717555c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:04:17.397457 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e8131-0df8-4d3b-8679-4ebd2fdb5d90 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:17.398214 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e8131-0df8-4d3b-8679-4ebd2fdb5d90 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:17.398214 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e8131-0df8-4d3b-8679-4ebd2fdb5d90 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:17.400284 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 119/235] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:17.407037 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28088695-6bda-4664-8f57-cdaea8d7c631 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:17.407685 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28088695-6bda-4664-8f57-cdaea8d7c631 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:17.407937 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28088695-6bda-4664-8f57-cdaea8d7c631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:17.432272 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-28088695-6bda-4664-8f57-cdaea8d7c631 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:17.433641 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-28088695-6bda-4664-8f57-cdaea8d7c631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:17.508386 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 117/236] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:17.592328 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b5bf6-f2ec-4c47-8b61-e1c0228b71e7 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:17.592661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b5bf6-f2ec-4c47-8b61-e1c0228b71e7 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:17.592942 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b5bf6-f2ec-4c47-8b61-e1c0228b71e7 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:17.594552 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 120/237] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:17.600196 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365d669-6d4b-4f15-915d-1ad0b72972a5 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:17.600483 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365d669-6d4b-4f15-915d-1ad0b72972a5 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:17.600760 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365d669-6d4b-4f15-915d-1ad0b72972a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:17.624863 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-f365d669-6d4b-4f15-915d-1ad0b72972a5 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:17.626040 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f365d669-6d4b-4f15-915d-1ad0b72972a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:17.696216 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 118/238] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:17.884374 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b5bf6-f2ec-4c47-8b61-e1c0228b71e7 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:17.985375 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d421f72-65f9-4374-80b0-006b574c67b5 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:17.985931 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d421f72-65f9-4374-80b0-006b574c67b5 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:17.986322 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d421f72-65f9-4374-80b0-006b574c67b5 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:17.990259 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 119/239] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:18.000524 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08690c47-a43a-4f77-a97c-804816d18898 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:18.000926 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08690c47-a43a-4f77-a97c-804816d18898 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:18.001317 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08690c47-a43a-4f77-a97c-804816d18898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:18.013042 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b5bf6-f2ec-4c47-8b61-e1c0228b71e7 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:18.030076 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-08690c47-a43a-4f77-a97c-804816d18898 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:18.031530 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-08690c47-a43a-4f77-a97c-804816d18898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:18.046808 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:18.073600 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd7c0a-3399-44b4-8b7f-589d2c8c5fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:18.074249 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd7c0a-3399-44b4-8b7f-589d2c8c5fa1 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:18.074556 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd7c0a-3399-44b4-8b7f-589d2c8c5fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:18.074830 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd7c0a-3399-44b4-8b7f-589d2c8c5fa1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:18.076006 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd7c0a-3399-44b4-8b7f-589d2c8c5fa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:18.077573 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd7c0a-3399-44b4-8b7f-589d2c8c5fa1 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:18.079526 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 121/240] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:04:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:18.080244 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd7c0a-3399-44b4-8b7f-589d2c8c5fa1 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:18.115038 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:18.124180 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 120/241] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:04:18.125254 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08690c47-a43a-4f77-a97c-804816d18898 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:18.249614 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd7c0a-3399-44b4-8b7f-589d2c8c5fa1 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:18.317487 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6c898-5c03-4e3d-b6fe-7897152847d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:18.318813 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6c898-5c03-4e3d-b6fe-7897152847d8 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:18.319447 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6c898-5c03-4e3d-b6fe-7897152847d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:18.320044 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6c898-5c03-4e3d-b6fe-7897152847d8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:18.330174 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08690c47-a43a-4f77-a97c-804816d18898 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:18.338371 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6c898-5c03-4e3d-b6fe-7897152847d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:18.349627 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-e3e6c898-5c03-4e3d-b6fe-7897152847d8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:04:18.349627 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:18.349627 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:18.349627 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:18.349627 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:18.349627 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:18.349627 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:18.349627 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:18.349627 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:18.349627 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:18.349627 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:18.349627 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:18.349627 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:18.349627 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:18.349627 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:18.349627 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:18.350895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:18.350895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:18.350895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:18.350895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:18.350895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:18.350895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:18.350895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:18.350895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:18.350895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:18.350895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:18.350895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:18.350895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:18.350895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:18.350895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:18.350895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:18.350895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:18.352573 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:18.352573 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:18.352573 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:18.352573 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:18.352573 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:18.352573 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:18.352573 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:18.352573 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:18.352573 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:18.352573 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:18.352573 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:04:18.352573 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:04:18.356991 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 122/242] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:04:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:18.366354 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6c898-5c03-4e3d-b6fe-7897152847d8 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:18.387478 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45bdbb8-1ec7-4c27-ac7f-4f9549d000ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:18.387892 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bdbb8-1ec7-4c27-ac7f-4f9549d000ce None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:18.388123 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bdbb8-1ec7-4c27-ac7f-4f9549d000ce None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:18.388353 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bdbb8-1ec7-4c27-ac7f-4f9549d000ce None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:18.389026 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45bdbb8-1ec7-4c27-ac7f-4f9549d000ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:18.390485 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45bdbb8-1ec7-4c27-ac7f-4f9549d000ce None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:18.437851 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 121/243] 10.222.0.79 () {60 vars in 1132 bytes} [Wed Aug 31 19:04:18 2022] POST /identity/v3/users => generated 293 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:04:18.481688 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:18.485458 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45bdbb8-1ec7-4c27-ac7f-4f9549d000ce None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:18.491110 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:18.499484 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6c898-5c03-4e3d-b6fe-7897152847d8 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:18.538055 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335cdc7-8b64-49d4-af84-25154a034461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:18.538984 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335cdc7-8b64-49d4-af84-25154a034461 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:18.539486 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335cdc7-8b64-49d4-af84-25154a034461 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:18.539967 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335cdc7-8b64-49d4-af84-25154a034461 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:18.540886 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1335cdc7-8b64-49d4-af84-25154a034461 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:18.541431 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1335cdc7-8b64-49d4-af84-25154a034461 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:18.543780 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1335cdc7-8b64-49d4-af84-25154a034461 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:18.558821 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 123/244] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 19:04:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:04:18.564018 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335cdc7-8b64-49d4-af84-25154a034461 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:18.688960 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45bdbb8-1ec7-4c27-ac7f-4f9549d000ce None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:18.697120 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335cdc7-8b64-49d4-af84-25154a034461 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:18.738865 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c931c1-a0b1-45b4-9636-c18ed400eb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:18.739906 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c931c1-a0b1-45b4-9636-c18ed400eb54 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:18.740555 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c931c1-a0b1-45b4-9636-c18ed400eb54 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:18.740988 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c931c1-a0b1-45b4-9636-c18ed400eb54 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:18.750823 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f9445-0530-4f64-805c-9ae7fc936cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:18.752200 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f9445-0530-4f64-805c-9ae7fc936cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:18.752751 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f9445-0530-4f64-805c-9ae7fc936cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:18.753766 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f9445-0530-4f64-805c-9ae7fc936cc1 None admin] PATH_INFO: `/v3/users/42d42e9cdb114a21a44cd777f1fdb856` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:18.756575 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c931c1-a0b1-45b4-9636-c18ed400eb54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:18.763524 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-62c931c1-a0b1-45b4-9636-c18ed400eb54 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:04:18.763524 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:18.763524 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:18.763524 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:18.763524 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:18.763524 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:18.763524 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:18.763524 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:18.763524 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:18.763524 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:18.763524 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:18.763524 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:18.763524 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:18.763524 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:18.763524 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:18.763524 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:18.764459 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:18.764459 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:18.764459 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:18.764459 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:18.764459 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:18.764459 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:18.764459 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:18.764459 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:18.764459 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:18.764459 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:18.764459 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:18.764459 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:18.764459 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:18.764459 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:18.764459 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:18.764459 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:18.765325 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:18.765325 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:18.765325 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:18.765325 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:18.765325 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:18.765325 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:18.765325 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:18.765325 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:18.765325 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:18.765325 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:18.765325 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:04:18.765325 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:04:18.765325 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 122/245] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:04:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:04:18.771914 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c931c1-a0b1-45b4-9636-c18ed400eb54 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:18.778973 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f9445-0530-4f64-805c-9ae7fc936cc1 None admin] RBAC: Authorizing `identity:get_user(user_id=42d42e9cdb114a21a44cd777f1fdb856)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:18.780710 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f9445-0530-4f64-805c-9ae7fc936cc1 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:18.783249 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 124/246] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:04:18 2022] GET /identity/v3/users/42d42e9cdb114a21a44cd777f1fdb856 => generated 297 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:18.790914 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f9445-0530-4f64-805c-9ae7fc936cc1 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:18.807824 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:18.849257 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:18.897801 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c931c1-a0b1-45b4-9636-c18ed400eb54 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:18.911597 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f9445-0530-4f64-805c-9ae7fc936cc1 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:18.935093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b078d5-1561-49c9-9197-affaf3a5dc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:18.936046 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b078d5-1561-49c9-9197-affaf3a5dc7c None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:18.936551 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b078d5-1561-49c9-9197-affaf3a5dc7c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:18.937022 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b078d5-1561-49c9-9197-affaf3a5dc7c None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:18.937918 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b078d5-1561-49c9-9197-affaf3a5dc7c None admin] RBAC: Adding query filter params (name=member) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:18.938418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b078d5-1561-49c9-9197-affaf3a5dc7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:18.940029 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b078d5-1561-49c9-9197-affaf3a5dc7c None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:18.950361 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291bc6ad-f307-4955-a6ed-313a64d926ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:18.951358 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 123/247] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 19:04:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:04:18.955091 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291bc6ad-f307-4955-a6ed-313a64d926ae None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:18.956491 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b078d5-1561-49c9-9197-affaf3a5dc7c None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:18.956841 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291bc6ad-f307-4955-a6ed-313a64d926ae None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:18.957710 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291bc6ad-f307-4955-a6ed-313a64d926ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:19.053068 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291bc6ad-f307-4955-a6ed-313a64d926ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:19.055380 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291bc6ad-f307-4955-a6ed-313a64d926ae None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:19.070850 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:19.103718 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b078d5-1561-49c9-9197-affaf3a5dc7c None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:19.138506 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:19.156552 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5184f57-2e8a-413b-aabe-8370b63a500b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:19.156552 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5184f57-2e8a-413b-aabe-8370b63a500b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:19.156552 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5184f57-2e8a-413b-aabe-8370b63a500b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:19.156552 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5184f57-2e8a-413b-aabe-8370b63a500b None admin] PATH_INFO: `/v3/users/65770af5315f4185b11b6f7efc9fd9d0` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:19.157858 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5184f57-2e8a-413b-aabe-8370b63a500b None admin] RBAC: Authorizing `identity:get_user(user_id=65770af5315f4185b11b6f7efc9fd9d0)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:19.159868 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5184f57-2e8a-413b-aabe-8370b63a500b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:19.161518 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 124/248] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:04:18 2022] GET /identity/v3/users/65770af5315f4185b11b6f7efc9fd9d0 => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:19.162770 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774e833-e99f-44b9-b489-dd8b1526de0d None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:19.163048 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774e833-e99f-44b9-b489-dd8b1526de0d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:19.163317 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774e833-e99f-44b9-b489-dd8b1526de0d None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:19.164717 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 125/249] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:19.169903 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774e833-e99f-44b9-b489-dd8b1526de0d None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:19.204368 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 125/250] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:04:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:04:19.207004 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1500ba-fc2d-4127-8e93-cf283416a747 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:19.207537 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1500ba-fc2d-4127-8e93-cf283416a747 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:19.208032 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1500ba-fc2d-4127-8e93-cf283416a747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:19.230726 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-ec1500ba-fc2d-4127-8e93-cf283416a747 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:19.232567 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-ec1500ba-fc2d-4127-8e93-cf283416a747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:19.320977 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774e833-e99f-44b9-b489-dd8b1526de0d None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:19.334115 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 126/251] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:19.335087 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1500ba-fc2d-4127-8e93-cf283416a747 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:19.363309 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cdbdea-76db-43a0-ad00-ffb0d44146d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:19.364050 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdbdea-76db-43a0-ad00-ffb0d44146d5 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:19.364425 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdbdea-76db-43a0-ad00-ffb0d44146d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:19.364768 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdbdea-76db-43a0-ad00-ffb0d44146d5 None admin] PATH_INFO: `/v3/projects/3aa248dc3fd34facaa9b43a30893c924` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:19.366006 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cdbdea-76db-43a0-ad00-ffb0d44146d5 None admin] RBAC: Authorizing `identity:get_project(project_id=3aa248dc3fd34facaa9b43a30893c924)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:19.367568 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cdbdea-76db-43a0-ad00-ffb0d44146d5 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:19.369615 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 126/252] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:04:19 2022] GET /identity/v3/projects/3aa248dc3fd34facaa9b43a30893c924 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:19.370879 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218822f-e305-441e-95bd-cb485d520777 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:19.371228 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218822f-e305-441e-95bd-cb485d520777 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:19.371569 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218822f-e305-441e-95bd-cb485d520777 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:19.372915 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 127/253] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:19.379677 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218822f-e305-441e-95bd-cb485d520777 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:19.393604 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:19.455634 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:19.514392 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218822f-e305-441e-95bd-cb485d520777 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:19.540685 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1500ba-fc2d-4127-8e93-cf283416a747 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:19.577994 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9535f4-b0b4-4844-a592-fca8d2dc44b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:19.578603 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9535f4-b0b4-4844-a592-fca8d2dc44b2 None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:19.578885 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9535f4-b0b4-4844-a592-fca8d2dc44b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:19.579153 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9535f4-b0b4-4844-a592-fca8d2dc44b2 None admin] PATH_INFO: `/v3/projects/3aa248dc3fd34facaa9b43a30893c924/users/65770af5315f4185b11b6f7efc9fd9d0/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:19.585270 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9535f4-b0b4-4844-a592-fca8d2dc44b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=3aa248dc3fd34facaa9b43a30893c924, user_id=65770af5315f4185b11b6f7efc9fd9d0, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:19.586874 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9535f4-b0b4-4844-a592-fca8d2dc44b2 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:19.608716 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 128/254] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 19:04:19 2022] PUT /identity/v3/projects/3aa248dc3fd34facaa9b43a30893c924/users/65770af5315f4185b11b6f7efc9fd9d0/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:04:19.610659 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba25b9-cc7f-4fc7-9cb8-aa6e5f9a4840 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:19.610942 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba25b9-cc7f-4fc7-9cb8-aa6e5f9a4840 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:19.618036 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba25b9-cc7f-4fc7-9cb8-aa6e5f9a4840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:19.623871 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec523dd-3d87-4ecb-b2cb-c18ce2c954d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:19.624539 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec523dd-3d87-4ecb-b2cb-c18ce2c954d4 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:19.624814 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec523dd-3d87-4ecb-b2cb-c18ce2c954d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:19.625089 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec523dd-3d87-4ecb-b2cb-c18ce2c954d4 None admin] PATH_INFO: `/v3/projects/3aa248dc3fd34facaa9b43a30893c924` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:19.627487 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec523dd-3d87-4ecb-b2cb-c18ce2c954d4 None admin] RBAC: Authorizing `identity:get_project(project_id=3aa248dc3fd34facaa9b43a30893c924)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:19.631752 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec523dd-3d87-4ecb-b2cb-c18ce2c954d4 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:19.640058 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 127/255] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:04:19 2022] GET /identity/v3/projects/3aa248dc3fd34facaa9b43a30893c924 => generated 302 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:19.646689 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec523dd-3d87-4ecb-b2cb-c18ce2c954d4 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:19.663630 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-42ba25b9-cc7f-4fc7-9cb8-aa6e5f9a4840 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:19.664831 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-42ba25b9-cc7f-4fc7-9cb8-aa6e5f9a4840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:19.780709 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 129/256] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:19.782177 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba25b9-cc7f-4fc7-9cb8-aa6e5f9a4840 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:19.871153 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:19.872210 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec523dd-3d87-4ecb-b2cb-c18ce2c954d4 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:19.883241 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:19.924497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e95d2-582b-48c9-8f80-dd1df10813be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:19.925117 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e95d2-582b-48c9-8f80-dd1df10813be None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:19.925393 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e95d2-582b-48c9-8f80-dd1df10813be None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:19.925661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e95d2-582b-48c9-8f80-dd1df10813be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:19.926399 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e95d2-582b-48c9-8f80-dd1df10813be None admin] RBAC: Adding query filter params (role.id=35835d27c5d14dbbb20c5e3f646a40a9, scope.project.id=3aa248dc3fd34facaa9b43a30893c924, user.id=42d42e9cdb114a21a44cd777f1fdb856) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:19.927244 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e95d2-582b-48c9-8f80-dd1df10813be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:19.928846 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e95d2-582b-48c9-8f80-dd1df10813be None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:19.936972 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 128/257] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:04:19 2022] GET /identity/v3/role_assignments?user.id=42d42e9cdb114a21a44cd777f1fdb856&scope.project.id=3aa248dc3fd34facaa9b43a30893c924&role.id=35835d27c5d14dbbb20c5e3f646a40a9 => generated 259 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:19.966994 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba25b9-cc7f-4fc7-9cb8-aa6e5f9a4840 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:20.029783 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33259627-78bd-4b0d-a23e-a6c4f72f738f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:20.030886 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33259627-78bd-4b0d-a23e-a6c4f72f738f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:20.031374 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33259627-78bd-4b0d-a23e-a6c4f72f738f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:20.031848 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33259627-78bd-4b0d-a23e-a6c4f72f738f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:20.055633 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33259627-78bd-4b0d-a23e-a6c4f72f738f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:20.061150 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-33259627-78bd-4b0d-a23e-a6c4f72f738f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:04:20.061150 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:20.061150 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:20.061150 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:20.061150 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:20.061150 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:20.061150 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:20.061150 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:20.061150 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:20.061150 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:20.061150 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:20.061150 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:20.061150 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:20.061150 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:20.061150 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:20.061150 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:20.062071 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:20.062071 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:20.062071 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:20.062071 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:20.062071 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:20.062071 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:20.062071 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:20.062071 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:20.062071 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:20.062071 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:20.062071 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:20.062071 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:20.062071 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:20.062071 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:20.062071 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:20.062071 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:20.062914 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:20.062914 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:20.062914 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:20.062914 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:20.062914 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:20.062914 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:20.062914 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:20.062914 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:20.062914 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:20.062914 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:20.062914 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:04:20.062914 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:04:20.066102 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 130/258] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 19:04:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:20.072344 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e95d2-582b-48c9-8f80-dd1df10813be None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:20.207981 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e95d2-582b-48c9-8f80-dd1df10813be None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:20.245984 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33259627-78bd-4b0d-a23e-a6c4f72f738f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:20.260265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a54fa2-a592-44a4-9cf6-f7f5e8724450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:20.266493 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a54fa2-a592-44a4-9cf6-f7f5e8724450 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:20.266493 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a54fa2-a592-44a4-9cf6-f7f5e8724450 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:20.266493 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a54fa2-a592-44a4-9cf6-f7f5e8724450 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:20.266493 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a54fa2-a592-44a4-9cf6-f7f5e8724450 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:20.266493 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a54fa2-a592-44a4-9cf6-f7f5e8724450 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:20.266493 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a54fa2-a592-44a4-9cf6-f7f5e8724450 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:20.278055 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 129/259] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:04:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:04:20.283421 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a54fa2-a592-44a4-9cf6-f7f5e8724450 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:20.342426 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:20.443684 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33259627-78bd-4b0d-a23e-a6c4f72f738f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:20.470123 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:20.480379 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a54fa2-a592-44a4-9cf6-f7f5e8724450 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:20.522789 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec7344-2b28-4298-9c70-cc88edb62cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:20.523433 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec7344-2b28-4298-9c70-cc88edb62cd9 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:20.523713 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec7344-2b28-4298-9c70-cc88edb62cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:20.523993 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec7344-2b28-4298-9c70-cc88edb62cd9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:20.530923 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9c306-d0d2-4a1a-b675-9cc04d1b8442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:20.531561 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9c306-d0d2-4a1a-b675-9cc04d1b8442 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:20.532148 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9c306-d0d2-4a1a-b675-9cc04d1b8442 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:20.532566 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9c306-d0d2-4a1a-b675-9cc04d1b8442 None admin] PATH_INFO: `/v3/users/a79bf5e395cf4869831e1e617132317f` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:20.533873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab9c306-d0d2-4a1a-b675-9cc04d1b8442 None admin] RBAC: Authorizing `identity:get_user(user_id=a79bf5e395cf4869831e1e617132317f)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:20.535614 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab9c306-d0d2-4a1a-b675-9cc04d1b8442 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:20.537744 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 130/260] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:04:20 2022] GET /identity/v3/users/a79bf5e395cf4869831e1e617132317f => generated 283 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:04:20.543596 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9c306-d0d2-4a1a-b675-9cc04d1b8442 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:20.567123 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec7344-2b28-4298-9c70-cc88edb62cd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:20.572421 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-ccec7344-2b28-4298-9c70-cc88edb62cd9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:04:20.572421 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:20.572421 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:20.572421 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:20.572421 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:20.572421 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:20.572421 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:20.572421 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:20.572421 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:20.572421 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:20.572421 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:20.572421 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:20.572421 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:20.572421 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:20.572421 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:20.572421 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:20.573514 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:20.573514 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:20.573514 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:20.573514 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:20.573514 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:20.573514 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:20.573514 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:20.573514 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:20.573514 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:20.573514 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:20.573514 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:20.573514 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:20.573514 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:20.573514 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:20.573514 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:20.573514 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:20.574431 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:20.574431 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:20.574431 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:20.574431 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:20.574431 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:20.574431 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:20.574431 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:20.574431 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:20.574431 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:20.574431 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:20.574431 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:04:20.574431 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:04:20.574431 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 131/261] 10.222.0.79 () {56 vars in 1114 bytes} [Wed Aug 31 19:04:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:20.583406 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec7344-2b28-4298-9c70-cc88edb62cd9 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:20.703451 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:20.708990 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9c306-d0d2-4a1a-b675-9cc04d1b8442 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:20.776518 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c9477-7612-4d66-afe6-adb5dee931be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:20.777418 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c9477-7612-4d66-afe6-adb5dee931be None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:20.777858 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c9477-7612-4d66-afe6-adb5dee931be None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:20.778297 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c9477-7612-4d66-afe6-adb5dee931be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:20.846236 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec7344-2b28-4298-9c70-cc88edb62cd9 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:20.919210 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab5f13-afa7-4cf3-a209-9ac7f6a11528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:20.919839 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab5f13-afa7-4cf3-a209-9ac7f6a11528 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:20.920120 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab5f13-afa7-4cf3-a209-9ac7f6a11528 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:20.920390 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab5f13-afa7-4cf3-a209-9ac7f6a11528 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:20.920803 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c9477-7612-4d66-afe6-adb5dee931be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:20.921067 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab5f13-afa7-4cf3-a209-9ac7f6a11528 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:20.921367 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab5f13-afa7-4cf3-a209-9ac7f6a11528 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:20.922781 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab5f13-afa7-4cf3-a209-9ac7f6a11528 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:20.923034 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c9477-7612-4d66-afe6-adb5dee931be None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:20.937882 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 132/262] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:04:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:20.947590 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab5f13-afa7-4cf3-a209-9ac7f6a11528 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:21.023704 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:21.115692 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:21.120392 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 131/263] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:04:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 19:04:21.126379 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c9477-7612-4d66-afe6-adb5dee931be None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:21.182609 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab5f13-afa7-4cf3-a209-9ac7f6a11528 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:21.249283 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d5cd4-c92c-458f-93e5-c24db9c261cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:21.249925 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d5cd4-c92c-458f-93e5-c24db9c261cc None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:21.250201 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d5cd4-c92c-458f-93e5-c24db9c261cc None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:21.250483 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d5cd4-c92c-458f-93e5-c24db9c261cc None admin] PATH_INFO: `/v3/users/a79bf5e395cf4869831e1e617132317f` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:21.254165 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d5cd4-c92c-458f-93e5-c24db9c261cc None admin] RBAC: Authorizing `identity:get_user(user_id=a79bf5e395cf4869831e1e617132317f)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:21.255859 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d5cd4-c92c-458f-93e5-c24db9c261cc None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:21.257591 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 133/264] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:04:20 2022] GET /identity/v3/users/a79bf5e395cf4869831e1e617132317f => generated 283 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:21.284706 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d5cd4-c92c-458f-93e5-c24db9c261cc None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:21.348798 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c9477-7612-4d66-afe6-adb5dee931be None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:21.450943 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440642fc-dc8c-4d0a-a90b-4e81492e7859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:21.451521 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440642fc-dc8c-4d0a-a90b-4e81492e7859 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:21.451799 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440642fc-dc8c-4d0a-a90b-4e81492e7859 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:21.452070 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440642fc-dc8c-4d0a-a90b-4e81492e7859 None admin] PATH_INFO: `/v3/projects/3aa248dc3fd34facaa9b43a30893c924` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:21.453448 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440642fc-dc8c-4d0a-a90b-4e81492e7859 None admin] RBAC: Authorizing `identity:get_project(project_id=3aa248dc3fd34facaa9b43a30893c924)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:21.455877 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440642fc-dc8c-4d0a-a90b-4e81492e7859 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:21.458129 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 132/265] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:04:21 2022] GET /identity/v3/projects/3aa248dc3fd34facaa9b43a30893c924 => generated 302 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:21.459820 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aadadc0-42d5-47b3-8d99-b5f676a0f5a3 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:21.460104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aadadc0-42d5-47b3-8d99-b5f676a0f5a3 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:21.460380 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aadadc0-42d5-47b3-8d99-b5f676a0f5a3 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:21.460724 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:21.462389 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 133/266] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:21.467780 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aadadc0-42d5-47b3-8d99-b5f676a0f5a3 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:21.471038 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d5cd4-c92c-458f-93e5-c24db9c261cc None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:21.545746 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913686aa-b323-4746-b74d-7297e54fbf3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:21.548003 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913686aa-b323-4746-b74d-7297e54fbf3d None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:21.548467 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913686aa-b323-4746-b74d-7297e54fbf3d None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:21.550929 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913686aa-b323-4746-b74d-7297e54fbf3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:21.597729 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:21.648043 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aadadc0-42d5-47b3-8d99-b5f676a0f5a3 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:21.665900 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913686aa-b323-4746-b74d-7297e54fbf3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:21.668239 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913686aa-b323-4746-b74d-7297e54fbf3d None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:21.690081 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd4f64-5c7c-4f70-80d9-a8df4b960c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:21.690836 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd4f64-5c7c-4f70-80d9-a8df4b960c46 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:21.691184 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd4f64-5c7c-4f70-80d9-a8df4b960c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:21.691526 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd4f64-5c7c-4f70-80d9-a8df4b960c46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:21.692396 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd4f64-5c7c-4f70-80d9-a8df4b960c46 None admin] RBAC: Adding query filter params (role.id=edc551338adb4ae88bdafc591ad69582, scope.project.id=3aa248dc3fd34facaa9b43a30893c924, user.id=a79bf5e395cf4869831e1e617132317f) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:21.692867 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd4f64-5c7c-4f70-80d9-a8df4b960c46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:21.694428 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd4f64-5c7c-4f70-80d9-a8df4b960c46 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:21.701785 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 134/267] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:04:21 2022] GET /identity/v3/role_assignments?user.id=a79bf5e395cf4869831e1e617132317f&scope.project.id=3aa248dc3fd34facaa9b43a30893c924&role.id=edc551338adb4ae88bdafc591ad69582 => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:21.703357 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcba96b-8b37-4685-a684-ce175f5f79f8 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:21.703643 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcba96b-8b37-4685-a684-ce175f5f79f8 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:21.703916 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcba96b-8b37-4685-a684-ce175f5f79f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:21.756144 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-bdcba96b-8b37-4685-a684-ce175f5f79f8 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:21.757880 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-bdcba96b-8b37-4685-a684-ce175f5f79f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:21.807970 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 134/268] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:04:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:04:21.809353 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3ce6d-ad71-4dc3-b8a3-694d00bafb2f None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:21.809647 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3ce6d-ad71-4dc3-b8a3-694d00bafb2f None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:21.809924 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3ce6d-ad71-4dc3-b8a3-694d00bafb2f None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:21.811220 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 135/269] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:21.811685 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:21.816914 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3ce6d-ad71-4dc3-b8a3-694d00bafb2f None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:21.943410 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3ce6d-ad71-4dc3-b8a3-694d00bafb2f None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:21.951336 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 135/270] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:21.958679 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a518c-aafa-4f93-9c30-9c31d99ace68 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:21.958911 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a518c-aafa-4f93-9c30-9c31d99ace68 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:21.959641 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a518c-aafa-4f93-9c30-9c31d99ace68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:21.984565 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-b89a518c-aafa-4f93-9c30-9c31d99ace68 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:21.985740 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-b89a518c-aafa-4f93-9c30-9c31d99ace68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:21.998881 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9973f-b705-4f44-92ff-7f241c42e136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:21.999939 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9973f-b705-4f44-92ff-7f241c42e136 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:22.000296 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9973f-b705-4f44-92ff-7f241c42e136 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:22.000667 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9973f-b705-4f44-92ff-7f241c42e136 None admin] PATH_INFO: `/v3/projects/3aa248dc3fd34facaa9b43a30893c924` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:22.002812 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9973f-b705-4f44-92ff-7f241c42e136 None admin] RBAC: Authorizing `identity:get_project(project_id=3aa248dc3fd34facaa9b43a30893c924)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:22.005136 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9973f-b705-4f44-92ff-7f241c42e136 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:22.008337 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 136/271] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:04:21 2022] GET /identity/v3/projects/3aa248dc3fd34facaa9b43a30893c924 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:22.014263 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9973f-b705-4f44-92ff-7f241c42e136 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:22.051335 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:22.062963 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 136/272] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:22.096693 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:22.135490 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9973f-b705-4f44-92ff-7f241c42e136 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:22.176698 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3a362-6775-4e41-b3f0-685feecd6e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:22.177564 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3a362-6775-4e41-b3f0-685feecd6e78 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:22.178001 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3a362-6775-4e41-b3f0-685feecd6e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:22.178275 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3a362-6775-4e41-b3f0-685feecd6e78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:22.179639 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d3a362-6775-4e41-b3f0-685feecd6e78 None admin] RBAC: Adding query filter params (role.id=d01cf7e1efe04d8c8f8d09667717555c, scope.project.id=3aa248dc3fd34facaa9b43a30893c924, user.id=a79bf5e395cf4869831e1e617132317f) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:22.179975 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d3a362-6775-4e41-b3f0-685feecd6e78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:22.181678 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d3a362-6775-4e41-b3f0-685feecd6e78 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:22.188821 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 137/273] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:04:22 2022] GET /identity/v3/role_assignments?user.id=a79bf5e395cf4869831e1e617132317f&scope.project.id=3aa248dc3fd34facaa9b43a30893c924&role.id=d01cf7e1efe04d8c8f8d09667717555c => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:04:22.275291 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a518c-aafa-4f93-9c30-9c31d99ace68 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:22.386547 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3a362-6775-4e41-b3f0-685feecd6e78 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:22.389388 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a518c-aafa-4f93-9c30-9c31d99ace68 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:22.432533 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c294b-6e3e-43a5-844a-a438adbe1efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:22.434370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c294b-6e3e-43a5-844a-a438adbe1efc None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:22.434921 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c294b-6e3e-43a5-844a-a438adbe1efc None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:22.435392 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c294b-6e3e-43a5-844a-a438adbe1efc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:22.449316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c294b-6e3e-43a5-844a-a438adbe1efc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:22.456525 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-432c294b-6e3e-43a5-844a-a438adbe1efc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:04:22.456525 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:22.456525 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:22.456525 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:22.456525 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:22.456525 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:22.456525 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:22.456525 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:22.456525 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:22.456525 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:22.456525 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:22.456525 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:22.456525 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:22.456525 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:22.456525 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:22.456525 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:22.457461 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:22.457461 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:22.457461 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:22.457461 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:22.457461 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:22.457461 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:22.457461 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:22.457461 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:22.457461 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:22.457461 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:22.457461 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:22.457461 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:22.457461 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:22.457461 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:22.457461 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:22.457461 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:22.458265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:22.458265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:22.458265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:22.458265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:22.458265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:22.458265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:22.458265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:22.458265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:22.458265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:22.458265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:22.458265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:04:22.458265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:04:22.460075 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 137/274] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:04:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:22.465824 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c294b-6e3e-43a5-844a-a438adbe1efc None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:22.523318 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3a362-6775-4e41-b3f0-685feecd6e78 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:22.526693 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:22.562186 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:22.570099 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca85b3-2aaa-41a5-af0e-2973c2618052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:22.571252 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca85b3-2aaa-41a5-af0e-2973c2618052 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:22.571738 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca85b3-2aaa-41a5-af0e-2973c2618052 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:22.572270 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca85b3-2aaa-41a5-af0e-2973c2618052 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:22.573909 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca85b3-2aaa-41a5-af0e-2973c2618052 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:22.575660 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca85b3-2aaa-41a5-af0e-2973c2618052 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:22.581877 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 138/275] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:04:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:22.582654 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c294b-6e3e-43a5-844a-a438adbe1efc None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:22.584122 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca85b3-2aaa-41a5-af0e-2973c2618052 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:22.625173 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aba2ed-6750-4d6b-81b7-25863c260d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:22.629190 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aba2ed-6750-4d6b-81b7-25863c260d12 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:22.629190 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aba2ed-6750-4d6b-81b7-25863c260d12 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:22.629190 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aba2ed-6750-4d6b-81b7-25863c260d12 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:22.629750 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aba2ed-6750-4d6b-81b7-25863c260d12 None admin] RBAC: Adding query filter params (name=member) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:22.630167 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aba2ed-6750-4d6b-81b7-25863c260d12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:22.632231 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aba2ed-6750-4d6b-81b7-25863c260d12 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:22.646138 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 138/276] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 19:04:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:04:22.653485 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aba2ed-6750-4d6b-81b7-25863c260d12 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:22.714883 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca85b3-2aaa-41a5-af0e-2973c2618052 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:22.761648 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f13ab1-ded2-4518-99dd-fe00a81dcc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:22.762950 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f13ab1-ded2-4518-99dd-fe00a81dcc7e None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:22.763680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f13ab1-ded2-4518-99dd-fe00a81dcc7e None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:22.764203 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f13ab1-ded2-4518-99dd-fe00a81dcc7e None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:22.765095 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f13ab1-ded2-4518-99dd-fe00a81dcc7e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:22.767635 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f13ab1-ded2-4518-99dd-fe00a81dcc7e None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:22.807341 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 139/277] 10.222.0.79 () {60 vars in 1132 bytes} [Wed Aug 31 19:04:22 2022] POST /identity/v3/users => generated 293 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:04:22.817415 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aba2ed-6750-4d6b-81b7-25863c260d12 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:22.834154 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:22.853283 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8a0ac-fea0-4997-a916-d0ae38ecf71d None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:22.853566 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8a0ac-fea0-4997-a916-d0ae38ecf71d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:22.853845 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8a0ac-fea0-4997-a916-d0ae38ecf71d None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:22.858584 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 140/278] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:22.861408 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68995b2e-af0f-42ff-8548-e8bd3c54534a None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:22.861833 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68995b2e-af0f-42ff-8548-e8bd3c54534a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:22.862802 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68995b2e-af0f-42ff-8548-e8bd3c54534a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:22.867262 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b82494-81b3-4e7b-918e-83350b8a309f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:22.868251 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b82494-81b3-4e7b-918e-83350b8a309f None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:22.868536 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b82494-81b3-4e7b-918e-83350b8a309f None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:22.868886 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b82494-81b3-4e7b-918e-83350b8a309f None admin] PATH_INFO: `/v3/users/83caa29619cd4a0dafefd7dabf62bda0` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:22.886859 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b82494-81b3-4e7b-918e-83350b8a309f None admin] RBAC: Authorizing `identity:get_user(user_id=83caa29619cd4a0dafefd7dabf62bda0)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:22.887176 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-68995b2e-af0f-42ff-8548-e8bd3c54534a None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:22.888431 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-68995b2e-af0f-42ff-8548-e8bd3c54534a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:22.888977 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b82494-81b3-4e7b-918e-83350b8a309f None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:22.891289 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 139/279] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:04:22 2022] GET /identity/v3/users/83caa29619cd4a0dafefd7dabf62bda0 => generated 293 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:22.900140 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b82494-81b3-4e7b-918e-83350b8a309f None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:22.964338 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:22.987885 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 141/280] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:04:23.009089 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3154b9-53e2-4a79-89fb-36ff29c9f854 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:23.010216 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3154b9-53e2-4a79-89fb-36ff29c9f854 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:23.010216 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3154b9-53e2-4a79-89fb-36ff29c9f854 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:23.011415 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 142/281] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:04:23.016373 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7545fe1-780f-4a47-abe2-755e06def9b9 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:23.016656 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7545fe1-780f-4a47-abe2-755e06def9b9 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:23.016928 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7545fe1-780f-4a47-abe2-755e06def9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:23.039284 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-b7545fe1-780f-4a47-abe2-755e06def9b9 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:23.040821 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b7545fe1-780f-4a47-abe2-755e06def9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:23.057312 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b82494-81b3-4e7b-918e-83350b8a309f None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:23.097316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07884d9-a948-4ca1-897f-9371b3487e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:23.098074 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07884d9-a948-4ca1-897f-9371b3487e92 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:23.098354 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07884d9-a948-4ca1-897f-9371b3487e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:23.098651 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07884d9-a948-4ca1-897f-9371b3487e92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:23.099391 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07884d9-a948-4ca1-897f-9371b3487e92 None admin] RBAC: Adding query filter params (role.id=27c44f922df34ac6bcb3794b111cb3da, user.id=83caa29619cd4a0dafefd7dabf62bda0, scope.system=all) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:23.099693 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07884d9-a948-4ca1-897f-9371b3487e92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:23.101120 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07884d9-a948-4ca1-897f-9371b3487e92 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:23.107272 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 140/282] 10.222.0.79 () {56 vars in 1308 bytes} [Wed Aug 31 19:04:22 2022] GET /identity/v3/role_assignments?user.id=83caa29619cd4a0dafefd7dabf62bda0&scope.system=all&role.id=27c44f922df34ac6bcb3794b111cb3da => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:23.145472 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 143/283] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:23.301955 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07884d9-a948-4ca1-897f-9371b3487e92 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:23.341231 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:23.413742 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07884d9-a948-4ca1-897f-9371b3487e92 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:23.452108 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1090d-b265-4723-80c1-25b04575d64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:23.452745 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1090d-b265-4723-80c1-25b04575d64a None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:23.453024 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1090d-b265-4723-80c1-25b04575d64a None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:23.453296 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1090d-b265-4723-80c1-25b04575d64a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:23.464947 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a1090d-b265-4723-80c1-25b04575d64a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:23.469933 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-b0a1090d-b265-4723-80c1-25b04575d64a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:04:23.469933 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:23.469933 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:23.469933 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:23.469933 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:23.469933 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:23.469933 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:23.469933 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:23.469933 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:23.469933 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:23.469933 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:23.469933 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:23.469933 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:23.469933 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:23.469933 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:23.469933 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:23.470845 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:23.470845 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:23.470845 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:23.470845 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:23.470845 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:23.470845 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:23.470845 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:23.470845 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:23.470845 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:23.470845 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:23.470845 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:23.470845 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:23.470845 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:23.470845 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:23.470845 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:23.470845 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:23.472600 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:23.472600 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:23.472600 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:23.472600 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:23.472600 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:23.472600 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:23.472600 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:23.472600 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:23.472600 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:23.472600 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:23.472600 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:04:23.472600 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:04:23.472600 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 141/284] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:04:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:23.478293 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7545fe1-780f-4a47-abe2-755e06def9b9 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:23.487843 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1090d-b265-4723-80c1-25b04575d64a None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:23.627351 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7545fe1-780f-4a47-abe2-755e06def9b9 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:23.650842 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:23.669009 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bda40e-ad2e-443f-b08f-d728438bb6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:23.669655 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bda40e-ad2e-443f-b08f-d728438bb6ba None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:23.670133 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bda40e-ad2e-443f-b08f-d728438bb6ba None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:23.670429 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bda40e-ad2e-443f-b08f-d728438bb6ba None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:23.671175 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bda40e-ad2e-443f-b08f-d728438bb6ba None admin] RBAC: Adding query filter params (name=member) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:23.671484 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bda40e-ad2e-443f-b08f-d728438bb6ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:23.676585 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bda40e-ad2e-443f-b08f-d728438bb6ba None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:23.691794 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:23.698769 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 144/285] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 19:04:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:23.702187 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bda40e-ad2e-443f-b08f-d728438bb6ba None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:23.705186 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1090d-b265-4723-80c1-25b04575d64a None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:23.800110 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7060e91f-4659-4b8d-9ff6-4a2e1e9d4abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:23.800772 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060e91f-4659-4b8d-9ff6-4a2e1e9d4abd None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:23.801050 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060e91f-4659-4b8d-9ff6-4a2e1e9d4abd None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:23.801321 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060e91f-4659-4b8d-9ff6-4a2e1e9d4abd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:23.827690 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7060e91f-4659-4b8d-9ff6-4a2e1e9d4abd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:23.830548 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bda40e-ad2e-443f-b08f-d728438bb6ba None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:23.832944 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-7060e91f-4659-4b8d-9ff6-4a2e1e9d4abd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:04:23.832944 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:23.832944 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:23.832944 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:23.832944 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:23.832944 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:23.832944 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:23.832944 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:23.832944 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:23.832944 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:23.832944 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:23.832944 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:23.832944 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:23.832944 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:23.832944 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:23.832944 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:23.833809 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:23.833809 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:23.833809 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:23.833809 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:23.833809 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:23.833809 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:23.833809 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:23.833809 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:23.833809 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:23.833809 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:23.833809 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:23.833809 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:23.833809 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:23.833809 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:23.833809 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:23.833809 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:23.834627 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:23.834627 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:23.834627 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:23.834627 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:23.834627 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:23.834627 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:23.834627 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:23.834627 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:23.834627 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:23.834627 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:23.834627 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:04:23.834627 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:04:23.836711 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 142/286] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:04:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:04:23.841884 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7060e91f-4659-4b8d-9ff6-4a2e1e9d4abd None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:23.901242 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0500c9a-8652-4d31-a4a2-957c5d040fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:23.902633 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0500c9a-8652-4d31-a4a2-957c5d040fcc None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:23.904446 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0500c9a-8652-4d31-a4a2-957c5d040fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:23.905442 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0500c9a-8652-4d31-a4a2-957c5d040fcc None admin] PATH_INFO: `/v3/users/65770af5315f4185b11b6f7efc9fd9d0` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:23.909985 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0500c9a-8652-4d31-a4a2-957c5d040fcc None admin] RBAC: Authorizing `identity:get_user(user_id=65770af5315f4185b11b6f7efc9fd9d0)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:23.911468 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0500c9a-8652-4d31-a4a2-957c5d040fcc None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:23.913082 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 145/287] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:04:23 2022] GET /identity/v3/users/65770af5315f4185b11b6f7efc9fd9d0 => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:23.918953 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0500c9a-8652-4d31-a4a2-957c5d040fcc None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:23.987396 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7060e91f-4659-4b8d-9ff6-4a2e1e9d4abd None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:24.023699 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a2c78-110a-4413-94d1-a998a618112d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:24.024692 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a2c78-110a-4413-94d1-a998a618112d None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:24.025172 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a2c78-110a-4413-94d1-a998a618112d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:24.025644 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a2c78-110a-4413-94d1-a998a618112d None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:24.026559 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a2c78-110a-4413-94d1-a998a618112d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:24.027065 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a2c78-110a-4413-94d1-a998a618112d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:24.028652 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a2c78-110a-4413-94d1-a998a618112d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:24.045042 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 143/288] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 19:04:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:24.051426 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a2c78-110a-4413-94d1-a998a618112d None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:24.053151 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:24.090843 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:24.129461 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0500c9a-8652-4d31-a4a2-957c5d040fcc None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:24.172802 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78baa028-c701-4f15-8c57-2b42ecc62857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:24.174299 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78baa028-c701-4f15-8c57-2b42ecc62857 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:24.175010 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78baa028-c701-4f15-8c57-2b42ecc62857 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:24.175724 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78baa028-c701-4f15-8c57-2b42ecc62857 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:24.289027 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78baa028-c701-4f15-8c57-2b42ecc62857 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:24.290421 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78baa028-c701-4f15-8c57-2b42ecc62857 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:24.317789 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a2c78-110a-4413-94d1-a998a618112d None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:24.340020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:24.403487 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 146/289] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:04:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:04:24.409178 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78baa028-c701-4f15-8c57-2b42ecc62857 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:24.410946 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6673cd-1ab4-4631-88bf-8f9e5201f690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:24.411592 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6673cd-1ab4-4631-88bf-8f9e5201f690 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:24.411873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6673cd-1ab4-4631-88bf-8f9e5201f690 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:24.412154 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6673cd-1ab4-4631-88bf-8f9e5201f690 None admin] PATH_INFO: `/v3/users/42d42e9cdb114a21a44cd777f1fdb856` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:24.413303 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6673cd-1ab4-4631-88bf-8f9e5201f690 None admin] RBAC: Authorizing `identity:get_user(user_id=42d42e9cdb114a21a44cd777f1fdb856)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:24.414761 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6673cd-1ab4-4631-88bf-8f9e5201f690 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:24.416338 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 144/290] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:04:24 2022] GET /identity/v3/users/42d42e9cdb114a21a44cd777f1fdb856 => generated 297 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:24.427570 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6673cd-1ab4-4631-88bf-8f9e5201f690 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:24.519169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78baa028-c701-4f15-8c57-2b42ecc62857 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:24.553541 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46327970-9113-44b0-b453-fd823c44c3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:24.554421 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46327970-9113-44b0-b453-fd823c44c3ff None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:24.555685 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46327970-9113-44b0-b453-fd823c44c3ff None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:24.556707 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46327970-9113-44b0-b453-fd823c44c3ff None admin] PATH_INFO: `/v3/projects/3aa248dc3fd34facaa9b43a30893c924` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:24.560384 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46327970-9113-44b0-b453-fd823c44c3ff None admin] RBAC: Authorizing `identity:get_project(project_id=3aa248dc3fd34facaa9b43a30893c924)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:24.562226 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46327970-9113-44b0-b453-fd823c44c3ff None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:24.571053 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 147/291] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:04:24 2022] GET /identity/v3/projects/3aa248dc3fd34facaa9b43a30893c924 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:04:24.574808 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46327970-9113-44b0-b453-fd823c44c3ff None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:24.619957 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:24.642860 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:24.675620 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6673cd-1ab4-4631-88bf-8f9e5201f690 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:24.691934 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46327970-9113-44b0-b453-fd823c44c3ff None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:24.731761 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9eecf1-5a9b-4b7e-ad3e-a4e90d56148d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:24.732450 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9eecf1-5a9b-4b7e-ad3e-a4e90d56148d None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:24.732685 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9eecf1-5a9b-4b7e-ad3e-a4e90d56148d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:24.732959 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9eecf1-5a9b-4b7e-ad3e-a4e90d56148d None admin] PATH_INFO: `/v3/projects/3aa248dc3fd34facaa9b43a30893c924` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:24.734231 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9eecf1-5a9b-4b7e-ad3e-a4e90d56148d None admin] RBAC: Authorizing `identity:get_project(project_id=3aa248dc3fd34facaa9b43a30893c924)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:24.735719 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9eecf1-5a9b-4b7e-ad3e-a4e90d56148d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:24.739436 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 145/292] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:04:24 2022] GET /identity/v3/projects/3aa248dc3fd34facaa9b43a30893c924 => generated 302 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:24.743868 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9eecf1-5a9b-4b7e-ad3e-a4e90d56148d None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:24.758930 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2af953-f39c-4534-95f5-617a91914328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:24.759552 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2af953-f39c-4534-95f5-617a91914328 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:24.759834 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2af953-f39c-4534-95f5-617a91914328 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:24.760106 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2af953-f39c-4534-95f5-617a91914328 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:24.760849 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2af953-f39c-4534-95f5-617a91914328 None admin] RBAC: Adding query filter params (role.id=27c44f922df34ac6bcb3794b111cb3da, scope.project.id=3aa248dc3fd34facaa9b43a30893c924, user.id=65770af5315f4185b11b6f7efc9fd9d0) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:24.761158 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2af953-f39c-4534-95f5-617a91914328 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:24.762617 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2af953-f39c-4534-95f5-617a91914328 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:24.782564 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 148/293] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:04:24 2022] GET /identity/v3/role_assignments?user.id=65770af5315f4185b11b6f7efc9fd9d0&scope.project.id=3aa248dc3fd34facaa9b43a30893c924&role.id=27c44f922df34ac6bcb3794b111cb3da => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:24.915308 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9eecf1-5a9b-4b7e-ad3e-a4e90d56148d None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:24.958175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dceb747-c414-47e5-a827-2255e9b91d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:24.958887 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dceb747-c414-47e5-a827-2255e9b91d39 None admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:24.959170 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dceb747-c414-47e5-a827-2255e9b91d39 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:24.959448 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dceb747-c414-47e5-a827-2255e9b91d39 None admin] PATH_INFO: `/v3/projects/3aa248dc3fd34facaa9b43a30893c924/users/42d42e9cdb114a21a44cd777f1fdb856/roles/35835d27c5d14dbbb20c5e3f646a40a9` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:24.961404 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dceb747-c414-47e5-a827-2255e9b91d39 None admin] RBAC: Authorizing `identity:create_grant(project_id=3aa248dc3fd34facaa9b43a30893c924, user_id=42d42e9cdb114a21a44cd777f1fdb856, role_id=35835d27c5d14dbbb20c5e3f646a40a9)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:24.962992 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dceb747-c414-47e5-a827-2255e9b91d39 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:24.976474 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 146/294] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 19:04:24 2022] PUT /identity/v3/projects/3aa248dc3fd34facaa9b43a30893c924/users/42d42e9cdb114a21a44cd777f1fdb856/roles/35835d27c5d14dbbb20c5e3f646a40a9 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:04:25.292526 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6914f-af25-4004-86db-722ac434e86c None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:25.292874 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6914f-af25-4004-86db-722ac434e86c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:25.293106 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6914f-af25-4004-86db-722ac434e86c None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:25.294785 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 149/295] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:25.302090 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659826d4-b2d0-47eb-b2f1-00d64668bf6a None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:25.302378 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659826d4-b2d0-47eb-b2f1-00d64668bf6a None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:25.302749 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659826d4-b2d0-47eb-b2f1-00d64668bf6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:25.325025 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-659826d4-b2d0-47eb-b2f1-00d64668bf6a None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:25.326262 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-659826d4-b2d0-47eb-b2f1-00d64668bf6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:25.337266 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:25.351346 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d2235-9d4c-4375-8eb7-204f26ec0b20 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:25.351647 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d2235-9d4c-4375-8eb7-204f26ec0b20 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:25.352154 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d2235-9d4c-4375-8eb7-204f26ec0b20 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:25.353749 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 150/296] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:25.359355 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7fbbf-c885-466f-8da0-a826bddde2d0 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:25.359641 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7fbbf-c885-466f-8da0-a826bddde2d0 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:25.359921 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7fbbf-c885-466f-8da0-a826bddde2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:25.380126 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-3fc7fbbf-c885-466f-8da0-a826bddde2d0 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:25.381512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3fc7fbbf-c885-466f-8da0-a826bddde2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:25.422323 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 147/297] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:25.464906 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 151/298] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:04:25.655187 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cc86a-e1aa-4e35-95e8-a5c44c331ad8 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:25.655541 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cc86a-e1aa-4e35-95e8-a5c44c331ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:25.655925 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cc86a-e1aa-4e35-95e8-a5c44c331ad8 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:25.657678 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 148/299] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:25.664317 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32ac39-eefd-486a-b39d-b5391aaf9f8f None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:25.664782 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32ac39-eefd-486a-b39d-b5391aaf9f8f None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:25.664857 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32ac39-eefd-486a-b39d-b5391aaf9f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:25.686326 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-0d32ac39-eefd-486a-b39d-b5391aaf9f8f None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:25.687531 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0d32ac39-eefd-486a-b39d-b5391aaf9f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:25.689591 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:25.721465 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cc86a-e1aa-4e35-95e8-a5c44c331ad8 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:25.760069 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 152/300] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:25.760916 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32ac39-eefd-486a-b39d-b5391aaf9f8f None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:25.850485 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cc86a-e1aa-4e35-95e8-a5c44c331ad8 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:25.882701 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32ac39-eefd-486a-b39d-b5391aaf9f8f None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:25.886978 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f3424-1acc-4ced-8c7c-799773deefd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:25.887615 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f3424-1acc-4ced-8c7c-799773deefd4 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:25.887890 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f3424-1acc-4ced-8c7c-799773deefd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:25.888439 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f3424-1acc-4ced-8c7c-799773deefd4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:25.901998 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f3424-1acc-4ced-8c7c-799773deefd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:25.907330 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-184f3424-1acc-4ced-8c7c-799773deefd4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:04:25.907330 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:25.907330 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:25.907330 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:25.907330 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:25.907330 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:25.907330 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:25.907330 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:25.907330 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:25.907330 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:25.907330 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:25.907330 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:25.907330 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:25.907330 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:25.907330 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:25.907330 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:25.908171 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:25.908171 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:25.908171 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:25.908171 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:25.908171 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:25.908171 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:25.908171 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:25.908171 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:25.908171 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:25.908171 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:25.908171 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:25.908171 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:25.908171 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:25.908171 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:25.908171 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:25.908171 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:25.909496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:25.909496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:25.909496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:25.909496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:25.909496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:25.909496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:25.909496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:25.909496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:25.909496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:25.909496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:25.909496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:04:25.909496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:04:25.909496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 149/301] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:04:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:25.917542 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f3424-1acc-4ced-8c7c-799773deefd4 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:25.923590 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:25.928660 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65902b-2dc0-4637-bcf8-f7fbc485359c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:25.929301 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65902b-2dc0-4637-bcf8-f7fbc485359c None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:25.929620 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65902b-2dc0-4637-bcf8-f7fbc485359c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:25.929896 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65902b-2dc0-4637-bcf8-f7fbc485359c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:25.941525 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:25.949209 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65902b-2dc0-4637-bcf8-f7fbc485359c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:25.954578 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-ea65902b-2dc0-4637-bcf8-f7fbc485359c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:04:25.954578 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:25.954578 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:25.954578 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:25.954578 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:25.954578 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:25.954578 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:25.954578 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:25.954578 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:25.954578 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:25.954578 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:25.954578 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:25.954578 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:25.954578 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:25.954578 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:25.954578 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:25.959731 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:25.959731 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:25.959731 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:25.959731 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:25.959731 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:25.959731 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:25.959731 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:25.959731 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:25.959731 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:25.959731 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:25.959731 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:25.959731 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:25.959731 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:25.959731 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:25.959731 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:25.959731 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:25.960928 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:25.960928 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:25.960928 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:25.960928 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:25.960928 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:25.960928 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:25.960928 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:25.960928 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:25.960928 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:25.960928 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:25.960928 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:04:25.960928 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:04:25.960928 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 153/302] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:04:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:25.961568 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65902b-2dc0-4637-bcf8-f7fbc485359c None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:26.072366 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f3424-1acc-4ced-8c7c-799773deefd4 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:26.090682 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65902b-2dc0-4637-bcf8-f7fbc485359c None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:26.116536 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718533f6-a719-49b9-a83d-58eaefec1877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:26.117693 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718533f6-a719-49b9-a83d-58eaefec1877 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:26.117693 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718533f6-a719-49b9-a83d-58eaefec1877 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:26.117693 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718533f6-a719-49b9-a83d-58eaefec1877 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:26.118333 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718533f6-a719-49b9-a83d-58eaefec1877 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:26.118674 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718533f6-a719-49b9-a83d-58eaefec1877 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:26.120043 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718533f6-a719-49b9-a83d-58eaefec1877 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:26.128927 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 150/303] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 19:04:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:26.129761 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718533f6-a719-49b9-a83d-58eaefec1877 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:26.137995 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558587e0-3cac-4b48-ae8d-065ac80795c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:26.138992 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558587e0-3cac-4b48-ae8d-065ac80795c8 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:26.139455 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558587e0-3cac-4b48-ae8d-065ac80795c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:26.139908 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558587e0-3cac-4b48-ae8d-065ac80795c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:26.141027 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558587e0-3cac-4b48-ae8d-065ac80795c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:26.141535 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558587e0-3cac-4b48-ae8d-065ac80795c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:26.144002 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558587e0-3cac-4b48-ae8d-065ac80795c8 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:26.156813 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 154/304] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 19:04:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:04:26.158228 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558587e0-3cac-4b48-ae8d-065ac80795c8 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:26.218160 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:26.224372 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:26.260334 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718533f6-a719-49b9-a83d-58eaefec1877 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:26.267391 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558587e0-3cac-4b48-ae8d-065ac80795c8 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:26.300480 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61326711-1523-430b-9eaf-7fdca04287f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:26.301113 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61326711-1523-430b-9eaf-7fdca04287f2 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:26.301395 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61326711-1523-430b-9eaf-7fdca04287f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:26.301664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61326711-1523-430b-9eaf-7fdca04287f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:26.302846 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61326711-1523-430b-9eaf-7fdca04287f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:26.304258 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61326711-1523-430b-9eaf-7fdca04287f2 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:26.305391 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d85220-557f-4dc5-8fd1-e09eb848658c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:26.310622 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 151/305] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:04:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:26.310754 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d85220-557f-4dc5-8fd1-e09eb848658c None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:26.310754 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d85220-557f-4dc5-8fd1-e09eb848658c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:26.310754 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d85220-557f-4dc5-8fd1-e09eb848658c None admin] PATH_INFO: `/v3/users/e67262561a8a4291b26880f840675855` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:26.310930 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61326711-1523-430b-9eaf-7fdca04287f2 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:26.325629 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d85220-557f-4dc5-8fd1-e09eb848658c None admin] RBAC: Authorizing `identity:get_user(user_id=e67262561a8a4291b26880f840675855)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:26.327139 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d85220-557f-4dc5-8fd1-e09eb848658c None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:26.328817 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 155/306] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:04:26 2022] GET /identity/v3/users/e67262561a8a4291b26880f840675855 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:26.329558 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d85220-557f-4dc5-8fd1-e09eb848658c None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:26.434868 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61326711-1523-430b-9eaf-7fdca04287f2 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:26.438222 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d85220-557f-4dc5-8fd1-e09eb848658c None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:26.456736 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:26.471092 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d8d0d-a6e1-4938-852c-cc3c1dac1dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:26.472381 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d8d0d-a6e1-4938-852c-cc3c1dac1dfb None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:26.472660 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d8d0d-a6e1-4938-852c-cc3c1dac1dfb None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:26.473045 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d8d0d-a6e1-4938-852c-cc3c1dac1dfb None admin] PATH_INFO: `/v3/users/83caa29619cd4a0dafefd7dabf62bda0` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:26.474208 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d8d0d-a6e1-4938-852c-cc3c1dac1dfb None admin] RBAC: Authorizing `identity:get_user(user_id=83caa29619cd4a0dafefd7dabf62bda0)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:26.476004 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d8d0d-a6e1-4938-852c-cc3c1dac1dfb None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:26.477911 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab6eaf-43b3-4cbe-b67b-a229f29184d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:26.478551 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab6eaf-43b3-4cbe-b67b-a229f29184d0 None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:26.478827 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab6eaf-43b3-4cbe-b67b-a229f29184d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:26.479093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab6eaf-43b3-4cbe-b67b-a229f29184d0 None admin] PATH_INFO: `/v3/groups` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:26.479732 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab6eaf-43b3-4cbe-b67b-a229f29184d0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:26.481147 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab6eaf-43b3-4cbe-b67b-a229f29184d0 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:26.482866 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 152/307] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:04:26 2022] GET /identity/v3/users/83caa29619cd4a0dafefd7dabf62bda0 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:26.483719 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d8d0d-a6e1-4938-852c-cc3c1dac1dfb None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:26.487255 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:26.498104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 156/308] 10.222.0.79 () {60 vars in 1134 bytes} [Wed Aug 31 19:04:26 2022] POST /identity/v3/groups => generated 229 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:04:26.505010 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab6eaf-43b3-4cbe-b67b-a229f29184d0 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:26.616126 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d8d0d-a6e1-4938-852c-cc3c1dac1dfb None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:26.648794 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab6eaf-43b3-4cbe-b67b-a229f29184d0 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:26.656783 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207079a2-cd02-4dba-804c-26ef0c8d033e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:26.657771 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207079a2-cd02-4dba-804c-26ef0c8d033e None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:26.658296 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207079a2-cd02-4dba-804c-26ef0c8d033e None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:26.658835 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207079a2-cd02-4dba-804c-26ef0c8d033e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:26.659821 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207079a2-cd02-4dba-804c-26ef0c8d033e None admin] RBAC: Adding query filter params (role.id=35835d27c5d14dbbb20c5e3f646a40a9, user.id=e67262561a8a4291b26880f840675855, scope.system=all) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:26.660341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207079a2-cd02-4dba-804c-26ef0c8d033e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:26.661977 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207079a2-cd02-4dba-804c-26ef0c8d033e None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:26.668059 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 153/309] 10.222.0.79 () {56 vars in 1308 bytes} [Wed Aug 31 19:04:26 2022] GET /identity/v3/role_assignments?user.id=e67262561a8a4291b26880f840675855&scope.system=all&role.id=35835d27c5d14dbbb20c5e3f646a40a9 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:26.703326 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b712a-3db0-48a0-8af6-b5fdf2ed3f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:26.703920 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b712a-3db0-48a0-8af6-b5fdf2ed3f4c None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:26.704192 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b712a-3db0-48a0-8af6-b5fdf2ed3f4c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:26.704464 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b712a-3db0-48a0-8af6-b5fdf2ed3f4c None admin] PATH_INFO: `/v3/system/users/83caa29619cd4a0dafefd7dabf62bda0/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:26.707315 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b712a-3db0-48a0-8af6-b5fdf2ed3f4c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=83caa29619cd4a0dafefd7dabf62bda0, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:26.709086 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b712a-3db0-48a0-8af6-b5fdf2ed3f4c None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:26.720985 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 157/310] 10.222.0.79 () {58 vars in 1334 bytes} [Wed Aug 31 19:04:26 2022] PUT /identity/v3/system/users/83caa29619cd4a0dafefd7dabf62bda0/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:04:27.056378 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef20de-79b0-462c-9617-63304aa46a24 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:27.057317 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef20de-79b0-462c-9617-63304aa46a24 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:27.057817 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef20de-79b0-462c-9617-63304aa46a24 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:27.059424 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 154/311] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:27.066393 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c93848-fd36-49ba-b605-3b452571081d None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:27.067005 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c93848-fd36-49ba-b605-3b452571081d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:27.067649 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c93848-fd36-49ba-b605-3b452571081d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:27.086612 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-06c93848-fd36-49ba-b605-3b452571081d None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:27.088137 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-06c93848-fd36-49ba-b605-3b452571081d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:27.128201 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:27.164991 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 158/312] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:27.445936 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef20de-79b0-462c-9617-63304aa46a24 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:27.518951 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:27.561104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef20de-79b0-462c-9617-63304aa46a24 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:27.597468 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a9356-f881-4b12-98a1-f805bddac031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:27.598122 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a9356-f881-4b12-98a1-f805bddac031 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:27.598402 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a9356-f881-4b12-98a1-f805bddac031 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:27.598713 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a9356-f881-4b12-98a1-f805bddac031 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:27.611195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a9356-f881-4b12-98a1-f805bddac031 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:27.617875 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-dc9a9356-f881-4b12-98a1-f805bddac031 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:04:27.617875 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:27.617875 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:27.617875 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:27.617875 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:27.617875 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:27.617875 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:27.617875 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:27.617875 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:27.617875 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:27.617875 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:27.617875 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:27.617875 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:27.617875 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:27.617875 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:27.617875 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:27.618817 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:27.618817 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:27.618817 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:27.618817 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:27.618817 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:27.618817 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:27.618817 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:27.618817 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:27.618817 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:27.618817 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:27.618817 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:27.618817 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:27.618817 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:27.618817 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:27.618817 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:27.618817 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:27.620048 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:27.620048 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:27.620048 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:27.620048 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:27.620048 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:27.620048 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:27.620048 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:27.620048 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:27.620048 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:27.620048 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:27.620048 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:04:27.620048 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:04:27.620048 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 155/313] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:04:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:27.625299 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c93848-fd36-49ba-b605-3b452571081d None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:27.735286 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c93848-fd36-49ba-b605-3b452571081d None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:27.780884 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60884c49-c6c6-4955-8afa-fff58b35b3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:27.781506 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60884c49-c6c6-4955-8afa-fff58b35b3a5 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:27.781781 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60884c49-c6c6-4955-8afa-fff58b35b3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:27.782052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60884c49-c6c6-4955-8afa-fff58b35b3a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:27.782755 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60884c49-c6c6-4955-8afa-fff58b35b3a5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:27.783055 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60884c49-c6c6-4955-8afa-fff58b35b3a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:27.785020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60884c49-c6c6-4955-8afa-fff58b35b3a5 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:27.794755 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 159/314] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 19:04:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:27.800365 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a9356-f881-4b12-98a1-f805bddac031 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:27.914272 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a9356-f881-4b12-98a1-f805bddac031 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:27.942820 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:27.954256 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59502f26-1471-48f8-b834-a5765acb150a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:27.954962 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59502f26-1471-48f8-b834-a5765acb150a None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:27.957017 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59502f26-1471-48f8-b834-a5765acb150a None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:27.957017 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59502f26-1471-48f8-b834-a5765acb150a None admin] PATH_INFO: `/v3/users/42d42e9cdb114a21a44cd777f1fdb856` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:27.960929 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59502f26-1471-48f8-b834-a5765acb150a None admin] RBAC: Authorizing `identity:get_user(user_id=42d42e9cdb114a21a44cd777f1fdb856)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:27.960929 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59502f26-1471-48f8-b834-a5765acb150a None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:27.962677 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 156/315] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:04:27 2022] GET /identity/v3/users/42d42e9cdb114a21a44cd777f1fdb856 => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:27.967438 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60884c49-c6c6-4955-8afa-fff58b35b3a5 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:28.004879 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:28.083653 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60884c49-c6c6-4955-8afa-fff58b35b3a5 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:28.117831 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15a538-5d6c-4a96-ad96-b010a2603b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:28.118445 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15a538-5d6c-4a96-ad96-b010a2603b8f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:28.118745 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15a538-5d6c-4a96-ad96-b010a2603b8f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:28.119013 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15a538-5d6c-4a96-ad96-b010a2603b8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:28.191070 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae15a538-5d6c-4a96-ad96-b010a2603b8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:28.192554 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae15a538-5d6c-4a96-ad96-b010a2603b8f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:28.226798 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:28.305202 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 160/316] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:04:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:04:28.310705 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59502f26-1471-48f8-b834-a5765acb150a None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:28.426185 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59502f26-1471-48f8-b834-a5765acb150a None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:28.464096 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30b233-c176-4cdd-934b-68a324318209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:28.464796 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30b233-c176-4cdd-934b-68a324318209 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:28.465078 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30b233-c176-4cdd-934b-68a324318209 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:28.465457 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30b233-c176-4cdd-934b-68a324318209 None admin] PATH_INFO: `/v3/projects/3aa248dc3fd34facaa9b43a30893c924` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:28.466674 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a30b233-c176-4cdd-934b-68a324318209 None admin] RBAC: Authorizing `identity:get_project(project_id=3aa248dc3fd34facaa9b43a30893c924)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:28.468141 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a30b233-c176-4cdd-934b-68a324318209 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:28.470114 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 157/317] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:04:28 2022] GET /identity/v3/projects/3aa248dc3fd34facaa9b43a30893c924 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:28.476730 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15a538-5d6c-4a96-ad96-b010a2603b8f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:28.594416 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15a538-5d6c-4a96-ad96-b010a2603b8f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:28.630874 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6b796-7772-4ee3-a589-42af6fd2e5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:28.631543 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6b796-7772-4ee3-a589-42af6fd2e5f7 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:28.631824 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6b796-7772-4ee3-a589-42af6fd2e5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:28.632091 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6b796-7772-4ee3-a589-42af6fd2e5f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:28.632825 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6b796-7772-4ee3-a589-42af6fd2e5f7 None admin] RBAC: Adding query filter params (role.id=35835d27c5d14dbbb20c5e3f646a40a9, scope.project.id=3aa248dc3fd34facaa9b43a30893c924, user.id=42d42e9cdb114a21a44cd777f1fdb856) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:28.633130 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6b796-7772-4ee3-a589-42af6fd2e5f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:28.634600 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6b796-7772-4ee3-a589-42af6fd2e5f7 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:28.636484 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:28.642770 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 161/318] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:04:28 2022] GET /identity/v3/role_assignments?user.id=42d42e9cdb114a21a44cd777f1fdb856&scope.project.id=3aa248dc3fd34facaa9b43a30893c924&role.id=35835d27c5d14dbbb20c5e3f646a40a9 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:28.653368 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c0056-016f-4fa5-90a4-f7d72fd3f11a None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:28.653703 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c0056-016f-4fa5-90a4-f7d72fd3f11a None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:28.653980 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c0056-016f-4fa5-90a4-f7d72fd3f11a None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:28.655910 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 158/319] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:28.664362 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b20ada-50ff-47c1-9ec7-4cda392e3bd6 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:28.664884 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b20ada-50ff-47c1-9ec7-4cda392e3bd6 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:28.665327 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b20ada-50ff-47c1-9ec7-4cda392e3bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:28.670211 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402f302-eeea-44a4-a115-3761acc791c9 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:28.670522 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402f302-eeea-44a4-a115-3761acc791c9 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:28.670821 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402f302-eeea-44a4-a115-3761acc791c9 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:28.672184 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 159/320] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:04:28.678233 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393fc5f9-bdd9-4142-ad89-a76bb1c5c322 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:28.678553 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393fc5f9-bdd9-4142-ad89-a76bb1c5c322 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:28.678835 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393fc5f9-bdd9-4142-ad89-a76bb1c5c322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:28.686511 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-61b20ada-50ff-47c1-9ec7-4cda392e3bd6 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:28.687954 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-61b20ada-50ff-47c1-9ec7-4cda392e3bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:28.706261 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-393fc5f9-bdd9-4142-ad89-a76bb1c5c322 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:28.707733 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-393fc5f9-bdd9-4142-ad89-a76bb1c5c322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:28.794186 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 162/321] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:28.803346 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:28.813567 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6274f38-b90a-41be-8747-b0ddb4d72bab None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:28.813854 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6274f38-b90a-41be-8747-b0ddb4d72bab None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:28.814131 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6274f38-b90a-41be-8747-b0ddb4d72bab None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:28.818243 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 160/323] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:04:28.818575 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 163/323] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:04:28.826057 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b39a8-08a2-4f81-b159-58a4d12c1fca None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:28.826348 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b39a8-08a2-4f81-b159-58a4d12c1fca None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:28.826674 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b39a8-08a2-4f81-b159-58a4d12c1fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:28.845980 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-958b39a8-08a2-4f81-b159-58a4d12c1fca None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:28.847678 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-958b39a8-08a2-4f81-b159-58a4d12c1fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:28.926022 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 161/324] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:29.064171 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6274f38-b90a-41be-8747-b0ddb4d72bab None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:29.085663 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b39a8-08a2-4f81-b159-58a4d12c1fca None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:29.176351 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6274f38-b90a-41be-8747-b0ddb4d72bab None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:29.206882 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b39a8-08a2-4f81-b159-58a4d12c1fca None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:29.209820 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:29.219260 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c0ee2-8481-47b7-b03c-8d04fef2eb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:29.219909 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c0ee2-8481-47b7-b03c-8d04fef2eb16 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:29.220187 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c0ee2-8481-47b7-b03c-8d04fef2eb16 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:29.220458 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c0ee2-8481-47b7-b03c-8d04fef2eb16 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:29.221612 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c0ee2-8481-47b7-b03c-8d04fef2eb16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:29.223078 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c0ee2-8481-47b7-b03c-8d04fef2eb16 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:29.224663 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 164/325] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:04:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:29.225419 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c0ee2-8481-47b7-b03c-8d04fef2eb16 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:29.232468 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:29.244926 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d15060-c0e8-49c8-963e-9a869a0a1b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:29.245562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d15060-c0e8-49c8-963e-9a869a0a1b2c None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:29.245847 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d15060-c0e8-49c8-963e-9a869a0a1b2c None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:29.246102 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d15060-c0e8-49c8-963e-9a869a0a1b2c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:29.256782 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d15060-c0e8-49c8-963e-9a869a0a1b2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:29.261618 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-c1d15060-c0e8-49c8-963e-9a869a0a1b2c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:04:29.261618 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:29.261618 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:29.261618 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:29.261618 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:29.261618 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:29.261618 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:29.261618 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:29.261618 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:29.261618 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:29.261618 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:29.261618 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:29.261618 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:29.261618 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:29.261618 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:29.261618 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:29.262584 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:29.262584 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:29.262584 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:29.262584 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:29.262584 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:29.262584 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:29.262584 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:29.262584 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:29.262584 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:29.262584 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:29.262584 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:29.262584 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:29.262584 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:29.262584 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:29.262584 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:29.262584 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:29.263381 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:29.263381 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:29.263381 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:29.263381 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:29.263381 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:29.263381 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:29.263381 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:29.263381 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:29.263381 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:29.263381 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:29.263381 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:04:29.263381 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:04:29.263381 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 162/326] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:04:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:04:29.264048 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d15060-c0e8-49c8-963e-9a869a0a1b2c None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:29.334910 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c0ee2-8481-47b7-b03c-8d04fef2eb16 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:29.371540 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d15060-c0e8-49c8-963e-9a869a0a1b2c None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:29.373211 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa95268-1c99-4b71-aded-0b0cee6e6c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:29.373888 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa95268-1c99-4b71-aded-0b0cee6e6c3d None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:29.374212 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa95268-1c99-4b71-aded-0b0cee6e6c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:29.374504 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa95268-1c99-4b71-aded-0b0cee6e6c3d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:29.385798 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa95268-1c99-4b71-aded-0b0cee6e6c3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:29.391223 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-5fa95268-1c99-4b71-aded-0b0cee6e6c3d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:04:29.391223 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:29.391223 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:29.391223 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:29.391223 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:29.391223 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:29.391223 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:29.391223 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:29.391223 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:29.391223 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:29.391223 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:29.391223 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:29.391223 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:29.391223 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:29.391223 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:29.391223 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:29.395106 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:29.395106 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:29.395106 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:29.395106 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:29.395106 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:29.395106 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:29.395106 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:29.395106 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:29.395106 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:29.395106 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:29.395106 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:29.395106 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:29.395106 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:29.395106 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:29.395106 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:29.395106 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:29.396715 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:29.396715 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:29.396715 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:29.396715 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:29.396715 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:29.396715 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:29.396715 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:29.396715 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:29.396715 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:29.396715 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:29.396715 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:04:29.396715 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:04:29.396715 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 165/327] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:04:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:29.396715 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa95268-1c99-4b71-aded-0b0cee6e6c3d None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:29.415354 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df962972-7a9e-4c65-a355-2d65506c27ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:29.416007 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df962972-7a9e-4c65-a355-2d65506c27ba None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:29.416310 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df962972-7a9e-4c65-a355-2d65506c27ba None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:29.416583 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df962972-7a9e-4c65-a355-2d65506c27ba None admin] PATH_INFO: `/v3/groups` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:29.417251 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df962972-7a9e-4c65-a355-2d65506c27ba None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:29.418884 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df962972-7a9e-4c65-a355-2d65506c27ba None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:29.436298 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 163/328] 10.222.0.79 () {60 vars in 1134 bytes} [Wed Aug 31 19:04:29 2022] POST /identity/v3/groups => generated 226 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:04:29.437056 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df962972-7a9e-4c65-a355-2d65506c27ba None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:29.472595 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:29.488797 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:29.536777 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa95268-1c99-4b71-aded-0b0cee6e6c3d None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:29.569377 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df962972-7a9e-4c65-a355-2d65506c27ba None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:29.586404 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b45bb0-08ef-4bde-a0ac-d96148200c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:29.586672 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b45bb0-08ef-4bde-a0ac-d96148200c9d None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:29.586944 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b45bb0-08ef-4bde-a0ac-d96148200c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:29.587212 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b45bb0-08ef-4bde-a0ac-d96148200c9d None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:29.588313 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b45bb0-08ef-4bde-a0ac-d96148200c9d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:29.588621 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b45bb0-08ef-4bde-a0ac-d96148200c9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:29.590999 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b45bb0-08ef-4bde-a0ac-d96148200c9d None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:29.604277 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 166/329] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 19:04:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:29.612447 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b45bb0-08ef-4bde-a0ac-d96148200c9d None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:29.622791 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1fe689-6034-4748-a5b3-36215d32206c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:29.623356 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1fe689-6034-4748-a5b3-36215d32206c None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:29.623634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1fe689-6034-4748-a5b3-36215d32206c None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:29.623930 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1fe689-6034-4748-a5b3-36215d32206c None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:29.624559 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1fe689-6034-4748-a5b3-36215d32206c None admin] RBAC: Adding query filter params (name=member) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:29.625534 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1fe689-6034-4748-a5b3-36215d32206c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:29.629546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1fe689-6034-4748-a5b3-36215d32206c None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:29.639492 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 164/330] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 19:04:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:29.645004 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1fe689-6034-4748-a5b3-36215d32206c None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:29.760953 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b45bb0-08ef-4bde-a0ac-d96148200c9d None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:29.776749 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1fe689-6034-4748-a5b3-36215d32206c None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:29.781624 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:29.783355 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:29.816477 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117f5d6-9f4f-47c0-aa58-c640da69aa32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:29.818205 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117f5d6-9f4f-47c0-aa58-c640da69aa32 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:29.818862 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117f5d6-9f4f-47c0-aa58-c640da69aa32 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:29.819144 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117f5d6-9f4f-47c0-aa58-c640da69aa32 None admin] PATH_INFO: `/v3/users/e67262561a8a4291b26880f840675855` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:29.821053 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6117f5d6-9f4f-47c0-aa58-c640da69aa32 None admin] RBAC: Authorizing `identity:get_user(user_id=e67262561a8a4291b26880f840675855)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:29.823754 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6117f5d6-9f4f-47c0-aa58-c640da69aa32 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:29.826655 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 167/331] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:04:29 2022] GET /identity/v3/users/e67262561a8a4291b26880f840675855 => generated 293 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:29.834009 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117f5d6-9f4f-47c0-aa58-c640da69aa32 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:29.841977 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698248d-baac-4eb6-8668-0d08dcd043c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:29.843012 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698248d-baac-4eb6-8668-0d08dcd043c4 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:29.843457 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698248d-baac-4eb6-8668-0d08dcd043c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:29.843894 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698248d-baac-4eb6-8668-0d08dcd043c4 None admin] PATH_INFO: `/v3/users/83caa29619cd4a0dafefd7dabf62bda0` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:29.845693 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a698248d-baac-4eb6-8668-0d08dcd043c4 None admin] RBAC: Authorizing `identity:get_user(user_id=83caa29619cd4a0dafefd7dabf62bda0)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:29.848830 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a698248d-baac-4eb6-8668-0d08dcd043c4 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:29.853455 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 165/332] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:04:29 2022] GET /identity/v3/users/83caa29619cd4a0dafefd7dabf62bda0 => generated 293 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:04:29.861082 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698248d-baac-4eb6-8668-0d08dcd043c4 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:29.996986 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117f5d6-9f4f-47c0-aa58-c640da69aa32 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:30.012879 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698248d-baac-4eb6-8668-0d08dcd043c4 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:30.047336 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669a026-40fb-442b-9085-28fdd8291c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:30.047998 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669a026-40fb-442b-9085-28fdd8291c38 None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:30.048274 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669a026-40fb-442b-9085-28fdd8291c38 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:30.048547 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669a026-40fb-442b-9085-28fdd8291c38 None admin] PATH_INFO: `/v3/system/users/e67262561a8a4291b26880f840675855/roles/35835d27c5d14dbbb20c5e3f646a40a9` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:30.052247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669a026-40fb-442b-9085-28fdd8291c38 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e67262561a8a4291b26880f840675855, role_id=35835d27c5d14dbbb20c5e3f646a40a9)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:30.054099 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669a026-40fb-442b-9085-28fdd8291c38 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:30.064953 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 168/333] 10.222.0.79 () {58 vars in 1334 bytes} [Wed Aug 31 19:04:29 2022] PUT /identity/v3/system/users/e67262561a8a4291b26880f840675855/roles/35835d27c5d14dbbb20c5e3f646a40a9 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:04:30.080129 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de70d0-dda2-4b1c-89db-400af1b3d15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:30.081274 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de70d0-dda2-4b1c-89db-400af1b3d15d None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:30.081796 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de70d0-dda2-4b1c-89db-400af1b3d15d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:30.082294 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de70d0-dda2-4b1c-89db-400af1b3d15d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:30.083372 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de70d0-dda2-4b1c-89db-400af1b3d15d None admin] RBAC: Adding query filter params (role.id=27c44f922df34ac6bcb3794b111cb3da, user.id=83caa29619cd4a0dafefd7dabf62bda0, scope.system=all) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:30.083912 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de70d0-dda2-4b1c-89db-400af1b3d15d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:30.085641 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de70d0-dda2-4b1c-89db-400af1b3d15d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:30.106589 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 166/334] 10.222.0.79 () {56 vars in 1308 bytes} [Wed Aug 31 19:04:29 2022] GET /identity/v3/role_assignments?user.id=83caa29619cd4a0dafefd7dabf62bda0&scope.system=all&role.id=27c44f922df34ac6bcb3794b111cb3da => generated 510 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:04:31.672755 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21aea3-bb41-42a3-8e57-667f8a63f94d None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:31.673753 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21aea3-bb41-42a3-8e57-667f8a63f94d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:31.674816 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21aea3-bb41-42a3-8e57-667f8a63f94d None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:31.676618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 169/335] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:31.683477 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34722b3e-29b9-4ce7-8c80-fcf83a1fd178 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:31.684405 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34722b3e-29b9-4ce7-8c80-fcf83a1fd178 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:31.684949 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34722b3e-29b9-4ce7-8c80-fcf83a1fd178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:31.710448 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-34722b3e-29b9-4ce7-8c80-fcf83a1fd178 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:31.712016 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-34722b3e-29b9-4ce7-8c80-fcf83a1fd178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:31.743871 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:31.795957 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 167/336] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:32.267085 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a369e-bc79-4615-96b5-1222f6556ff8 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:32.267417 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a369e-bc79-4615-96b5-1222f6556ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:32.267632 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a369e-bc79-4615-96b5-1222f6556ff8 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:32.269307 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 170/337] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:32.274393 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cd952-a3ca-4422-a199-efc711af01f0 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:32.274774 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cd952-a3ca-4422-a199-efc711af01f0 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:32.274984 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cd952-a3ca-4422-a199-efc711af01f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:32.298120 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-d77cd952-a3ca-4422-a199-efc711af01f0 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:32.299935 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d77cd952-a3ca-4422-a199-efc711af01f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:32.328476 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a369e-bc79-4615-96b5-1222f6556ff8 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:32.416018 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 168/338] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:32.431093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:32.517636 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a369e-bc79-4615-96b5-1222f6556ff8 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:32.567787 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f727eb-b625-441c-aaf6-334408dfcec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:32.568444 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f727eb-b625-441c-aaf6-334408dfcec0 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:32.568728 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f727eb-b625-441c-aaf6-334408dfcec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:32.569006 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f727eb-b625-441c-aaf6-334408dfcec0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:32.589704 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f727eb-b625-441c-aaf6-334408dfcec0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:32.595352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-c0f727eb-b625-441c-aaf6-334408dfcec0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:04:32.595352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:32.595352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:32.595352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:32.595352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:32.595352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:32.595352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:32.595352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:32.595352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:32.595352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:32.595352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:32.595352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:32.595352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:32.595352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:32.595352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:32.595352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:32.596824 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:32.596824 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:32.596824 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:32.596824 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:32.596824 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:32.596824 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:32.596824 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:32.596824 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:32.596824 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:32.596824 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:32.596824 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:32.596824 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:32.596824 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:32.596824 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:32.596824 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:32.596824 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:32.597827 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:32.597827 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:32.597827 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:32.597827 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:32.597827 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:32.597827 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:32.597827 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:32.597827 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:32.597827 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:32.597827 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:32.597827 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:04:32.597827 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:04:32.598429 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 171/339] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:04:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:32.603038 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841c914-f67b-4ba8-af92-368f09941392 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:32.603339 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f727eb-b625-441c-aaf6-334408dfcec0 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:32.603444 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841c914-f67b-4ba8-af92-368f09941392 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:32.603563 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841c914-f67b-4ba8-af92-368f09941392 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:32.605208 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 169/340] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:32.611679 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270abb0-a622-4da9-a4c2-c10f5ad1d126 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:32.612576 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270abb0-a622-4da9-a4c2-c10f5ad1d126 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:32.612845 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270abb0-a622-4da9-a4c2-c10f5ad1d126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:32.649217 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-f270abb0-a622-4da9-a4c2-c10f5ad1d126 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:32.651351 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f270abb0-a622-4da9-a4c2-c10f5ad1d126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:32.767334 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 170/341] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:32.769298 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b1679-7653-4ca5-87cb-a309c3210597 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:32.769520 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b1679-7653-4ca5-87cb-a309c3210597 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:32.769787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b1679-7653-4ca5-87cb-a309c3210597 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:32.775370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 171/342] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:32.781871 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa07617-84a0-45b4-a9d1-7898367b8732 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:32.782259 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa07617-84a0-45b4-a9d1-7898367b8732 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:32.782449 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa07617-84a0-45b4-a9d1-7898367b8732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:32.809815 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-1aa07617-84a0-45b4-a9d1-7898367b8732 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:32.811193 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1aa07617-84a0-45b4-a9d1-7898367b8732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:32.818570 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f727eb-b625-441c-aaf6-334408dfcec0 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:32.833044 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:32.842683 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:32.890060 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2bd05f-de58-4bdb-b037-6af50a94468f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:32.891197 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2bd05f-de58-4bdb-b037-6af50a94468f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:32.891702 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2bd05f-de58-4bdb-b037-6af50a94468f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:32.892179 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2bd05f-de58-4bdb-b037-6af50a94468f None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:32.893087 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2bd05f-de58-4bdb-b037-6af50a94468f None admin] RBAC: Adding query filter params (name=member) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:32.893589 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2bd05f-de58-4bdb-b037-6af50a94468f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:32.895383 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2bd05f-de58-4bdb-b037-6af50a94468f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:32.912880 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 172/343] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 19:04:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:04:32.914058 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2bd05f-de58-4bdb-b037-6af50a94468f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:32.914606 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 172/344] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:04:32.919925 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa07617-84a0-45b4-a9d1-7898367b8732 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:33.034596 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa07617-84a0-45b4-a9d1-7898367b8732 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:33.071113 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f6dff-0da3-40f3-aba9-ff17363b774b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:33.071972 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f6dff-0da3-40f3-aba9-ff17363b774b None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:33.072441 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f6dff-0da3-40f3-aba9-ff17363b774b None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:33.072886 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f6dff-0da3-40f3-aba9-ff17363b774b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:33.093964 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:33.103410 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2bd05f-de58-4bdb-b037-6af50a94468f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:33.158503 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f6dff-0da3-40f3-aba9-ff17363b774b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:33.158503 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f6dff-0da3-40f3-aba9-ff17363b774b None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:33.166794 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f292676-c552-4e58-8a8c-41e59e5bf51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:33.167876 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f292676-c552-4e58-8a8c-41e59e5bf51c None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:33.168349 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f292676-c552-4e58-8a8c-41e59e5bf51c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:33.168887 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f292676-c552-4e58-8a8c-41e59e5bf51c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:33.188736 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f292676-c552-4e58-8a8c-41e59e5bf51c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:33.194784 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-8f292676-c552-4e58-8a8c-41e59e5bf51c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:04:33.194784 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:33.194784 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:33.194784 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:33.194784 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:33.194784 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:33.194784 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:33.194784 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:33.194784 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:33.194784 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:33.194784 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:33.194784 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:33.194784 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:33.194784 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:33.194784 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:33.194784 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:33.195680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:33.195680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:33.195680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:33.195680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:33.195680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:33.195680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:33.195680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:33.195680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:33.195680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:33.195680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:33.195680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:33.195680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:33.195680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:33.195680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:33.195680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:33.195680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:33.196465 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:33.196465 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:33.196465 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:33.196465 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:33.196465 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:33.196465 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:33.196465 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:33.196465 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:33.196465 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:33.196465 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:33.196465 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 19:04:33.196465 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:04:33.202363 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 173/345] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:04:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:33.203514 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f292676-c552-4e58-8a8c-41e59e5bf51c None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:33.244348 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:33.271311 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 173/346] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:04:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:04:33.272280 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f6dff-0da3-40f3-aba9-ff17363b774b None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:33.325042 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:33.336975 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f292676-c552-4e58-8a8c-41e59e5bf51c None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:33.380646 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f2042-667f-4d76-8d4b-6257de41b133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:33.381870 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f2042-667f-4d76-8d4b-6257de41b133 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:33.382326 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f2042-667f-4d76-8d4b-6257de41b133 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:33.382787 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f2042-667f-4d76-8d4b-6257de41b133 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:33.385304 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f6dff-0da3-40f3-aba9-ff17363b774b None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:33.401321 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f2042-667f-4d76-8d4b-6257de41b133 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:33.413233 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-9f4f2042-667f-4d76-8d4b-6257de41b133 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:04:33.413233 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:33.413233 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:33.413233 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:33.413233 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:33.413233 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:33.413233 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:33.413233 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:33.413233 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:33.413233 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:33.413233 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:33.413233 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:33.413233 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:33.413233 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:33.413233 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:33.413233 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:33.414195 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:33.414195 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:33.414195 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:33.414195 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:33.414195 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:33.414195 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:33.414195 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:33.414195 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:33.414195 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:33.414195 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:33.414195 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:33.414195 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:33.414195 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:33.414195 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:33.414195 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:33.414195 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:33.415140 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:33.415140 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:33.415140 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:33.415140 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:33.415140 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:33.415140 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:33.415140 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:33.415140 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:33.415140 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:33.415140 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:33.415140 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:04:33.415140 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:04:33.417311 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 174/347] 10.222.0.79 () {56 vars in 1114 bytes} [Wed Aug 31 19:04:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:33.418650 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f2042-667f-4d76-8d4b-6257de41b133 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:33.424272 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572662d-aab8-472a-bb4e-2a45fc1139e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:33.425537 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572662d-aab8-472a-bb4e-2a45fc1139e1 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:33.425953 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572662d-aab8-472a-bb4e-2a45fc1139e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:33.426322 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572662d-aab8-472a-bb4e-2a45fc1139e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:33.427106 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d572662d-aab8-472a-bb4e-2a45fc1139e1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:33.427519 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d572662d-aab8-472a-bb4e-2a45fc1139e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:33.429023 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d572662d-aab8-472a-bb4e-2a45fc1139e1 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:33.441351 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 174/348] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 19:04:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:33.442515 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572662d-aab8-472a-bb4e-2a45fc1139e1 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:33.528831 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:33.541478 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f2042-667f-4d76-8d4b-6257de41b133 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:33.551569 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572662d-aab8-472a-bb4e-2a45fc1139e1 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:33.565587 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:33.591544 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5beeb-5e28-456b-a408-ac877946227c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:33.592630 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5beeb-5e28-456b-a408-ac877946227c None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:33.593055 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5beeb-5e28-456b-a408-ac877946227c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:33.593273 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f61ce6-cad6-47a0-8d59-088090bee463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:33.593713 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5beeb-5e28-456b-a408-ac877946227c None admin] PATH_INFO: `/v3/projects/898cfe9ce73e43bc84af8abd019b8d31` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:33.594107 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f61ce6-cad6-47a0-8d59-088090bee463 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:33.594519 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f61ce6-cad6-47a0-8d59-088090bee463 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:33.594943 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f61ce6-cad6-47a0-8d59-088090bee463 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:33.595517 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc5beeb-5e28-456b-a408-ac877946227c None admin] RBAC: Authorizing `identity:get_project(project_id=898cfe9ce73e43bc84af8abd019b8d31)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:33.595774 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f61ce6-cad6-47a0-8d59-088090bee463 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:33.596704 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f61ce6-cad6-47a0-8d59-088090bee463 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:33.598166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f61ce6-cad6-47a0-8d59-088090bee463 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:33.598391 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc5beeb-5e28-456b-a408-ac877946227c None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:33.600642 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 175/349] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:04:33 2022] GET /identity/v3/projects/898cfe9ce73e43bc84af8abd019b8d31 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:33.601734 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5beeb-5e28-456b-a408-ac877946227c None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:33.608588 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 175/350] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:04:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:33.609550 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f61ce6-cad6-47a0-8d59-088090bee463 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:33.720650 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f61ce6-cad6-47a0-8d59-088090bee463 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:33.727817 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5beeb-5e28-456b-a408-ac877946227c None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:33.758013 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23e6ee-9a56-4458-a4ba-642af3ce5910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:33.758786 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23e6ee-9a56-4458-a4ba-642af3ce5910 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:33.759181 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23e6ee-9a56-4458-a4ba-642af3ce5910 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:33.759585 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23e6ee-9a56-4458-a4ba-642af3ce5910 None admin] PATH_INFO: `/v3/groups/b8dbc32e324c4c1f896f3b8d32ff616e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:33.766252 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23e6ee-9a56-4458-a4ba-642af3ce5910 None admin] RBAC: Authorizing `identity:get_group(group_id=b8dbc32e324c4c1f896f3b8d32ff616e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:33.768522 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23e6ee-9a56-4458-a4ba-642af3ce5910 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:33.773916 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 176/351] 10.222.0.79 () {56 vars in 1180 bytes} [Wed Aug 31 19:04:33 2022] GET /identity/v3/groups/b8dbc32e324c4c1f896f3b8d32ff616e => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:33.773916 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23e6ee-9a56-4458-a4ba-642af3ce5910 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:33.775190 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a7d93-c795-4afd-be31-b26ebde64a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:33.776037 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a7d93-c795-4afd-be31-b26ebde64a6e None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:33.776598 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a7d93-c795-4afd-be31-b26ebde64a6e None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:33.777069 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a7d93-c795-4afd-be31-b26ebde64a6e None admin] PATH_INFO: `/v3/users/e67262561a8a4291b26880f840675855` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:33.779151 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a7d93-c795-4afd-be31-b26ebde64a6e None admin] RBAC: Authorizing `identity:get_user(user_id=e67262561a8a4291b26880f840675855)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:33.780891 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a7d93-c795-4afd-be31-b26ebde64a6e None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:33.782908 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 176/352] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:04:33 2022] GET /identity/v3/users/e67262561a8a4291b26880f840675855 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:33.784525 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a7d93-c795-4afd-be31-b26ebde64a6e None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:33.816847 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:33.820962 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:33.884128 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23e6ee-9a56-4458-a4ba-642af3ce5910 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:33.909969 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a7d93-c795-4afd-be31-b26ebde64a6e None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:33.922286 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a11b18-585f-461d-a78b-5d20f1527edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:33.923041 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a11b18-585f-461d-a78b-5d20f1527edf None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:33.923384 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a11b18-585f-461d-a78b-5d20f1527edf None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:33.923980 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a11b18-585f-461d-a78b-5d20f1527edf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:33.935215 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a11b18-585f-461d-a78b-5d20f1527edf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:33.941015 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-01a11b18-585f-461d-a78b-5d20f1527edf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:04:33.941015 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:33.941015 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:33.941015 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:33.941015 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:33.941015 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:33.941015 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:33.941015 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:33.941015 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:33.941015 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:33.941015 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:33.941015 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:33.941015 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:33.941015 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:33.941015 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:33.941015 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:33.942000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:33.942000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:33.942000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:33.942000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:33.942000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:33.942000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:33.942000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:33.942000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:33.942000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:33.942000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:33.942000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:33.942000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:33.942000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:33.942000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:33.942000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:33.942000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:33.942899 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:33.942899 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:33.942899 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:33.942899 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:33.942899 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:33.942899 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:33.942899 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:33.942899 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:33.942899 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:33.942899 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:33.942899 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:04:33.942899 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:04:33.943495 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 177/353] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:04:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:33.944785 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a11b18-585f-461d-a78b-5d20f1527edf None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:33.956371 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406cf60-19c9-4e5f-af28-771b659599af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:33.957416 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406cf60-19c9-4e5f-af28-771b659599af None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:33.957841 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406cf60-19c9-4e5f-af28-771b659599af None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:33.958252 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406cf60-19c9-4e5f-af28-771b659599af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:34.037873 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406cf60-19c9-4e5f-af28-771b659599af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:34.039762 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406cf60-19c9-4e5f-af28-771b659599af None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:34.071302 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:34.076449 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:34.080695 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a11b18-585f-461d-a78b-5d20f1527edf None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:34.122079 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62655ba6-df2e-4c5f-b964-90d2409b681e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:34.123008 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62655ba6-df2e-4c5f-b964-90d2409b681e None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:34.123389 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62655ba6-df2e-4c5f-b964-90d2409b681e None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:34.123764 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62655ba6-df2e-4c5f-b964-90d2409b681e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:34.124719 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62655ba6-df2e-4c5f-b964-90d2409b681e None admin] RBAC: Adding query filter params (group.id=b8dbc32e324c4c1f896f3b8d32ff616e, role.id=27c44f922df34ac6bcb3794b111cb3da, scope.project.id=898cfe9ce73e43bc84af8abd019b8d31) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:34.125023 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62655ba6-df2e-4c5f-b964-90d2409b681e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:34.127032 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62655ba6-df2e-4c5f-b964-90d2409b681e None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:34.133775 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 178/354] 10.222.0.79 () {56 vars in 1376 bytes} [Wed Aug 31 19:04:33 2022] GET /identity/v3/role_assignments?group.id=b8dbc32e324c4c1f896f3b8d32ff616e&scope.project.id=898cfe9ce73e43bc84af8abd019b8d31&role.id=27c44f922df34ac6bcb3794b111cb3da => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:34.134908 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62655ba6-df2e-4c5f-b964-90d2409b681e None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:34.211655 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 177/355] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:04:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:04:34.212549 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406cf60-19c9-4e5f-af28-771b659599af None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:34.270553 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62655ba6-df2e-4c5f-b964-90d2409b681e None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:34.323132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba18bd-6da7-4bfa-b7fe-0cc08754e5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:34.323364 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba18bd-6da7-4bfa-b7fe-0cc08754e5f3 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:34.324397 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba18bd-6da7-4bfa-b7fe-0cc08754e5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:34.324934 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba18bd-6da7-4bfa-b7fe-0cc08754e5f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:34.325586 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba18bd-6da7-4bfa-b7fe-0cc08754e5f3 None admin] RBAC: Adding query filter params (role.id=35835d27c5d14dbbb20c5e3f646a40a9, user.id=e67262561a8a4291b26880f840675855, scope.system=all) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:34.325926 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba18bd-6da7-4bfa-b7fe-0cc08754e5f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:34.327408 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba18bd-6da7-4bfa-b7fe-0cc08754e5f3 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:34.344275 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 179/356] 10.222.0.79 () {56 vars in 1308 bytes} [Wed Aug 31 19:04:34 2022] GET /identity/v3/role_assignments?user.id=e67262561a8a4291b26880f840675855&scope.system=all&role.id=35835d27c5d14dbbb20c5e3f646a40a9 => generated 510 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:34.345664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0aca5-3ac0-473d-87fb-0ef4033aad82 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:34.345981 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0aca5-3ac0-473d-87fb-0ef4033aad82 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:34.346794 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0aca5-3ac0-473d-87fb-0ef4033aad82 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:34.348502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 180/357] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:34.349108 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0aca5-3ac0-473d-87fb-0ef4033aad82 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:34.379918 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406cf60-19c9-4e5f-af28-771b659599af None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:34.380691 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:34.437382 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:34.455221 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa2779-a280-4dfd-9581-006dafe593db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:34.456388 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa2779-a280-4dfd-9581-006dafe593db None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:34.456671 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa2779-a280-4dfd-9581-006dafe593db None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:34.456944 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa2779-a280-4dfd-9581-006dafe593db None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:34.457622 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaa2779-a280-4dfd-9581-006dafe593db None admin] RBAC: Adding query filter params (name=member) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:34.457922 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaa2779-a280-4dfd-9581-006dafe593db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:34.459534 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaa2779-a280-4dfd-9581-006dafe593db None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:34.478975 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 178/358] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 19:04:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:34.480517 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aecd42-5ee4-4a2d-b01f-4f3b99da622d None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:34.480804 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aecd42-5ee4-4a2d-b01f-4f3b99da622d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:34.481079 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aecd42-5ee4-4a2d-b01f-4f3b99da622d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:34.492311 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0aca5-3ac0-473d-87fb-0ef4033aad82 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:34.517351 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-07aecd42-5ee4-4a2d-b01f-4f3b99da622d None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:34.519399 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-07aecd42-5ee4-4a2d-b01f-4f3b99da622d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:34.536919 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ab73f-e633-4837-94c6-98ceb0ba24ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:34.537583 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ab73f-e633-4837-94c6-98ceb0ba24ec None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:34.537858 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ab73f-e633-4837-94c6-98ceb0ba24ec None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:34.538121 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ab73f-e633-4837-94c6-98ceb0ba24ec None admin] PATH_INFO: `/v3/projects/898cfe9ce73e43bc84af8abd019b8d31` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:34.539352 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ab73f-e633-4837-94c6-98ceb0ba24ec None admin] RBAC: Authorizing `identity:get_project(project_id=898cfe9ce73e43bc84af8abd019b8d31)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:34.541126 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ab73f-e633-4837-94c6-98ceb0ba24ec None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:34.542692 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 181/359] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:04:34 2022] GET /identity/v3/projects/898cfe9ce73e43bc84af8abd019b8d31 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:34.543480 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ab73f-e633-4837-94c6-98ceb0ba24ec None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:34.648396 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 179/360] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:34.649870 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310222e-3585-458d-b81e-ea65837fa740 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:34.650205 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310222e-3585-458d-b81e-ea65837fa740 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:34.650518 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310222e-3585-458d-b81e-ea65837fa740 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:34.651998 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 180/361] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:34.652585 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310222e-3585-458d-b81e-ea65837fa740 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:34.683537 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:34.704774 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ab73f-e633-4837-94c6-98ceb0ba24ec None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:34.758852 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953515fc-821d-4f0f-ab9b-4d44b94b04f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:34.759730 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953515fc-821d-4f0f-ab9b-4d44b94b04f0 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:34.761018 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953515fc-821d-4f0f-ab9b-4d44b94b04f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:34.761305 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953515fc-821d-4f0f-ab9b-4d44b94b04f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:34.801815 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310222e-3585-458d-b81e-ea65837fa740 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:34.829106 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:34.847917 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6536be1-47a8-47a4-b9f9-7fa6505363bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:34.848561 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6536be1-47a8-47a4-b9f9-7fa6505363bf None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:34.848834 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6536be1-47a8-47a4-b9f9-7fa6505363bf None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:34.849109 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6536be1-47a8-47a4-b9f9-7fa6505363bf None admin] PATH_INFO: `/v3/groups/b8dbc32e324c4c1f896f3b8d32ff616e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:34.850583 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6536be1-47a8-47a4-b9f9-7fa6505363bf None admin] RBAC: Authorizing `identity:get_group(group_id=b8dbc32e324c4c1f896f3b8d32ff616e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:34.852351 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6536be1-47a8-47a4-b9f9-7fa6505363bf None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:34.854432 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 181/362] 10.222.0.79 () {56 vars in 1180 bytes} [Wed Aug 31 19:04:34 2022] GET /identity/v3/groups/b8dbc32e324c4c1f896f3b8d32ff616e => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:34.855918 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ae8b5-bf5d-4076-a022-b2556f715776 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:34.856205 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ae8b5-bf5d-4076-a022-b2556f715776 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:34.856479 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ae8b5-bf5d-4076-a022-b2556f715776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:34.863689 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953515fc-821d-4f0f-ab9b-4d44b94b04f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:34.865202 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953515fc-821d-4f0f-ab9b-4d44b94b04f0 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:34.876910 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-c52ae8b5-bf5d-4076-a022-b2556f715776 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:34.878579 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c52ae8b5-bf5d-4076-a022-b2556f715776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:34.957106 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 182/363] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:34.957901 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ae8b5-bf5d-4076-a022-b2556f715776 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:34.960330 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:34.975399 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 182/364] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:04:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:04:34.981847 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953515fc-821d-4f0f-ab9b-4d44b94b04f0 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:35.078336 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ae8b5-bf5d-4076-a022-b2556f715776 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:35.099093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:35.113068 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953515fc-821d-4f0f-ab9b-4d44b94b04f0 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:35.121115 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa56743-537d-4db0-9eb2-6b13cc63e3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:35.121737 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa56743-537d-4db0-9eb2-6b13cc63e3a9 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:35.122135 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa56743-537d-4db0-9eb2-6b13cc63e3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:35.122413 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa56743-537d-4db0-9eb2-6b13cc63e3a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:35.123180 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa56743-537d-4db0-9eb2-6b13cc63e3a9 None admin] RBAC: Adding query filter params (group.id=b8dbc32e324c4c1f896f3b8d32ff616e, role.id=d01cf7e1efe04d8c8f8d09667717555c, scope.project.id=898cfe9ce73e43bc84af8abd019b8d31) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:35.123490 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa56743-537d-4db0-9eb2-6b13cc63e3a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:35.125069 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa56743-537d-4db0-9eb2-6b13cc63e3a9 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:35.131504 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 183/365] 10.222.0.79 () {56 vars in 1376 bytes} [Wed Aug 31 19:04:34 2022] GET /identity/v3/role_assignments?group.id=b8dbc32e324c4c1f896f3b8d32ff616e&scope.project.id=898cfe9ce73e43bc84af8abd019b8d31&role.id=d01cf7e1efe04d8c8f8d09667717555c => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:35.132426 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa56743-537d-4db0-9eb2-6b13cc63e3a9 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:35.151115 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652af227-2778-4d69-b3df-97321f78c36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:35.152035 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652af227-2778-4d69-b3df-97321f78c36e None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:35.152451 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652af227-2778-4d69-b3df-97321f78c36e None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:35.152859 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652af227-2778-4d69-b3df-97321f78c36e None admin] PATH_INFO: `/v3/projects/3aa248dc3fd34facaa9b43a30893c924` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:35.154372 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652af227-2778-4d69-b3df-97321f78c36e None admin] RBAC: Authorizing `identity:get_project(project_id=3aa248dc3fd34facaa9b43a30893c924)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:35.156861 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652af227-2778-4d69-b3df-97321f78c36e None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:35.159597 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 183/366] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:04:34 2022] GET /identity/v3/projects/3aa248dc3fd34facaa9b43a30893c924 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:04:35.165172 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652af227-2778-4d69-b3df-97321f78c36e None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:35.230515 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:35.261471 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa56743-537d-4db0-9eb2-6b13cc63e3a9 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:35.305159 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3498ed-5e95-49d4-8c56-c0f394f3491a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:35.306101 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3498ed-5e95-49d4-8c56-c0f394f3491a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:35.306386 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3498ed-5e95-49d4-8c56-c0f394f3491a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:35.306705 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3498ed-5e95-49d4-8c56-c0f394f3491a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:35.320601 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3498ed-5e95-49d4-8c56-c0f394f3491a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:35.327294 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-fc3498ed-5e95-49d4-8c56-c0f394f3491a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:04:35.327294 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:35.327294 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:35.327294 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:35.327294 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:35.327294 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:35.327294 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:35.327294 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:35.327294 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:35.327294 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:35.327294 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:35.327294 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:35.327294 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:35.327294 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:35.327294 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:35.327294 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:35.328443 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:35.328443 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:35.328443 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:35.328443 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:35.328443 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:35.328443 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:35.328443 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:35.328443 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:35.328443 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:35.328443 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:35.328443 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:35.328443 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:35.328443 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:35.328443 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:35.328443 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:35.328443 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:35.329427 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:35.329427 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:35.329427 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:35.329427 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:35.329427 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:35.329427 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:35.329427 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:35.329427 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:35.329427 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:35.329427 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:35.329427 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:04:35.329427 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:04:35.329427 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 184/367] 10.222.0.79 () {56 vars in 1114 bytes} [Wed Aug 31 19:04:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:35.335748 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3498ed-5e95-49d4-8c56-c0f394f3491a None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:35.339323 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652af227-2778-4d69-b3df-97321f78c36e None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:35.392612 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:35.412062 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb6241-bb4e-41fb-8817-0ea722accd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:35.413148 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb6241-bb4e-41fb-8817-0ea722accd5b None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:35.413699 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb6241-bb4e-41fb-8817-0ea722accd5b None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:35.414194 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb6241-bb4e-41fb-8817-0ea722accd5b None admin] PATH_INFO: `/v3/groups/b8dbc32e324c4c1f896f3b8d32ff616e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:35.419376 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb6241-bb4e-41fb-8817-0ea722accd5b None admin] RBAC: Authorizing `identity:get_group(group_id=b8dbc32e324c4c1f896f3b8d32ff616e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:35.421396 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb6241-bb4e-41fb-8817-0ea722accd5b None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:35.423956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 184/368] 10.222.0.79 () {56 vars in 1180 bytes} [Wed Aug 31 19:04:35 2022] GET /identity/v3/groups/b8dbc32e324c4c1f896f3b8d32ff616e => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:35.431162 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb6241-bb4e-41fb-8817-0ea722accd5b None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:35.466814 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3498ed-5e95-49d4-8c56-c0f394f3491a None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:35.510070 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a1dbf-f39c-483b-bc23-171328204f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:35.510772 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a1dbf-f39c-483b-bc23-171328204f11 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:35.511099 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a1dbf-f39c-483b-bc23-171328204f11 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:35.511470 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a1dbf-f39c-483b-bc23-171328204f11 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:35.512514 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a1dbf-f39c-483b-bc23-171328204f11 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:35.512863 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a1dbf-f39c-483b-bc23-171328204f11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:35.514238 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a1dbf-f39c-483b-bc23-171328204f11 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:35.527049 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 185/369] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:04:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:04:35.527826 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a1dbf-f39c-483b-bc23-171328204f11 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:35.612099 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb6241-bb4e-41fb-8817-0ea722accd5b None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:35.639271 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:35.654980 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ab49d-d1a0-44c7-9783-c61f1ae04108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:35.655736 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ab49d-d1a0-44c7-9783-c61f1ae04108 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:35.656240 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ab49d-d1a0-44c7-9783-c61f1ae04108 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:35.656719 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ab49d-d1a0-44c7-9783-c61f1ae04108 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:35.657618 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ab49d-d1a0-44c7-9783-c61f1ae04108 None admin] RBAC: Adding query filter params (group.id=b8dbc32e324c4c1f896f3b8d32ff616e, role.id=27c44f922df34ac6bcb3794b111cb3da, scope.project.id=3aa248dc3fd34facaa9b43a30893c924) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:35.657932 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ab49d-d1a0-44c7-9783-c61f1ae04108 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:35.660395 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ab49d-d1a0-44c7-9783-c61f1ae04108 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:35.667911 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 185/370] 10.222.0.79 () {56 vars in 1376 bytes} [Wed Aug 31 19:04:35 2022] GET /identity/v3/role_assignments?group.id=b8dbc32e324c4c1f896f3b8d32ff616e&scope.project.id=3aa248dc3fd34facaa9b43a30893c924&role.id=27c44f922df34ac6bcb3794b111cb3da => generated 260 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:35.668586 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ab49d-d1a0-44c7-9783-c61f1ae04108 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:35.675668 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a1dbf-f39c-483b-bc23-171328204f11 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:35.679602 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:35.728250 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad67d68-681b-4548-8afb-4b4ff67f08e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:35.729208 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad67d68-681b-4548-8afb-4b4ff67f08e3 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:35.729693 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad67d68-681b-4548-8afb-4b4ff67f08e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:35.730142 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad67d68-681b-4548-8afb-4b4ff67f08e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:35.742594 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad67d68-681b-4548-8afb-4b4ff67f08e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:35.748370 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-cad67d68-681b-4548-8afb-4b4ff67f08e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:04:35.748370 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:35.748370 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:35.748370 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:35.748370 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:35.748370 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:35.748370 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:35.748370 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:35.748370 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:35.748370 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:35.748370 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:35.748370 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:35.748370 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:35.748370 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:35.748370 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:35.748370 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:35.749248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:35.749248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:35.749248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:35.749248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:35.749248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:35.749248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:35.749248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:35.749248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:35.749248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:35.749248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:35.749248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:35.749248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:35.749248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:35.749248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:35.749248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:35.749248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:35.750031 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:35.750031 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:35.750031 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:35.750031 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:35.750031 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:35.750031 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:35.750031 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:35.750031 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:35.750031 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:35.750031 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:35.750031 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:04:35.750031 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:04:35.753388 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 186/371] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 19:04:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:35.760855 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad67d68-681b-4548-8afb-4b4ff67f08e3 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:35.797090 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ab49d-d1a0-44c7-9783-c61f1ae04108 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:35.837216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0aa7f-b30f-4d8d-b361-d5dc43acd113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:35.837905 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0aa7f-b30f-4d8d-b361-d5dc43acd113 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:35.838122 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0aa7f-b30f-4d8d-b361-d5dc43acd113 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:35.838396 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0aa7f-b30f-4d8d-b361-d5dc43acd113 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:35.911511 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:35.926424 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad67d68-681b-4548-8afb-4b4ff67f08e3 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:35.927859 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb0aa7f-b30f-4d8d-b361-d5dc43acd113 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:35.929347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb0aa7f-b30f-4d8d-b361-d5dc43acd113 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:35.980284 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cde5f1-c964-4d57-9a93-86a8d6ab49e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:35.980913 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cde5f1-c964-4d57-9a93-86a8d6ab49e9 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:35.981190 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cde5f1-c964-4d57-9a93-86a8d6ab49e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:35.981462 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cde5f1-c964-4d57-9a93-86a8d6ab49e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:35.982136 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cde5f1-c964-4d57-9a93-86a8d6ab49e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:35.982435 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cde5f1-c964-4d57-9a93-86a8d6ab49e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:35.983825 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cde5f1-c964-4d57-9a93-86a8d6ab49e9 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:35.998198 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 187/372] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:04:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:36.008100 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cde5f1-c964-4d57-9a93-86a8d6ab49e9 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:36.043901 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 186/373] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:04:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:04:36.049611 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0aa7f-b30f-4d8d-b361-d5dc43acd113 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:36.070816 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:36.153896 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:36.161103 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cde5f1-c964-4d57-9a93-86a8d6ab49e9 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:36.175305 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0aa7f-b30f-4d8d-b361-d5dc43acd113 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:36.214584 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c819d-ed4b-4dbe-bd3f-392ae5c506f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:36.215231 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c819d-ed4b-4dbe-bd3f-392ae5c506f9 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:36.215555 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c819d-ed4b-4dbe-bd3f-392ae5c506f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:36.215836 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c819d-ed4b-4dbe-bd3f-392ae5c506f9 None admin] PATH_INFO: `/v3/projects/3aa248dc3fd34facaa9b43a30893c924` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:36.216662 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061d70f-6ee8-41e2-bc8d-c67b999f27d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:36.217094 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c819d-ed4b-4dbe-bd3f-392ae5c506f9 None admin] RBAC: Authorizing `identity:get_project(project_id=3aa248dc3fd34facaa9b43a30893c924)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:36.217272 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061d70f-6ee8-41e2-bc8d-c67b999f27d1 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:36.217550 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061d70f-6ee8-41e2-bc8d-c67b999f27d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:36.217820 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061d70f-6ee8-41e2-bc8d-c67b999f27d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:36.218660 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c819d-ed4b-4dbe-bd3f-392ae5c506f9 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:36.220672 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 187/374] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:04:36 2022] GET /identity/v3/projects/3aa248dc3fd34facaa9b43a30893c924 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:04:36.226058 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c819d-ed4b-4dbe-bd3f-392ae5c506f9 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:36.324626 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f061d70f-6ee8-41e2-bc8d-c67b999f27d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:36.326028 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f061d70f-6ee8-41e2-bc8d-c67b999f27d1 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:36.341672 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c819d-ed4b-4dbe-bd3f-392ae5c506f9 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:36.380514 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:36.383957 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346cdab-0a4d-4d9d-9d4b-b5387af4158c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:36.384610 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346cdab-0a4d-4d9d-9d4b-b5387af4158c None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:36.384890 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346cdab-0a4d-4d9d-9d4b-b5387af4158c None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:36.385169 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346cdab-0a4d-4d9d-9d4b-b5387af4158c None admin] PATH_INFO: `/v3/groups/b8dbc32e324c4c1f896f3b8d32ff616e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:36.386407 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8346cdab-0a4d-4d9d-9d4b-b5387af4158c None admin] RBAC: Authorizing `identity:get_group(group_id=b8dbc32e324c4c1f896f3b8d32ff616e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:36.388148 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8346cdab-0a4d-4d9d-9d4b-b5387af4158c None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:36.390103 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 188/375] 10.222.0.79 () {56 vars in 1180 bytes} [Wed Aug 31 19:04:36 2022] GET /identity/v3/groups/b8dbc32e324c4c1f896f3b8d32ff616e => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:04:36.396133 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346cdab-0a4d-4d9d-9d4b-b5387af4158c None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:36.425366 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:36.494218 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 188/376] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:04:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:04:36.500194 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061d70f-6ee8-41e2-bc8d-c67b999f27d1 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:36.522677 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346cdab-0a4d-4d9d-9d4b-b5387af4158c None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:36.560795 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f73578-7f43-4d52-8f78-39b8f3c4e06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:36.561413 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f73578-7f43-4d52-8f78-39b8f3c4e06b None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:36.561691 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f73578-7f43-4d52-8f78-39b8f3c4e06b None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:36.562061 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f73578-7f43-4d52-8f78-39b8f3c4e06b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:36.562845 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f73578-7f43-4d52-8f78-39b8f3c4e06b None admin] RBAC: Adding query filter params (group.id=b8dbc32e324c4c1f896f3b8d32ff616e, role.id=d01cf7e1efe04d8c8f8d09667717555c, scope.project.id=3aa248dc3fd34facaa9b43a30893c924) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:36.563154 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f73578-7f43-4d52-8f78-39b8f3c4e06b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:36.564601 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f73578-7f43-4d52-8f78-39b8f3c4e06b None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:36.571533 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 189/377] 10.222.0.79 () {56 vars in 1376 bytes} [Wed Aug 31 19:04:36 2022] GET /identity/v3/role_assignments?group.id=b8dbc32e324c4c1f896f3b8d32ff616e&scope.project.id=3aa248dc3fd34facaa9b43a30893c924&role.id=d01cf7e1efe04d8c8f8d09667717555c => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:04:36.646330 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061d70f-6ee8-41e2-bc8d-c67b999f27d1 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:36.669650 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa855f74-d48e-490f-9029-4f93fbe9ab0b None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:36.669964 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa855f74-d48e-490f-9029-4f93fbe9ab0b None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:36.670199 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa855f74-d48e-490f-9029-4f93fbe9ab0b None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:36.671961 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 190/378] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:36.681459 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:36.684694 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae924bba-bf81-4d60-9439-415c93aafe2a None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:36.684866 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae924bba-bf81-4d60-9439-415c93aafe2a None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:36.685145 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae924bba-bf81-4d60-9439-415c93aafe2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:36.696180 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ebd467-58d8-497a-8b24-9edc9cac778a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:36.696827 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ebd467-58d8-497a-8b24-9edc9cac778a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:36.697102 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ebd467-58d8-497a-8b24-9edc9cac778a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:36.697373 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ebd467-58d8-497a-8b24-9edc9cac778a None admin] PATH_INFO: `/v3/projects/eabc1ce4c37941459d2c18a04fbaba99` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:36.703807 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ebd467-58d8-497a-8b24-9edc9cac778a None admin] RBAC: Authorizing `identity:get_project(project_id=eabc1ce4c37941459d2c18a04fbaba99)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:36.705821 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ebd467-58d8-497a-8b24-9edc9cac778a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:36.707966 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 189/379] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:04:36 2022] GET /identity/v3/projects/eabc1ce4c37941459d2c18a04fbaba99 => generated 344 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:04:36.715419 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ebd467-58d8-497a-8b24-9edc9cac778a None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:36.725117 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-ae924bba-bf81-4d60-9439-415c93aafe2a None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:36.726345 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-ae924bba-bf81-4d60-9439-415c93aafe2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:36.845797 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 191/380] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:36.851437 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ebd467-58d8-497a-8b24-9edc9cac778a None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:36.889720 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c09acb-7c9f-40a8-98fd-d5892b7d849f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:36.890628 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c09acb-7c9f-40a8-98fd-d5892b7d849f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:36.891044 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c09acb-7c9f-40a8-98fd-d5892b7d849f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:36.891475 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c09acb-7c9f-40a8-98fd-d5892b7d849f None admin] PATH_INFO: `/v3/groups/93cbcc76df8645e2a9a50f383b96e18c` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:36.898143 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c09acb-7c9f-40a8-98fd-d5892b7d849f None admin] RBAC: Authorizing `identity:get_group(group_id=93cbcc76df8645e2a9a50f383b96e18c)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:36.899788 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c09acb-7c9f-40a8-98fd-d5892b7d849f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:36.901906 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 190/381] 10.222.0.79 () {56 vars in 1180 bytes} [Wed Aug 31 19:04:36 2022] GET /identity/v3/groups/93cbcc76df8645e2a9a50f383b96e18c => generated 229 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:36.907811 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae924bba-bf81-4d60-9439-415c93aafe2a None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:36.949275 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:37.074576 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae924bba-bf81-4d60-9439-415c93aafe2a None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:37.122666 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ca6a5-32bb-466c-9c3c-a1b00915517d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:37.123290 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ca6a5-32bb-466c-9c3c-a1b00915517d None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:37.123567 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ca6a5-32bb-466c-9c3c-a1b00915517d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:37.123843 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ca6a5-32bb-466c-9c3c-a1b00915517d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:37.124583 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ca6a5-32bb-466c-9c3c-a1b00915517d None admin] RBAC: Adding query filter params (group.id=93cbcc76df8645e2a9a50f383b96e18c, role.id=edc551338adb4ae88bdafc591ad69582, scope.project.id=eabc1ce4c37941459d2c18a04fbaba99) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:37.124891 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ca6a5-32bb-466c-9c3c-a1b00915517d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:37.126325 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ca6a5-32bb-466c-9c3c-a1b00915517d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:37.135178 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 192/382] 10.222.0.79 () {56 vars in 1376 bytes} [Wed Aug 31 19:04:36 2022] GET /identity/v3/role_assignments?group.id=93cbcc76df8645e2a9a50f383b96e18c&scope.project.id=eabc1ce4c37941459d2c18a04fbaba99&role.id=edc551338adb4ae88bdafc591ad69582 => generated 260 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:37.178633 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c09acb-7c9f-40a8-98fd-d5892b7d849f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:37.247163 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:37.292119 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c09acb-7c9f-40a8-98fd-d5892b7d849f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:37.328845 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba0f83-3ddf-4a22-bbda-9e4689925d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:37.329484 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba0f83-3ddf-4a22-bbda-9e4689925d77 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:37.329763 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba0f83-3ddf-4a22-bbda-9e4689925d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:37.330031 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba0f83-3ddf-4a22-bbda-9e4689925d77 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:37.341339 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba0f83-3ddf-4a22-bbda-9e4689925d77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:37.347427 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-9dba0f83-3ddf-4a22-bbda-9e4689925d77 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:04:37.347427 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:37.347427 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:37.347427 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:37.347427 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:37.347427 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:37.347427 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:37.347427 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:37.347427 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:37.347427 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:37.347427 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:37.347427 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:37.347427 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:37.347427 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:37.347427 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:37.347427 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:37.348373 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:37.348373 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:37.348373 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:37.348373 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:37.348373 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:37.348373 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:37.348373 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:37.348373 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:37.348373 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:37.348373 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:37.348373 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:37.348373 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:37.348373 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:37.348373 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:37.348373 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:37.348373 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:37.349154 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:37.349154 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:37.349154 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:37.349154 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:37.349154 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:37.349154 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:37.349154 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:37.349154 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:37.349154 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:37.349154 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:37.349154 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:04:37.349154 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:04:37.349154 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 191/383] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:04:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:37.354939 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ca6a5-32bb-466c-9c3c-a1b00915517d None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:37.465190 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:37.489434 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ca6a5-32bb-466c-9c3c-a1b00915517d None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:37.504224 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49887158-391a-4d70-b72d-131a9b066c19 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:37.504519 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49887158-391a-4d70-b72d-131a9b066c19 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:37.504756 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49887158-391a-4d70-b72d-131a9b066c19 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:37.506254 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 192/384] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:04:37.511266 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f73f86-07a0-489a-b6e2-324be067da76 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:37.511798 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f73f86-07a0-489a-b6e2-324be067da76 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:37.512266 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f73f86-07a0-489a-b6e2-324be067da76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:37.547399 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-d8f73f86-07a0-489a-b6e2-324be067da76 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:37.548595 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d8f73f86-07a0-489a-b6e2-324be067da76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:37.553546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8957a-5c98-47bd-852d-fe647855bb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:37.554157 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8957a-5c98-47bd-852d-fe647855bb36 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:37.554647 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8957a-5c98-47bd-852d-fe647855bb36 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:37.554983 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8957a-5c98-47bd-852d-fe647855bb36 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:37.555659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f8957a-5c98-47bd-852d-fe647855bb36 None admin] RBAC: Adding query filter params (name=member) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:37.555959 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f8957a-5c98-47bd-852d-fe647855bb36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:37.557323 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f8957a-5c98-47bd-852d-fe647855bb36 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:37.577649 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 193/385] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 19:04:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:37.604242 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8957a-5c98-47bd-852d-fe647855bb36 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:37.672471 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 193/386] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:37.757718 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8957a-5c98-47bd-852d-fe647855bb36 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:37.803224 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e57ba1-18f9-485a-bbc5-21a30ba34682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:37.804253 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e57ba1-18f9-485a-bbc5-21a30ba34682 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:37.804753 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e57ba1-18f9-485a-bbc5-21a30ba34682 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:37.805223 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e57ba1-18f9-485a-bbc5-21a30ba34682 None admin] PATH_INFO: `/v3/groups/b8dbc32e324c4c1f896f3b8d32ff616e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:37.806623 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e57ba1-18f9-485a-bbc5-21a30ba34682 None admin] RBAC: Authorizing `identity:get_group(group_id=b8dbc32e324c4c1f896f3b8d32ff616e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:37.808263 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e57ba1-18f9-485a-bbc5-21a30ba34682 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:37.811717 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 194/387] 10.222.0.79 () {56 vars in 1180 bytes} [Wed Aug 31 19:04:37 2022] GET /identity/v3/groups/b8dbc32e324c4c1f896f3b8d32ff616e => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:04:37.816057 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f73f86-07a0-489a-b6e2-324be067da76 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:37.889052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:37.954705 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f73f86-07a0-489a-b6e2-324be067da76 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:38.000120 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756261af-2ede-498d-8683-6e9e83b81ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:38.000778 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756261af-2ede-498d-8683-6e9e83b81ada None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:38.001061 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756261af-2ede-498d-8683-6e9e83b81ada None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:38.001334 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756261af-2ede-498d-8683-6e9e83b81ada None admin] PATH_INFO: `/v3/projects/898cfe9ce73e43bc84af8abd019b8d31` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:38.003070 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756261af-2ede-498d-8683-6e9e83b81ada None admin] RBAC: Authorizing `identity:get_project(project_id=898cfe9ce73e43bc84af8abd019b8d31)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:38.004520 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756261af-2ede-498d-8683-6e9e83b81ada None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:38.006512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 194/388] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:04:37 2022] GET /identity/v3/projects/898cfe9ce73e43bc84af8abd019b8d31 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:38.011995 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e57ba1-18f9-485a-bbc5-21a30ba34682 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:38.046212 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:38.119045 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756261af-2ede-498d-8683-6e9e83b81ada None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:38.150937 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e57ba1-18f9-485a-bbc5-21a30ba34682 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:38.212481 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed09db-fa0a-45c8-8009-ac0f70306fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:38.213166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed09db-fa0a-45c8-8009-ac0f70306fec None admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:38.213448 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed09db-fa0a-45c8-8009-ac0f70306fec None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:38.213787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed09db-fa0a-45c8-8009-ac0f70306fec None admin] PATH_INFO: `/v3/projects/898cfe9ce73e43bc84af8abd019b8d31/groups/b8dbc32e324c4c1f896f3b8d32ff616e/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:38.215753 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed09db-fa0a-45c8-8009-ac0f70306fec None admin] RBAC: Authorizing `identity:create_grant(project_id=898cfe9ce73e43bc84af8abd019b8d31, group_id=b8dbc32e324c4c1f896f3b8d32ff616e, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:38.217311 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed09db-fa0a-45c8-8009-ac0f70306fec None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:38.244750 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 195/389] 10.222.0.79 () {58 vars in 1442 bytes} [Wed Aug 31 19:04:38 2022] PUT /identity/v3/projects/898cfe9ce73e43bc84af8abd019b8d31/groups/b8dbc32e324c4c1f896f3b8d32ff616e/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:04:38.261841 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756261af-2ede-498d-8683-6e9e83b81ada None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:38.287310 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:38.312752 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9e26a-9069-4346-b629-856ff5f897ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:38.313993 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9e26a-9069-4346-b629-856ff5f897ab None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:38.314498 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9e26a-9069-4346-b629-856ff5f897ab None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:38.314819 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9e26a-9069-4346-b629-856ff5f897ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:38.327074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9e26a-9069-4346-b629-856ff5f897ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:38.333052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-97e9e26a-9069-4346-b629-856ff5f897ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:04:38.333052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:38.333052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:38.333052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:38.333052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:38.333052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:38.333052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:38.333052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:38.333052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:38.333052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:38.333052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:38.333052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:38.333052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:38.333052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:38.333052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:38.333052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:38.334060 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:38.334060 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:38.334060 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:38.334060 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:38.334060 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:38.334060 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:38.334060 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:38.334060 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:38.334060 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:38.334060 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:38.334060 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:38.334060 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:38.334060 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:38.334060 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:38.334060 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:38.334060 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:38.335127 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:38.335127 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:38.335127 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:38.335127 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:38.335127 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:38.335127 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:38.335127 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:38.335127 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:38.335127 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:38.335127 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:38.335127 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:04:38.335127 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:04:38.335127 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 195/390] 10.222.0.79 () {56 vars in 1114 bytes} [Wed Aug 31 19:04:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:38.340193 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed09db-fa0a-45c8-8009-ac0f70306fec None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:38.435152 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:38.477908 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed09db-fa0a-45c8-8009-ac0f70306fec None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:38.522140 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60385a2-b1d5-4cb7-a972-c59b0743ed54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:38.523090 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60385a2-b1d5-4cb7-a972-c59b0743ed54 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:38.523548 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60385a2-b1d5-4cb7-a972-c59b0743ed54 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:38.523976 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60385a2-b1d5-4cb7-a972-c59b0743ed54 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:38.524898 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60385a2-b1d5-4cb7-a972-c59b0743ed54 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:38.525369 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60385a2-b1d5-4cb7-a972-c59b0743ed54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:38.527044 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60385a2-b1d5-4cb7-a972-c59b0743ed54 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:38.541611 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 196/391] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:04:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:38.547673 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9e26a-9069-4346-b629-856ff5f897ab None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:38.709256 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9e26a-9069-4346-b629-856ff5f897ab None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:38.757628 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdfb37b-c6bf-4153-adaa-9490b7e05dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:38.758270 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfb37b-c6bf-4153-adaa-9490b7e05dc7 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:38.758579 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfb37b-c6bf-4153-adaa-9490b7e05dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:38.758848 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfb37b-c6bf-4153-adaa-9490b7e05dc7 None admin] PATH_INFO: `/v3/groups/b8dbc32e324c4c1f896f3b8d32ff616e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:38.763239 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdfb37b-c6bf-4153-adaa-9490b7e05dc7 None admin] RBAC: Authorizing `identity:get_group(group_id=b8dbc32e324c4c1f896f3b8d32ff616e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:38.764700 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdfb37b-c6bf-4153-adaa-9490b7e05dc7 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:38.766662 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 196/392] 10.222.0.79 () {56 vars in 1180 bytes} [Wed Aug 31 19:04:38 2022] GET /identity/v3/groups/b8dbc32e324c4c1f896f3b8d32ff616e => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:04:38.772476 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60385a2-b1d5-4cb7-a972-c59b0743ed54 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:38.809112 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc427ed-6960-4ef3-9e12-ce8567f47199 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:38.809742 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc427ed-6960-4ef3-9e12-ce8567f47199 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:38.810231 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc427ed-6960-4ef3-9e12-ce8567f47199 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:38.812847 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 197/393] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:38.818645 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6563896-d921-4d0b-9977-f7bc97c09f05 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:38.819247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6563896-d921-4d0b-9977-f7bc97c09f05 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:38.819742 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6563896-d921-4d0b-9977-f7bc97c09f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:38.843770 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-a6563896-d921-4d0b-9977-f7bc97c09f05 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:38.845333 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a6563896-d921-4d0b-9977-f7bc97c09f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:38.909376 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:38.947665 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 198/394] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:04:38.965367 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60385a2-b1d5-4cb7-a972-c59b0743ed54 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:39.004069 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea8c64-8b6a-4f9a-bb47-1fe92adb2d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:39.005085 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea8c64-8b6a-4f9a-bb47-1fe92adb2d29 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:39.005622 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea8c64-8b6a-4f9a-bb47-1fe92adb2d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:39.006295 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea8c64-8b6a-4f9a-bb47-1fe92adb2d29 None admin] PATH_INFO: `/v3/projects/898cfe9ce73e43bc84af8abd019b8d31` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:39.007958 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea8c64-8b6a-4f9a-bb47-1fe92adb2d29 None admin] RBAC: Authorizing `identity:get_project(project_id=898cfe9ce73e43bc84af8abd019b8d31)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:39.009614 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea8c64-8b6a-4f9a-bb47-1fe92adb2d29 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:39.011907 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 197/395] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:04:38 2022] GET /identity/v3/projects/898cfe9ce73e43bc84af8abd019b8d31 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:39.019563 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6563896-d921-4d0b-9977-f7bc97c09f05 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:39.132453 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6563896-d921-4d0b-9977-f7bc97c09f05 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:39.172831 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653977ff-e4b3-4f08-ae2f-99f6bd1c454f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:39.173888 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653977ff-e4b3-4f08-ae2f-99f6bd1c454f None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:39.174409 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653977ff-e4b3-4f08-ae2f-99f6bd1c454f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:39.174907 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653977ff-e4b3-4f08-ae2f-99f6bd1c454f None admin] PATH_INFO: `/v3/projects/898cfe9ce73e43bc84af8abd019b8d31/groups/b8dbc32e324c4c1f896f3b8d32ff616e/roles/d01cf7e1efe04d8c8f8d09667717555c` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:39.177334 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653977ff-e4b3-4f08-ae2f-99f6bd1c454f None admin] RBAC: Authorizing `identity:create_grant(project_id=898cfe9ce73e43bc84af8abd019b8d31, group_id=b8dbc32e324c4c1f896f3b8d32ff616e, role_id=d01cf7e1efe04d8c8f8d09667717555c)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:39.179325 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653977ff-e4b3-4f08-ae2f-99f6bd1c454f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:39.198286 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 199/396] 10.222.0.79 () {58 vars in 1442 bytes} [Wed Aug 31 19:04:39 2022] PUT /identity/v3/projects/898cfe9ce73e43bc84af8abd019b8d31/groups/b8dbc32e324c4c1f896f3b8d32ff616e/roles/d01cf7e1efe04d8c8f8d09667717555c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:04:39.298394 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a0897-ebab-431e-934d-839dafc38eff None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:39.299010 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a0897-ebab-431e-934d-839dafc38eff None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:39.299010 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a0897-ebab-431e-934d-839dafc38eff None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:39.300522 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 198/397] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:39.309816 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad31862-e5d9-42c4-848e-e0cbdde5e5c9 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:39.309816 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad31862-e5d9-42c4-848e-e0cbdde5e5c9 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:39.309816 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad31862-e5d9-42c4-848e-e0cbdde5e5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:39.318989 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a0897-ebab-431e-934d-839dafc38eff None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:39.325451 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:39.330073 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-5ad31862-e5d9-42c4-848e-e0cbdde5e5c9 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:39.332245 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5ad31862-e5d9-42c4-848e-e0cbdde5e5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:39.363924 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:39.412342 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 200/398] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:39.505169 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a0897-ebab-431e-934d-839dafc38eff None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:39.553570 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccccde9-7958-4b51-ae76-964a85078e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:39.554332 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccccde9-7958-4b51-ae76-964a85078e6b None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:39.554735 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccccde9-7958-4b51-ae76-964a85078e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:39.555013 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccccde9-7958-4b51-ae76-964a85078e6b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:39.568592 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccccde9-7958-4b51-ae76-964a85078e6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:39.574307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-2ccccde9-7958-4b51-ae76-964a85078e6b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:04:39.574307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:39.574307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:39.574307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:39.574307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:39.574307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:39.574307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:39.574307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:39.574307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:39.574307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:39.574307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:39.574307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:39.574307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:39.574307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:39.574307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:39.574307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:39.575216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:39.575216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:39.575216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:39.575216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:39.575216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:39.575216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:39.575216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:39.575216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:39.575216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:39.575216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:39.575216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:39.575216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:39.575216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:39.575216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:39.575216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:39.575216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:39.576092 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:39.576092 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:39.576092 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:39.576092 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:39.576092 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:39.576092 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:39.576092 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:39.576092 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:39.576092 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:39.576092 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:39.576092 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:04:39.576092 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:04:39.578231 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 199/399] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:04:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:39.583573 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad31862-e5d9-42c4-848e-e0cbdde5e5c9 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:39.708181 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad31862-e5d9-42c4-848e-e0cbdde5e5c9 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:39.741277 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccccde9-7958-4b51-ae76-964a85078e6b None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:39.749082 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c099ff-2d37-4333-be89-9f9404360179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:39.749716 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c099ff-2d37-4333-be89-9f9404360179 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:39.749999 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c099ff-2d37-4333-be89-9f9404360179 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:39.750247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c099ff-2d37-4333-be89-9f9404360179 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:39.750967 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c099ff-2d37-4333-be89-9f9404360179 None admin] RBAC: Adding query filter params (name=member) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:39.751270 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c099ff-2d37-4333-be89-9f9404360179 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:39.753239 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c099ff-2d37-4333-be89-9f9404360179 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:39.774751 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 201/400] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 19:04:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:39.779438 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c099ff-2d37-4333-be89-9f9404360179 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:39.842837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:39.871768 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:39.954560 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccccde9-7958-4b51-ae76-964a85078e6b None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:39.967676 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c099ff-2d37-4333-be89-9f9404360179 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:39.996947 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8929311-4efb-4e26-81c8-a80d488357e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:39.997598 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8929311-4efb-4e26-81c8-a80d488357e7 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:39.997885 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8929311-4efb-4e26-81c8-a80d488357e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:39.998162 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8929311-4efb-4e26-81c8-a80d488357e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:40.009587 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbff9e7-81d1-4949-b932-2bfc5caef187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:40.010233 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbff9e7-81d1-4949-b932-2bfc5caef187 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:40.010560 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbff9e7-81d1-4949-b932-2bfc5caef187 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:40.010904 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbff9e7-81d1-4949-b932-2bfc5caef187 None admin] PATH_INFO: `/v3/groups/b8dbc32e324c4c1f896f3b8d32ff616e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:40.011391 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8929311-4efb-4e26-81c8-a80d488357e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:40.012063 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbff9e7-81d1-4949-b932-2bfc5caef187 None admin] RBAC: Authorizing `identity:get_group(group_id=b8dbc32e324c4c1f896f3b8d32ff616e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:40.013506 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbff9e7-81d1-4949-b932-2bfc5caef187 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:40.015490 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 202/401] 10.222.0.79 () {56 vars in 1180 bytes} [Wed Aug 31 19:04:39 2022] GET /identity/v3/groups/b8dbc32e324c4c1f896f3b8d32ff616e => generated 226 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:40.016687 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5f0f4-e9c8-451a-a6f9-e3262927f322 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:40.016971 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5f0f4-e9c8-451a-a6f9-e3262927f322 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:40.017248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5f0f4-e9c8-451a-a6f9-e3262927f322 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:40.019204 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 203/402] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:40.021547 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-c8929311-4efb-4e26-81c8-a80d488357e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:04:40.021547 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:40.021547 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:40.021547 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:40.021547 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:40.021547 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:40.021547 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:40.021547 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:40.021547 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:40.021547 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:40.021547 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:40.021547 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:40.021547 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:40.021547 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:40.021547 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:40.021547 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:40.022810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:40.022810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:40.022810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:40.022810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:40.022810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:40.022810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:40.022810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:40.022810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:40.022810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:40.022810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:40.022810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:40.022810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:40.022810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:40.022810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:40.022810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:40.022810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:40.023990 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:40.023990 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:40.023990 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:40.023990 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:40.023990 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:40.023990 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:40.023990 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:40.023990 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:40.023990 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:40.023990 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:40.023990 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:04:40.023990 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:04:40.023990 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 200/403] 10.222.0.79 () {56 vars in 1114 bytes} [Wed Aug 31 19:04:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:40.029859 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8929311-4efb-4e26-81c8-a80d488357e7 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:40.031643 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a7b16-24b0-4472-a441-7544f50ed3d8 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:40.032126 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a7b16-24b0-4472-a441-7544f50ed3d8 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:40.032699 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a7b16-24b0-4472-a441-7544f50ed3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:40.058040 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-ef7a7b16-24b0-4472-a441-7544f50ed3d8 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:40.059612 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ef7a7b16-24b0-4472-a441-7544f50ed3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:40.136806 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 204/404] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:40.137723 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a7b16-24b0-4472-a441-7544f50ed3d8 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:40.149233 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8929311-4efb-4e26-81c8-a80d488357e7 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:40.164998 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:40.190964 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7a1aa-69de-4cd1-894c-30a316aee9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:40.191598 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7a1aa-69de-4cd1-894c-30a316aee9f3 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:40.191995 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7a1aa-69de-4cd1-894c-30a316aee9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:40.192267 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7a1aa-69de-4cd1-894c-30a316aee9f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:40.193037 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e7a1aa-69de-4cd1-894c-30a316aee9f3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:40.193348 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e7a1aa-69de-4cd1-894c-30a316aee9f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:40.193870 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:40.202727 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e7a1aa-69de-4cd1-894c-30a316aee9f3 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:40.220278 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 201/405] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:04:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:40.228997 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7a1aa-69de-4cd1-894c-30a316aee9f3 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:40.320589 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a7b16-24b0-4472-a441-7544f50ed3d8 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:40.362898 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7a1aa-69de-4cd1-894c-30a316aee9f3 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:40.404864 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c751e-2b9e-466f-a9d0-7270ebd0783a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:40.407430 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c751e-2b9e-466f-a9d0-7270ebd0783a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:40.407720 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c751e-2b9e-466f-a9d0-7270ebd0783a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:40.407998 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c751e-2b9e-466f-a9d0-7270ebd0783a None admin] PATH_INFO: `/v3/projects/3aa248dc3fd34facaa9b43a30893c924` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:40.411058 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544cf7a8-c142-43a3-bedd-520e8c0b8689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:40.412085 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c751e-2b9e-466f-a9d0-7270ebd0783a None admin] RBAC: Authorizing `identity:get_project(project_id=3aa248dc3fd34facaa9b43a30893c924)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:40.413551 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c751e-2b9e-466f-a9d0-7270ebd0783a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:40.415654 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cf7a8-c142-43a3-bedd-520e8c0b8689 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:40.415936 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cf7a8-c142-43a3-bedd-520e8c0b8689 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:40.416269 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cf7a8-c142-43a3-bedd-520e8c0b8689 None admin] PATH_INFO: `/v3/groups/b8dbc32e324c4c1f896f3b8d32ff616e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:40.417440 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544cf7a8-c142-43a3-bedd-520e8c0b8689 None admin] RBAC: Authorizing `identity:get_group(group_id=b8dbc32e324c4c1f896f3b8d32ff616e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:40.418961 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544cf7a8-c142-43a3-bedd-520e8c0b8689 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:40.419721 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 205/406] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:04:40 2022] GET /identity/v3/projects/3aa248dc3fd34facaa9b43a30893c924 => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:40.421838 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c751e-2b9e-466f-a9d0-7270ebd0783a None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:40.423772 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 202/407] 10.222.0.79 () {56 vars in 1180 bytes} [Wed Aug 31 19:04:40 2022] GET /identity/v3/groups/b8dbc32e324c4c1f896f3b8d32ff616e => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:40.427010 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544cf7a8-c142-43a3-bedd-520e8c0b8689 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:40.520403 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:40.596744 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:40.604447 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544cf7a8-c142-43a3-bedd-520e8c0b8689 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:40.610624 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c751e-2b9e-466f-a9d0-7270ebd0783a None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:40.648735 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b91b0e7-65e6-4461-b28c-3c151fb4e2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:40.649427 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9fe7ac-f757-4903-a1c1-c13bf66b079a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:40.649548 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91b0e7-65e6-4461-b28c-3c151fb4e2d7 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:40.649727 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91b0e7-65e6-4461-b28c-3c151fb4e2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:40.650002 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91b0e7-65e6-4461-b28c-3c151fb4e2d7 None admin] PATH_INFO: `/v3/projects/3aa248dc3fd34facaa9b43a30893c924` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:40.650120 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fe7ac-f757-4903-a1c1-c13bf66b079a None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:40.650357 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fe7ac-f757-4903-a1c1-c13bf66b079a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:40.650676 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fe7ac-f757-4903-a1c1-c13bf66b079a None admin] PATH_INFO: `/v3/projects/3aa248dc3fd34facaa9b43a30893c924/groups/b8dbc32e324c4c1f896f3b8d32ff616e/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:40.651186 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b91b0e7-65e6-4461-b28c-3c151fb4e2d7 None admin] RBAC: Authorizing `identity:get_project(project_id=3aa248dc3fd34facaa9b43a30893c924)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:40.652599 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9fe7ac-f757-4903-a1c1-c13bf66b079a None admin] RBAC: Authorizing `identity:create_grant(project_id=3aa248dc3fd34facaa9b43a30893c924, group_id=b8dbc32e324c4c1f896f3b8d32ff616e, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:40.652831 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b91b0e7-65e6-4461-b28c-3c151fb4e2d7 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:40.654043 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9fe7ac-f757-4903-a1c1-c13bf66b079a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:40.654812 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 203/408] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:04:40 2022] GET /identity/v3/projects/3aa248dc3fd34facaa9b43a30893c924 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:40.655786 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b91b0e7-65e6-4461-b28c-3c151fb4e2d7 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:40.673161 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 206/409] 10.222.0.79 () {58 vars in 1442 bytes} [Wed Aug 31 19:04:40 2022] PUT /identity/v3/projects/3aa248dc3fd34facaa9b43a30893c924/groups/b8dbc32e324c4c1f896f3b8d32ff616e/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:04:40.674642 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9fe7ac-f757-4903-a1c1-c13bf66b079a None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:40.796885 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9fe7ac-f757-4903-a1c1-c13bf66b079a None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:40.812637 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b91b0e7-65e6-4461-b28c-3c151fb4e2d7 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:40.840996 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b1492-3824-46bd-b317-d47442224ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:40.841683 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b1492-3824-46bd-b317-d47442224ceb None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:40.841965 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b1492-3824-46bd-b317-d47442224ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:40.842240 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b1492-3824-46bd-b317-d47442224ceb None admin] PATH_INFO: `/v3/projects/3aa248dc3fd34facaa9b43a30893c924/groups/b8dbc32e324c4c1f896f3b8d32ff616e/roles/d01cf7e1efe04d8c8f8d09667717555c` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:40.847143 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b1492-3824-46bd-b317-d47442224ceb None admin] RBAC: Authorizing `identity:create_grant(project_id=3aa248dc3fd34facaa9b43a30893c924, group_id=b8dbc32e324c4c1f896f3b8d32ff616e, role_id=d01cf7e1efe04d8c8f8d09667717555c)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:40.848648 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b1492-3824-46bd-b317-d47442224ceb None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:40.858889 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:40.876540 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 207/410] 10.222.0.79 () {58 vars in 1442 bytes} [Wed Aug 31 19:04:40 2022] PUT /identity/v3/projects/3aa248dc3fd34facaa9b43a30893c924/groups/b8dbc32e324c4c1f896f3b8d32ff616e/roles/d01cf7e1efe04d8c8f8d09667717555c => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:04:40.881730 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15911775-b45a-488a-97be-9062961b6f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:40.882759 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15911775-b45a-488a-97be-9062961b6f17 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:40.883297 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15911775-b45a-488a-97be-9062961b6f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:40.883814 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15911775-b45a-488a-97be-9062961b6f17 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:40.901170 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15911775-b45a-488a-97be-9062961b6f17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:40.907387 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-15911775-b45a-488a-97be-9062961b6f17 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:04:40.907387 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:40.907387 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:40.907387 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:40.907387 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:40.907387 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:40.907387 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:40.907387 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:40.907387 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:40.907387 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:40.907387 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:40.907387 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:40.907387 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:40.907387 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:40.907387 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:40.907387 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:40.908416 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:40.908416 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:40.908416 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:40.908416 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:40.908416 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:40.908416 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:40.908416 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:40.908416 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:40.908416 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:40.908416 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:40.908416 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:40.908416 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:40.908416 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:40.908416 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:40.908416 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:40.908416 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:40.909206 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:40.909206 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:40.909206 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:40.909206 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:40.909206 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:40.909206 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:40.909206 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:40.909206 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:40.909206 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:40.909206 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:40.909206 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:04:40.909206 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:04:40.912018 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 204/411] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 19:04:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:40.918777 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b1492-3824-46bd-b317-d47442224ceb None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:40.937782 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:41.051497 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b1492-3824-46bd-b317-d47442224ceb None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:41.094600 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc8c8b-7487-429f-a8fe-ea524e304a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:41.095589 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc8c8b-7487-429f-a8fe-ea524e304a63 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:41.096592 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc8c8b-7487-429f-a8fe-ea524e304a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:41.097066 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc8c8b-7487-429f-a8fe-ea524e304a63 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:41.097993 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc8c8b-7487-429f-a8fe-ea524e304a63 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:41.098539 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc8c8b-7487-429f-a8fe-ea524e304a63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:41.100155 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc8c8b-7487-429f-a8fe-ea524e304a63 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:41.110907 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 208/412] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:04:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:41.116831 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15911775-b45a-488a-97be-9062961b6f17 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:41.251046 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15911775-b45a-488a-97be-9062961b6f17 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:41.290272 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16a6f0-8cc8-4565-8f38-e6eb13e3ae53 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:41.290915 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16a6f0-8cc8-4565-8f38-e6eb13e3ae53 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:41.291392 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16a6f0-8cc8-4565-8f38-e6eb13e3ae53 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:41.293484 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 209/413] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:41.303966 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e7b1b-cedd-4742-be8b-829c30b47d1c None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:41.304243 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e7b1b-cedd-4742-be8b-829c30b47d1c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:41.304447 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e7b1b-cedd-4742-be8b-829c30b47d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:41.310745 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ebf63-fb93-424d-83b7-15051549822a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:41.311387 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ebf63-fb93-424d-83b7-15051549822a None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:41.311661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ebf63-fb93-424d-83b7-15051549822a None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:41.311927 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ebf63-fb93-424d-83b7-15051549822a None admin] PATH_INFO: `/v3/groups/93cbcc76df8645e2a9a50f383b96e18c` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:41.313073 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ebf63-fb93-424d-83b7-15051549822a None admin] RBAC: Authorizing `identity:get_group(group_id=93cbcc76df8645e2a9a50f383b96e18c)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:41.315209 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ebf63-fb93-424d-83b7-15051549822a None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:41.317111 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 205/414] 10.222.0.79 () {56 vars in 1180 bytes} [Wed Aug 31 19:04:41 2022] GET /identity/v3/groups/93cbcc76df8645e2a9a50f383b96e18c => generated 229 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:41.327497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ebf63-fb93-424d-83b7-15051549822a None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:41.331800 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-1a1e7b1b-cedd-4742-be8b-829c30b47d1c None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:41.333105 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1a1e7b1b-cedd-4742-be8b-829c30b47d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:41.425246 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:41.476456 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 210/415] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:41.497391 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ebf63-fb93-424d-83b7-15051549822a None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:41.533409 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fbb07e-bb1d-4647-b386-b2712567912e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:41.535031 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbb07e-bb1d-4647-b386-b2712567912e None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:41.535298 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbb07e-bb1d-4647-b386-b2712567912e None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:41.535562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbb07e-bb1d-4647-b386-b2712567912e None admin] PATH_INFO: `/v3/projects/eabc1ce4c37941459d2c18a04fbaba99` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:41.536782 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fbb07e-bb1d-4647-b386-b2712567912e None admin] RBAC: Authorizing `identity:get_project(project_id=eabc1ce4c37941459d2c18a04fbaba99)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:41.538242 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fbb07e-bb1d-4647-b386-b2712567912e None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:41.540620 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 206/416] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:04:41 2022] GET /identity/v3/projects/eabc1ce4c37941459d2c18a04fbaba99 => generated 344 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:41.545726 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e7b1b-cedd-4742-be8b-829c30b47d1c None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:41.553323 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:41.705216 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e7b1b-cedd-4742-be8b-829c30b47d1c None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:41.755222 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f64006-8dc1-47e8-9d5f-60f5a222e61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:41.755886 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f64006-8dc1-47e8-9d5f-60f5a222e61e None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:41.756164 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f64006-8dc1-47e8-9d5f-60f5a222e61e None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:41.756434 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f64006-8dc1-47e8-9d5f-60f5a222e61e None admin] PATH_INFO: `/v3/projects/eabc1ce4c37941459d2c18a04fbaba99/groups/93cbcc76df8645e2a9a50f383b96e18c/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:41.760253 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f64006-8dc1-47e8-9d5f-60f5a222e61e None admin] RBAC: Authorizing `identity:create_grant(project_id=eabc1ce4c37941459d2c18a04fbaba99, group_id=93cbcc76df8645e2a9a50f383b96e18c, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:41.761704 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f64006-8dc1-47e8-9d5f-60f5a222e61e None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:41.794248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 211/417] 10.222.0.79 () {58 vars in 1442 bytes} [Wed Aug 31 19:04:41 2022] PUT /identity/v3/projects/eabc1ce4c37941459d2c18a04fbaba99/groups/93cbcc76df8645e2a9a50f383b96e18c/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:04:41.816366 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0f8c8-fd24-4e18-9e0d-045100ab6905 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:41.816644 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0f8c8-fd24-4e18-9e0d-045100ab6905 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:41.817188 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0f8c8-fd24-4e18-9e0d-045100ab6905 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:41.818925 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 207/418] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:41.825312 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4793c7-9279-4b90-b556-26c7d90fc4f9 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:41.825597 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4793c7-9279-4b90-b556-26c7d90fc4f9 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:41.825872 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4793c7-9279-4b90-b556-26c7d90fc4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:41.845561 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0f8c8-fd24-4e18-9e0d-045100ab6905 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:41.855583 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-7f4793c7-9279-4b90-b556-26c7d90fc4f9 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:41.857101 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7f4793c7-9279-4b90-b556-26c7d90fc4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:41.995111 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:42.002568 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 212/419] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:42.031697 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0f8c8-fd24-4e18-9e0d-045100ab6905 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:42.052067 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:42.071826 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80aefbb-59d6-4479-8972-424a4e32eb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:42.072768 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80aefbb-59d6-4479-8972-424a4e32eb78 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:42.073182 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80aefbb-59d6-4479-8972-424a4e32eb78 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:42.073607 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80aefbb-59d6-4479-8972-424a4e32eb78 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:42.086849 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80aefbb-59d6-4479-8972-424a4e32eb78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:42.091997 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-e80aefbb-59d6-4479-8972-424a4e32eb78 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:04:42.091997 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:42.091997 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:42.091997 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:42.091997 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:42.091997 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:42.091997 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:42.091997 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:42.091997 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:42.091997 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:42.091997 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:42.091997 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:42.091997 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:42.091997 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:42.091997 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:42.091997 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:42.093065 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:42.093065 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:42.093065 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:42.093065 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:42.093065 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:42.093065 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:42.093065 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:42.093065 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:42.093065 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:42.093065 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:42.093065 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:42.093065 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:42.093065 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:42.093065 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:42.093065 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:42.093065 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:42.094143 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:42.094143 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:42.094143 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:42.094143 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:42.094143 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:42.094143 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:42.094143 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:42.094143 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:42.094143 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:42.094143 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:42.094143 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:04:42.094143 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:04:42.102568 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 208/420] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:04:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:04:42.104386 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4793c7-9279-4b90-b556-26c7d90fc4f9 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:42.241320 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4793c7-9279-4b90-b556-26c7d90fc4f9 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:42.293513 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3f710-ce62-4ae1-a072-d4b00ace2a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:42.294420 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3f710-ce62-4ae1-a072-d4b00ace2a9a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:42.294851 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3f710-ce62-4ae1-a072-d4b00ace2a9a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:42.295315 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3f710-ce62-4ae1-a072-d4b00ace2a9a None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:42.296137 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3f710-ce62-4ae1-a072-d4b00ace2a9a None admin] RBAC: Adding query filter params (name=member) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:42.296575 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3f710-ce62-4ae1-a072-d4b00ace2a9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:42.298125 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3f710-ce62-4ae1-a072-d4b00ace2a9a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:42.303998 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80aefbb-59d6-4479-8972-424a4e32eb78 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:42.317071 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 213/421] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 19:04:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:42.319947 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3f710-ce62-4ae1-a072-d4b00ace2a9a None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:42.438885 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:42.481934 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80aefbb-59d6-4479-8972-424a4e32eb78 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:42.523300 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133dbfa-3ae3-4ba6-82f1-5e5640caeb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:42.524174 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133dbfa-3ae3-4ba6-82f1-5e5640caeb56 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:42.525573 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133dbfa-3ae3-4ba6-82f1-5e5640caeb56 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:42.526720 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133dbfa-3ae3-4ba6-82f1-5e5640caeb56 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:42.529643 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3f710-ce62-4ae1-a072-d4b00ace2a9a None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:42.552627 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6133dbfa-3ae3-4ba6-82f1-5e5640caeb56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:42.558877 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-6133dbfa-3ae3-4ba6-82f1-5e5640caeb56 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:04:42.558877 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:42.558877 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:42.558877 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:42.558877 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:42.558877 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:42.558877 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:42.558877 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:42.558877 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:42.558877 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:42.558877 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:42.558877 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:42.558877 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:42.558877 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:42.558877 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:42.558877 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:42.559770 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:42.559770 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:42.559770 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:42.559770 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:42.559770 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:42.559770 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:42.559770 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:42.559770 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:42.559770 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:42.559770 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:42.559770 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:42.559770 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:42.559770 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:42.559770 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:42.559770 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:42.559770 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:42.560544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:42.560544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:42.560544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:42.560544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:42.560544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:42.560544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:42.560544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:42.560544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:42.560544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:42.560544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:42.560544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:04:42.560544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:04:42.560544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 209/422] 10.222.0.79 () {56 vars in 1114 bytes} [Wed Aug 31 19:04:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:42.570065 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133dbfa-3ae3-4ba6-82f1-5e5640caeb56 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:42.595016 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2463c7-233f-4dfe-be0d-04e97991b0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:42.595627 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2463c7-233f-4dfe-be0d-04e97991b0fb None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:42.596463 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2463c7-233f-4dfe-be0d-04e97991b0fb None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:42.596771 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2463c7-233f-4dfe-be0d-04e97991b0fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:42.652668 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:42.680979 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2463c7-233f-4dfe-be0d-04e97991b0fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:42.683272 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2463c7-233f-4dfe-be0d-04e97991b0fb None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:42.749036 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:42.778757 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133dbfa-3ae3-4ba6-82f1-5e5640caeb56 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:42.808787 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 214/423] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:04:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:04:42.810420 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2463c7-233f-4dfe-be0d-04e97991b0fb None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:42.828126 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1fe28-4ea4-44a3-8596-83685bed6ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:42.828819 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1fe28-4ea4-44a3-8596-83685bed6ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:42.829022 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1fe28-4ea4-44a3-8596-83685bed6ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:42.829300 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1fe28-4ea4-44a3-8596-83685bed6ab5 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:42.829979 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1fe28-4ea4-44a3-8596-83685bed6ab5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:42.830824 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1fe28-4ea4-44a3-8596-83685bed6ab5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:42.832188 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1fe28-4ea4-44a3-8596-83685bed6ab5 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:42.849987 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 210/424] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:04:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:42.855872 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1fe28-4ea4-44a3-8596-83685bed6ab5 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:42.921960 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2463c7-233f-4dfe-be0d-04e97991b0fb None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:42.960469 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef83a0-b949-467d-9834-e1acc81b6af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:42.961679 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef83a0-b949-467d-9834-e1acc81b6af8 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:42.962143 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef83a0-b949-467d-9834-e1acc81b6af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:42.962612 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef83a0-b949-467d-9834-e1acc81b6af8 None admin] PATH_INFO: `/v3/projects/898cfe9ce73e43bc84af8abd019b8d31` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:42.963970 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef83a0-b949-467d-9834-e1acc81b6af8 None admin] RBAC: Authorizing `identity:get_project(project_id=898cfe9ce73e43bc84af8abd019b8d31)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:42.965636 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef83a0-b949-467d-9834-e1acc81b6af8 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:42.972346 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 215/425] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:04:42 2022] GET /identity/v3/projects/898cfe9ce73e43bc84af8abd019b8d31 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:42.973834 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef83a0-b949-467d-9834-e1acc81b6af8 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:43.002735 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:43.097419 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef83a0-b949-467d-9834-e1acc81b6af8 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:43.102157 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:43.110554 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1fe28-4ea4-44a3-8596-83685bed6ab5 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:43.169251 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702daac-9377-4ad5-9ae0-597a1bf0b247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:43.169879 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702daac-9377-4ad5-9ae0-597a1bf0b247 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:43.170159 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702daac-9377-4ad5-9ae0-597a1bf0b247 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:43.170433 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702daac-9377-4ad5-9ae0-597a1bf0b247 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:43.173167 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95148e-8927-4dba-8efb-8893d83458c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:43.173807 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95148e-8927-4dba-8efb-8893d83458c5 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:43.174695 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95148e-8927-4dba-8efb-8893d83458c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:43.174933 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95148e-8927-4dba-8efb-8893d83458c5 None admin] PATH_INFO: `/v3/groups/b8dbc32e324c4c1f896f3b8d32ff616e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:43.177937 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf95148e-8927-4dba-8efb-8893d83458c5 None admin] RBAC: Authorizing `identity:get_group(group_id=b8dbc32e324c4c1f896f3b8d32ff616e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:43.179543 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf95148e-8927-4dba-8efb-8893d83458c5 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:43.181187 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 216/426] 10.222.0.79 () {56 vars in 1180 bytes} [Wed Aug 31 19:04:42 2022] GET /identity/v3/groups/b8dbc32e324c4c1f896f3b8d32ff616e => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:04:43.189224 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95148e-8927-4dba-8efb-8893d83458c5 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:43.317606 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702daac-9377-4ad5-9ae0-597a1bf0b247 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:43.320093 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702daac-9377-4ad5-9ae0-597a1bf0b247 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:43.340499 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:43.354580 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95148e-8927-4dba-8efb-8893d83458c5 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:43.402555 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d01b1-0fee-4ec0-bfc0-de9c05533d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:43.403230 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d01b1-0fee-4ec0-bfc0-de9c05533d02 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:43.403516 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d01b1-0fee-4ec0-bfc0-de9c05533d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:43.403792 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d01b1-0fee-4ec0-bfc0-de9c05533d02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:43.404785 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d01b1-0fee-4ec0-bfc0-de9c05533d02 None admin] RBAC: Adding query filter params (group.id=b8dbc32e324c4c1f896f3b8d32ff616e, role.id=27c44f922df34ac6bcb3794b111cb3da, scope.project.id=898cfe9ce73e43bc84af8abd019b8d31) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:43.405106 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d01b1-0fee-4ec0-bfc0-de9c05533d02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:43.407370 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d01b1-0fee-4ec0-bfc0-de9c05533d02 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:43.416379 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 217/427] 10.222.0.79 () {56 vars in 1376 bytes} [Wed Aug 31 19:04:43 2022] GET /identity/v3/role_assignments?group.id=b8dbc32e324c4c1f896f3b8d32ff616e&scope.project.id=898cfe9ce73e43bc84af8abd019b8d31&role.id=27c44f922df34ac6bcb3794b111cb3da => generated 611 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:43.417472 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f501f7-cc82-4a4f-b410-565d77a67751 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:43.417760 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f501f7-cc82-4a4f-b410-565d77a67751 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:43.418033 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f501f7-cc82-4a4f-b410-565d77a67751 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:43.424077 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 218/428] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:43.424077 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c0801-83d9-43dd-a692-00748661b98e None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:43.424077 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c0801-83d9-43dd-a692-00748661b98e None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:43.424077 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c0801-83d9-43dd-a692-00748661b98e None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:43.426670 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 219/429] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:04:43.432431 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17654430-ab75-4b7e-b8d5-ec8a46ffd3cc None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:43.433047 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17654430-ab75-4b7e-b8d5-ec8a46ffd3cc None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:43.433515 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17654430-ab75-4b7e-b8d5-ec8a46ffd3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:43.454864 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-17654430-ab75-4b7e-b8d5-ec8a46ffd3cc None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:43.457819 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-17654430-ab75-4b7e-b8d5-ec8a46ffd3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:43.474869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:43.479068 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 211/430] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:04:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 19:04:43.480665 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b3914-97e0-4a09-ac11-fcf6bc268b6a None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:43.480854 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b3914-97e0-4a09-ac11-fcf6bc268b6a None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:43.481100 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b3914-97e0-4a09-ac11-fcf6bc268b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:43.501932 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-0b1b3914-97e0-4a09-ac11-fcf6bc268b6a None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:43.504223 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-0b1b3914-97e0-4a09-ac11-fcf6bc268b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:43.540129 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 220/431] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:43.541612 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17654430-ab75-4b7e-b8d5-ec8a46ffd3cc None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:43.614562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 212/432] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:43.688984 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:43.706053 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17654430-ab75-4b7e-b8d5-ec8a46ffd3cc None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:43.749858 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e71f8-4824-4303-bd7b-6d0bf88d793a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:43.750964 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e71f8-4824-4303-bd7b-6d0bf88d793a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:43.751474 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e71f8-4824-4303-bd7b-6d0bf88d793a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:43.751978 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e71f8-4824-4303-bd7b-6d0bf88d793a None admin] PATH_INFO: `/v3/projects/898cfe9ce73e43bc84af8abd019b8d31` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:43.753938 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e71f8-4824-4303-bd7b-6d0bf88d793a None admin] RBAC: Authorizing `identity:get_project(project_id=898cfe9ce73e43bc84af8abd019b8d31)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:43.755915 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e71f8-4824-4303-bd7b-6d0bf88d793a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:43.758938 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 221/433] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:04:43 2022] GET /identity/v3/projects/898cfe9ce73e43bc84af8abd019b8d31 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:43.764693 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b3914-97e0-4a09-ac11-fcf6bc268b6a None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:43.870717 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e71f8-4824-4303-bd7b-6d0bf88d793a None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:43.902435 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b3914-97e0-4a09-ac11-fcf6bc268b6a None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:43.939001 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:43.943918 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470a267-80c9-4660-8fe2-b26832b9bf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:43.944562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470a267-80c9-4660-8fe2-b26832b9bf8a None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:43.944841 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470a267-80c9-4660-8fe2-b26832b9bf8a None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:43.945172 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470a267-80c9-4660-8fe2-b26832b9bf8a None admin] PATH_INFO: `/v3/groups/b8dbc32e324c4c1f896f3b8d32ff616e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:43.946338 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470a267-80c9-4660-8fe2-b26832b9bf8a None admin] RBAC: Authorizing `identity:get_group(group_id=b8dbc32e324c4c1f896f3b8d32ff616e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:43.947759 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470a267-80c9-4660-8fe2-b26832b9bf8a None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:43.949676 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 213/434] 10.222.0.79 () {56 vars in 1180 bytes} [Wed Aug 31 19:04:43 2022] GET /identity/v3/groups/b8dbc32e324c4c1f896f3b8d32ff616e => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:43.954283 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470a267-80c9-4660-8fe2-b26832b9bf8a None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:43.995234 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e71f8-4824-4303-bd7b-6d0bf88d793a None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:44.039333 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac217a-406a-4a19-a82d-306f5a2cd39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:44.039988 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac217a-406a-4a19-a82d-306f5a2cd39b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:44.040270 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac217a-406a-4a19-a82d-306f5a2cd39b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:44.040527 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac217a-406a-4a19-a82d-306f5a2cd39b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:44.062533 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac217a-406a-4a19-a82d-306f5a2cd39b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:44.068402 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-99ac217a-406a-4a19-a82d-306f5a2cd39b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:04:44.068402 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:44.068402 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:44.068402 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:44.068402 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:44.068402 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:44.068402 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:44.068402 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:44.068402 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:44.068402 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:44.068402 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:44.068402 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:44.068402 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:44.068402 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:44.068402 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:44.068402 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:44.069328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:44.069328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:44.069328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:44.069328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:44.069328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:44.069328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:44.069328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:44.069328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:44.069328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:44.069328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:44.069328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:44.069328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:44.069328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:44.069328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:44.069328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:44.069328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:44.070127 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:44.070127 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:44.070127 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:44.070127 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:44.070127 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:44.070127 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:44.070127 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:44.070127 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:44.070127 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:44.070127 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:44.070127 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 19:04:44.070127 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:04:44.074609 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 222/435] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:04:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:44.074609 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac217a-406a-4a19-a82d-306f5a2cd39b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:44.087397 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470a267-80c9-4660-8fe2-b26832b9bf8a None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:44.092319 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:44.133916 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec55db4-d8f2-4f8d-ba5c-2b3728d591f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:44.134585 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec55db4-d8f2-4f8d-ba5c-2b3728d591f1 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:44.135290 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec55db4-d8f2-4f8d-ba5c-2b3728d591f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:44.135398 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec55db4-d8f2-4f8d-ba5c-2b3728d591f1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:44.149299 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec55db4-d8f2-4f8d-ba5c-2b3728d591f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:44.154513 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-4ec55db4-d8f2-4f8d-ba5c-2b3728d591f1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:04:44.154513 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:44.154513 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:44.154513 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:44.154513 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:44.154513 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:44.154513 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:44.154513 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:44.154513 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:44.154513 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:44.154513 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:44.154513 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:44.154513 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:44.154513 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:44.154513 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:44.154513 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:44.155457 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:44.155457 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:44.155457 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:44.155457 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:44.155457 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:44.155457 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:44.155457 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:44.155457 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:44.155457 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:44.155457 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:44.155457 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:44.155457 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:44.155457 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:44.155457 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:44.155457 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:44.155457 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:44.156245 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:44.156245 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:44.156245 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:44.156245 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:44.156245 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:44.156245 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:44.156245 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:44.156245 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:44.156245 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:44.156245 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:44.156245 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:04:44.156245 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:04:44.156245 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 214/436] 10.222.0.79 () {56 vars in 1114 bytes} [Wed Aug 31 19:04:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:44.156924 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec55db4-d8f2-4f8d-ba5c-2b3728d591f1 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:44.204014 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac217a-406a-4a19-a82d-306f5a2cd39b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:44.220431 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:44.240261 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0763c-6fea-4864-935c-6c9d6dfa1402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:44.240866 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0763c-6fea-4864-935c-6c9d6dfa1402 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:44.241145 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0763c-6fea-4864-935c-6c9d6dfa1402 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:44.241414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0763c-6fea-4864-935c-6c9d6dfa1402 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:44.242141 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc0763c-6fea-4864-935c-6c9d6dfa1402 None admin] RBAC: Adding query filter params (group.id=b8dbc32e324c4c1f896f3b8d32ff616e, role.id=d01cf7e1efe04d8c8f8d09667717555c, scope.project.id=898cfe9ce73e43bc84af8abd019b8d31) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:44.242495 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc0763c-6fea-4864-935c-6c9d6dfa1402 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:44.243926 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc0763c-6fea-4864-935c-6c9d6dfa1402 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:44.249548 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 223/437] 10.222.0.79 () {56 vars in 1376 bytes} [Wed Aug 31 19:04:44 2022] GET /identity/v3/role_assignments?group.id=b8dbc32e324c4c1f896f3b8d32ff616e&scope.project.id=898cfe9ce73e43bc84af8abd019b8d31&role.id=d01cf7e1efe04d8c8f8d09667717555c => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:44.250393 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0763c-6fea-4864-935c-6c9d6dfa1402 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:44.271355 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec55db4-d8f2-4f8d-ba5c-2b3728d591f1 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:44.310617 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc280173-7aed-49af-98d9-ddb8efef5098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:44.311242 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc280173-7aed-49af-98d9-ddb8efef5098 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:44.311514 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc280173-7aed-49af-98d9-ddb8efef5098 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:44.311786 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc280173-7aed-49af-98d9-ddb8efef5098 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:44.312468 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc280173-7aed-49af-98d9-ddb8efef5098 None admin] RBAC: Adding query filter params (name=member) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:44.312765 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc280173-7aed-49af-98d9-ddb8efef5098 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:44.314164 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc280173-7aed-49af-98d9-ddb8efef5098 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:44.328453 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 215/438] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 19:04:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:44.328453 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59c234-49b0-4edc-be68-c22d0229c944 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:44.328453 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59c234-49b0-4edc-be68-c22d0229c944 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:44.328453 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59c234-49b0-4edc-be68-c22d0229c944 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:44.328453 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 216/439] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:44.329419 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59c234-49b0-4edc-be68-c22d0229c944 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:44.347109 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:44.374769 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0763c-6fea-4864-935c-6c9d6dfa1402 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:44.414080 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500892e-3221-4f0a-9561-1e9c1d288283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:44.414649 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500892e-3221-4f0a-9561-1e9c1d288283 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:44.414935 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500892e-3221-4f0a-9561-1e9c1d288283 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:44.415232 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500892e-3221-4f0a-9561-1e9c1d288283 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:44.415908 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500892e-3221-4f0a-9561-1e9c1d288283 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:44.416214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500892e-3221-4f0a-9561-1e9c1d288283 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:44.417589 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500892e-3221-4f0a-9561-1e9c1d288283 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:44.426814 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 224/440] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:04:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:44.427806 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3ea57-b7da-4c4a-9f29-fa4a50b7ad2c None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:44.428092 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3ea57-b7da-4c4a-9f29-fa4a50b7ad2c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:44.428367 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3ea57-b7da-4c4a-9f29-fa4a50b7ad2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:44.446959 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-7ea3ea57-b7da-4c4a-9f29-fa4a50b7ad2c None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:44.448132 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7ea3ea57-b7da-4c4a-9f29-fa4a50b7ad2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:44.455808 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59c234-49b0-4edc-be68-c22d0229c944 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:44.476662 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:44.497797 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d297f68d-b334-4b02-9565-e39a6488f7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:44.498847 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297f68d-b334-4b02-9565-e39a6488f7e1 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:44.499128 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297f68d-b334-4b02-9565-e39a6488f7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:44.499396 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297f68d-b334-4b02-9565-e39a6488f7e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:44.531876 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 225/441] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:44.533931 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea3ea57-b7da-4c4a-9f29-fa4a50b7ad2c None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:44.594930 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d297f68d-b334-4b02-9565-e39a6488f7e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:44.597245 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d297f68d-b334-4b02-9565-e39a6488f7e1 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:44.625329 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:44.666805 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea3ea57-b7da-4c4a-9f29-fa4a50b7ad2c None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:44.701441 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d6592-6f0d-436a-bb84-fb3c863f8d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:44.702055 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d6592-6f0d-436a-bb84-fb3c863f8d2c None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:44.702335 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d6592-6f0d-436a-bb84-fb3c863f8d2c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:44.702644 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d6592-6f0d-436a-bb84-fb3c863f8d2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:44.722108 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 217/442] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:04:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:04:44.727873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d297f68d-b334-4b02-9565-e39a6488f7e1 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:44.746194 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:44.778890 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d6592-6f0d-436a-bb84-fb3c863f8d2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:44.780426 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d6592-6f0d-436a-bb84-fb3c863f8d2c None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:44.829320 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d297f68d-b334-4b02-9565-e39a6488f7e1 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:44.848045 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:44.863611 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7e66b-8c4e-432b-8340-46e307e25817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:44.864231 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7e66b-8c4e-432b-8340-46e307e25817 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:44.864502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7e66b-8c4e-432b-8340-46e307e25817 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:44.864769 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7e66b-8c4e-432b-8340-46e307e25817 None admin] PATH_INFO: `/v3/projects/3aa248dc3fd34facaa9b43a30893c924` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:44.865891 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7e66b-8c4e-432b-8340-46e307e25817 None admin] RBAC: Authorizing `identity:get_project(project_id=3aa248dc3fd34facaa9b43a30893c924)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:44.867329 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7e66b-8c4e-432b-8340-46e307e25817 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:44.873392 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 218/443] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:04:44 2022] GET /identity/v3/projects/3aa248dc3fd34facaa9b43a30893c924 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:04:44.873392 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7e66b-8c4e-432b-8340-46e307e25817 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:44.886046 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 226/444] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:04:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:04:44.886919 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d6592-6f0d-436a-bb84-fb3c863f8d2c None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:44.956994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:44.972505 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7e66b-8c4e-432b-8340-46e307e25817 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:44.984496 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d6592-6f0d-436a-bb84-fb3c863f8d2c None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:45.007165 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef0302-9461-4ea3-88ab-aa518032fcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:45.007793 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef0302-9461-4ea3-88ab-aa518032fcff None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:45.008072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef0302-9461-4ea3-88ab-aa518032fcff None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:45.008355 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef0302-9461-4ea3-88ab-aa518032fcff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:45.018916 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ef0302-9461-4ea3-88ab-aa518032fcff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:45.019183 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6778d-c680-45eb-989d-4e5400fc25c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:45.019808 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6778d-c680-45eb-989d-4e5400fc25c8 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:45.020085 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6778d-c680-45eb-989d-4e5400fc25c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:45.020356 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6778d-c680-45eb-989d-4e5400fc25c8 None admin] PATH_INFO: `/v3/groups/b8dbc32e324c4c1f896f3b8d32ff616e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:45.021445 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6778d-c680-45eb-989d-4e5400fc25c8 None admin] RBAC: Authorizing `identity:get_group(group_id=b8dbc32e324c4c1f896f3b8d32ff616e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:45.022913 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6778d-c680-45eb-989d-4e5400fc25c8 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:45.023714 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-90ef0302-9461-4ea3-88ab-aa518032fcff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:04:45.023714 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:45.023714 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:45.023714 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:45.023714 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:45.023714 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:45.023714 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:45.023714 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:45.023714 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:45.023714 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:45.023714 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:45.023714 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:45.023714 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:45.023714 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:45.023714 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:45.023714 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:45.024663 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:45.024663 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:45.024663 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:45.024663 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:45.024663 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:45.024663 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:45.024663 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:45.024663 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:45.024663 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:45.024663 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:45.024663 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:45.024663 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:45.024663 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:45.024663 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:45.024663 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:45.024663 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:45.026117 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:45.026117 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:45.026117 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:45.026117 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:45.026117 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:45.026117 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:45.026117 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:45.026117 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:45.026117 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:45.026117 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:45.026117 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:04:45.026117 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:04:45.027012 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 227/445] 10.222.0.79 () {56 vars in 1180 bytes} [Wed Aug 31 19:04:44 2022] GET /identity/v3/groups/b8dbc32e324c4c1f896f3b8d32ff616e => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:45.027081 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 219/446] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 19:04:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:45.027145 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6778d-c680-45eb-989d-4e5400fc25c8 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:45.031102 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef0302-9461-4ea3-88ab-aa518032fcff None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:45.068143 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:45.129636 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6778d-c680-45eb-989d-4e5400fc25c8 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:45.130256 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef0302-9461-4ea3-88ab-aa518032fcff None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:45.164366 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a85cd-8f55-40b8-8c42-3e191132da97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:45.164543 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17545fa4-8cdf-4af8-b4d7-3bdf62d1deb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:45.164993 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a85cd-8f55-40b8-8c42-3e191132da97 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:45.165135 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17545fa4-8cdf-4af8-b4d7-3bdf62d1deb7 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:45.165267 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a85cd-8f55-40b8-8c42-3e191132da97 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:45.165395 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17545fa4-8cdf-4af8-b4d7-3bdf62d1deb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:45.165539 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a85cd-8f55-40b8-8c42-3e191132da97 None admin] PATH_INFO: `/v3/projects/3aa248dc3fd34facaa9b43a30893c924` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:45.165684 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17545fa4-8cdf-4af8-b4d7-3bdf62d1deb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:45.166383 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17545fa4-8cdf-4af8-b4d7-3bdf62d1deb7 None admin] RBAC: Adding query filter params (group.id=b8dbc32e324c4c1f896f3b8d32ff616e, role.id=27c44f922df34ac6bcb3794b111cb3da, scope.project.id=3aa248dc3fd34facaa9b43a30893c924) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:45.166691 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a85cd-8f55-40b8-8c42-3e191132da97 None admin] RBAC: Authorizing `identity:get_project(project_id=3aa248dc3fd34facaa9b43a30893c924)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:45.166780 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17545fa4-8cdf-4af8-b4d7-3bdf62d1deb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:45.168126 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17545fa4-8cdf-4af8-b4d7-3bdf62d1deb7 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:45.168233 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a85cd-8f55-40b8-8c42-3e191132da97 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:45.169911 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 228/447] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:04:45 2022] GET /identity/v3/projects/3aa248dc3fd34facaa9b43a30893c924 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:45.170719 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a85cd-8f55-40b8-8c42-3e191132da97 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:45.190489 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 220/448] 10.222.0.79 () {56 vars in 1376 bytes} [Wed Aug 31 19:04:45 2022] GET /identity/v3/role_assignments?group.id=b8dbc32e324c4c1f896f3b8d32ff616e&scope.project.id=3aa248dc3fd34facaa9b43a30893c924&role.id=27c44f922df34ac6bcb3794b111cb3da => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:45.190489 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17545fa4-8cdf-4af8-b4d7-3bdf62d1deb7 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:45.193881 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:45.292203 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a85cd-8f55-40b8-8c42-3e191132da97 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:45.300277 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:45.301455 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17545fa4-8cdf-4af8-b4d7-3bdf62d1deb7 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:45.341647 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeebb648-0a6b-43db-ac01-24f65ae9ab75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:45.341647 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeebb648-0a6b-43db-ac01-24f65ae9ab75 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:45.341647 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeebb648-0a6b-43db-ac01-24f65ae9ab75 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:45.341999 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeebb648-0a6b-43db-ac01-24f65ae9ab75 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:45.342556 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeebb648-0a6b-43db-ac01-24f65ae9ab75 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:45.342839 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeebb648-0a6b-43db-ac01-24f65ae9ab75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:45.344228 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeebb648-0a6b-43db-ac01-24f65ae9ab75 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:45.350067 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c758bb1-77c6-4361-9d9c-065e310daf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:45.350741 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c758bb1-77c6-4361-9d9c-065e310daf84 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:45.351019 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c758bb1-77c6-4361-9d9c-065e310daf84 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:45.351292 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c758bb1-77c6-4361-9d9c-065e310daf84 None admin] PATH_INFO: `/v3/groups/b8dbc32e324c4c1f896f3b8d32ff616e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:45.352706 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c758bb1-77c6-4361-9d9c-065e310daf84 None admin] RBAC: Authorizing `identity:get_group(group_id=b8dbc32e324c4c1f896f3b8d32ff616e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:45.354139 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c758bb1-77c6-4361-9d9c-065e310daf84 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:45.355134 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 229/449] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:04:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:45.355898 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 221/450] 10.222.0.79 () {56 vars in 1180 bytes} [Wed Aug 31 19:04:45 2022] GET /identity/v3/groups/b8dbc32e324c4c1f896f3b8d32ff616e => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:45.360506 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeebb648-0a6b-43db-ac01-24f65ae9ab75 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:45.361688 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c758bb1-77c6-4361-9d9c-065e310daf84 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:45.455755 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:45.483691 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c758bb1-77c6-4361-9d9c-065e310daf84 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:45.484553 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeebb648-0a6b-43db-ac01-24f65ae9ab75 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:45.522418 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9880c-2c23-4832-886b-3ac2d3a00aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:45.523052 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9880c-2c23-4832-886b-3ac2d3a00aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:45.523330 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9880c-2c23-4832-886b-3ac2d3a00aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:45.523598 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9880c-2c23-4832-886b-3ac2d3a00aa8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:45.524324 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce9880c-2c23-4832-886b-3ac2d3a00aa8 None admin] RBAC: Adding query filter params (group.id=b8dbc32e324c4c1f896f3b8d32ff616e, role.id=d01cf7e1efe04d8c8f8d09667717555c, scope.project.id=3aa248dc3fd34facaa9b43a30893c924) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:45.524630 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce9880c-2c23-4832-886b-3ac2d3a00aa8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:45.526044 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce9880c-2c23-4832-886b-3ac2d3a00aa8 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:45.526315 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714fc8b8-4358-4925-b6b6-add5fdf7aa8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:45.529520 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fc8b8-4358-4925-b6b6-add5fdf7aa8e None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:45.529520 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fc8b8-4358-4925-b6b6-add5fdf7aa8e None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:45.529520 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fc8b8-4358-4925-b6b6-add5fdf7aa8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:45.537828 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 222/451] 10.222.0.79 () {56 vars in 1376 bytes} [Wed Aug 31 19:04:45 2022] GET /identity/v3/role_assignments?group.id=b8dbc32e324c4c1f896f3b8d32ff616e&scope.project.id=3aa248dc3fd34facaa9b43a30893c924&role.id=d01cf7e1efe04d8c8f8d09667717555c => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:04:45.567191 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:45.603238 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714fc8b8-4358-4925-b6b6-add5fdf7aa8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:45.604744 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714fc8b8-4358-4925-b6b6-add5fdf7aa8e None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:45.707475 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 230/452] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:04:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:04:45.713307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9880c-2c23-4832-886b-3ac2d3a00aa8 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:45.819276 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9880c-2c23-4832-886b-3ac2d3a00aa8 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:45.854162 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc4a9c-54d1-4319-8b91-cad57200704b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:45.854827 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc4a9c-54d1-4319-8b91-cad57200704b None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:45.855105 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc4a9c-54d1-4319-8b91-cad57200704b None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:45.855377 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc4a9c-54d1-4319-8b91-cad57200704b None admin] PATH_INFO: `/v3/projects/eabc1ce4c37941459d2c18a04fbaba99` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:45.856526 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc4a9c-54d1-4319-8b91-cad57200704b None admin] RBAC: Authorizing `identity:get_project(project_id=eabc1ce4c37941459d2c18a04fbaba99)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:45.857958 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc4a9c-54d1-4319-8b91-cad57200704b None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:45.859662 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 223/453] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:04:45 2022] GET /identity/v3/projects/eabc1ce4c37941459d2c18a04fbaba99 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:45.865410 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714fc8b8-4358-4925-b6b6-add5fdf7aa8e None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:45.933942 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:45.966422 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714fc8b8-4358-4925-b6b6-add5fdf7aa8e None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:45.999482 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea464c-dbf5-4de3-9fd7-972bbdd78e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:46.000122 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea464c-dbf5-4de3-9fd7-972bbdd78e1f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:46.000404 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea464c-dbf5-4de3-9fd7-972bbdd78e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:46.000675 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea464c-dbf5-4de3-9fd7-972bbdd78e1f None admin] PATH_INFO: `/v3/groups/93cbcc76df8645e2a9a50f383b96e18c` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:46.001788 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea464c-dbf5-4de3-9fd7-972bbdd78e1f None admin] RBAC: Authorizing `identity:get_group(group_id=93cbcc76df8645e2a9a50f383b96e18c)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:46.003256 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea464c-dbf5-4de3-9fd7-972bbdd78e1f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:46.004811 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 231/454] 10.222.0.79 () {56 vars in 1180 bytes} [Wed Aug 31 19:04:45 2022] GET /identity/v3/groups/93cbcc76df8645e2a9a50f383b96e18c => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:46.010868 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc4a9c-54d1-4319-8b91-cad57200704b None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:46.023773 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:46.108473 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc4a9c-54d1-4319-8b91-cad57200704b None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:46.140468 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b514da-ded0-4c60-a001-c1bbfe34a38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:46.141057 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b514da-ded0-4c60-a001-c1bbfe34a38a None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:46.141335 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b514da-ded0-4c60-a001-c1bbfe34a38a None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:46.141605 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b514da-ded0-4c60-a001-c1bbfe34a38a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:46.142326 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b514da-ded0-4c60-a001-c1bbfe34a38a None admin] RBAC: Adding query filter params (group.id=93cbcc76df8645e2a9a50f383b96e18c, role.id=edc551338adb4ae88bdafc591ad69582, scope.project.id=eabc1ce4c37941459d2c18a04fbaba99) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:46.143312 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b514da-ded0-4c60-a001-c1bbfe34a38a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:46.144730 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b514da-ded0-4c60-a001-c1bbfe34a38a None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:46.150252 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 224/455] 10.222.0.79 () {56 vars in 1376 bytes} [Wed Aug 31 19:04:46 2022] GET /identity/v3/role_assignments?group.id=93cbcc76df8645e2a9a50f383b96e18c&scope.project.id=eabc1ce4c37941459d2c18a04fbaba99&role.id=edc551338adb4ae88bdafc591ad69582 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:48.460340 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9642a5-b65e-424b-a096-3a6c08a4f8ba None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:48.460866 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9642a5-b65e-424b-a096-3a6c08a4f8ba None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:48.460866 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9642a5-b65e-424b-a096-3a6c08a4f8ba None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:48.462351 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 232/456] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:48.469050 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b76d5-8b2a-4749-92fa-ff26e6e64107 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:48.469516 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b76d5-8b2a-4749-92fa-ff26e6e64107 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:48.469594 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b76d5-8b2a-4749-92fa-ff26e6e64107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:48.491519 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-201b76d5-8b2a-4749-92fa-ff26e6e64107 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:48.492709 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-201b76d5-8b2a-4749-92fa-ff26e6e64107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:48.569962 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 225/457] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:48.867041 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd4c61-199d-4965-b60d-2ac570c00be3 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:48.867415 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd4c61-199d-4965-b60d-2ac570c00be3 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:48.867592 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd4c61-199d-4965-b60d-2ac570c00be3 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:48.869166 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 233/458] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:48.874492 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45b9f5-639d-4b3e-a671-6bb4e1dc7bf5 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:48.874798 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45b9f5-639d-4b3e-a671-6bb4e1dc7bf5 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:48.875075 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45b9f5-639d-4b3e-a671-6bb4e1dc7bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:48.883156 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:48.896953 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-7e45b9f5-639d-4b3e-a671-6bb4e1dc7bf5 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:48.898133 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-7e45b9f5-639d-4b3e-a671-6bb4e1dc7bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:48.973890 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd4c61-199d-4965-b60d-2ac570c00be3 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:48.976340 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 226/459] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:49.037312 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70ffe0-d4fe-4a85-9898-bc81a464db1e None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:49.037891 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70ffe0-d4fe-4a85-9898-bc81a464db1e None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:49.038323 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70ffe0-d4fe-4a85-9898-bc81a464db1e None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:49.040255 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 227/460] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:04:49.045252 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f04acc-1c71-4861-bce1-a3523ea77e82 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:49.045725 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f04acc-1c71-4861-bce1-a3523ea77e82 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:49.046238 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f04acc-1c71-4861-bce1-a3523ea77e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:49.083620 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-25f04acc-1c71-4861-bce1-a3523ea77e82 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:49.085147 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-25f04acc-1c71-4861-bce1-a3523ea77e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:49.125121 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd4c61-199d-4965-b60d-2ac570c00be3 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:49.167427 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c209102-778c-4f9a-b02f-82ae81f243cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:49.168384 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c209102-778c-4f9a-b02f-82ae81f243cf None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:49.168802 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c209102-778c-4f9a-b02f-82ae81f243cf None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:49.169240 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c209102-778c-4f9a-b02f-82ae81f243cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:49.172642 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:49.181884 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c209102-778c-4f9a-b02f-82ae81f243cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:49.183603 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c209102-778c-4f9a-b02f-82ae81f243cf None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:49.190757 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 228/461] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:04:49.191966 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ddea0-f3d0-4638-8d73-9b22148c46e6 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:49.192236 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ddea0-f3d0-4638-8d73-9b22148c46e6 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:49.192509 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ddea0-f3d0-4638-8d73-9b22148c46e6 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:49.193867 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 229/462] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:49.203124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-5c209102-778c-4f9a-b02f-82ae81f243cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:04:49.203124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:49.203124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:49.203124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:49.203124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:49.203124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:49.203124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:49.203124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:49.203124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:49.203124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:49.203124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:49.203124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:49.203124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:04:49.203124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:04:49.203124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:04:49.203124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:04:49.204214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:49.204214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:49.204214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:49.204214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:49.204214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:49.204214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:49.204214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:49.204214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:49.204214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:49.204214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:49.204214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:49.204214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:49.204214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:49.204214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:49.204214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:49.204214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:49.204214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:04:49.205894 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:04:49.205894 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:04:49.205894 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:04:49.206661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea1f72-a602-4bc1-8669-524dfc954fe0 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:49.206940 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea1f72-a602-4bc1-8669-524dfc954fe0 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:49.207207 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea1f72-a602-4bc1-8669-524dfc954fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:49.207956 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 234/463] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:04:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:49.219413 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c209102-778c-4f9a-b02f-82ae81f243cf None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:49.234512 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-c0ea1f72-a602-4bc1-8669-524dfc954fe0 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:49.234512 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-c0ea1f72-a602-4bc1-8669-524dfc954fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:49.293435 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:49.306585 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 230/464] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:04:49.307540 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea1f72-a602-4bc1-8669-524dfc954fe0 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:49.380918 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c209102-778c-4f9a-b02f-82ae81f243cf None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:49.411045 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea1f72-a602-4bc1-8669-524dfc954fe0 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:49.443335 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96472db0-f3cb-47cb-95f9-8421bb5b57d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:49.444670 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96472db0-f3cb-47cb-95f9-8421bb5b57d0 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:49.445305 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96472db0-f3cb-47cb-95f9-8421bb5b57d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:49.445761 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96472db0-f3cb-47cb-95f9-8421bb5b57d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:49.446670 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96472db0-f3cb-47cb-95f9-8421bb5b57d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:49.447169 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3196bca2-a681-43ed-b23f-63c27c464336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:49.447380 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96472db0-f3cb-47cb-95f9-8421bb5b57d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:49.447978 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196bca2-a681-43ed-b23f-63c27c464336 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:49.448352 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196bca2-a681-43ed-b23f-63c27c464336 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:49.448720 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196bca2-a681-43ed-b23f-63c27c464336 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:49.449452 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96472db0-f3cb-47cb-95f9-8421bb5b57d0 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:49.459963 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3196bca2-a681-43ed-b23f-63c27c464336 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:49.461507 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3196bca2-a681-43ed-b23f-63c27c464336 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:49.477562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-3196bca2-a681-43ed-b23f-63c27c464336 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:04:49.477562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:49.477562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:49.477562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:49.477562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:49.477562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:49.477562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:49.477562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:49.477562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:49.477562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:49.477562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:49.477562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:49.477562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:04:49.477562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:04:49.477562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:04:49.477562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:04:49.479144 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:49.479144 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:49.479144 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:49.479144 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:49.479144 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:49.479144 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:49.479144 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:49.479144 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:49.479144 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:49.479144 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:49.479144 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:49.479144 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:49.479144 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:49.479144 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:49.479144 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:49.479144 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:49.479144 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:04:49.480192 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:04:49.480192 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:04:49.480192 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:04:49.482497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 231/465] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:04:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:49.486137 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 235/466] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:49.487694 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3196bca2-a681-43ed-b23f-63c27c464336 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:49.493314 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96472db0-f3cb-47cb-95f9-8421bb5b57d0 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:49.537944 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:49.575968 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:49.596978 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3196bca2-a681-43ed-b23f-63c27c464336 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:49.632381 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96472db0-f3cb-47cb-95f9-8421bb5b57d0 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:49.633334 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6b9fb-faf9-43e6-bbc8-fd4b7f60fe71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:49.634053 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6b9fb-faf9-43e6-bbc8-fd4b7f60fe71 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:49.634340 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6b9fb-faf9-43e6-bbc8-fd4b7f60fe71 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:49.634761 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6b9fb-faf9-43e6-bbc8-fd4b7f60fe71 None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:49.635423 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6b9fb-faf9-43e6-bbc8-fd4b7f60fe71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:49.635730 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6b9fb-faf9-43e6-bbc8-fd4b7f60fe71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:49.637097 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6b9fb-faf9-43e6-bbc8-fd4b7f60fe71 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:49.653201 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 232/467] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:49.654694 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6b9fb-faf9-43e6-bbc8-fd4b7f60fe71 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:49.667570 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee6d41-73aa-4d32-a067-41bc748462db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:49.668175 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee6d41-73aa-4d32-a067-41bc748462db None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:49.668450 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee6d41-73aa-4d32-a067-41bc748462db None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:49.668718 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee6d41-73aa-4d32-a067-41bc748462db None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:49.669369 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee6d41-73aa-4d32-a067-41bc748462db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:49.670828 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee6d41-73aa-4d32-a067-41bc748462db None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:49.702491 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 236/468] 10.222.0.79 () {60 vars in 1132 bytes} [Wed Aug 31 19:04:49 2022] POST /identity/v3/users => generated 246 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:04:49.702491 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee6d41-73aa-4d32-a067-41bc748462db None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:49.796508 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6b9fb-faf9-43e6-bbc8-fd4b7f60fe71 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:49.805616 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:49.821310 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee6d41-73aa-4d32-a067-41bc748462db None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:49.823853 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:49.838618 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31a3ac-a744-4b59-b7e5-70d8abf2ac8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:49.839356 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31a3ac-a744-4b59-b7e5-70d8abf2ac8e None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:49.839812 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31a3ac-a744-4b59-b7e5-70d8abf2ac8e None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:49.840161 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31a3ac-a744-4b59-b7e5-70d8abf2ac8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:49.853391 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a31a3ac-a744-4b59-b7e5-70d8abf2ac8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:49.855086 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a31a3ac-a744-4b59-b7e5-70d8abf2ac8e None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:49.866698 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c97307-f6af-4079-b8da-7d41ece1d522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:49.867352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c97307-f6af-4079-b8da-7d41ece1d522 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:49.867636 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c97307-f6af-4079-b8da-7d41ece1d522 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:49.867913 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c97307-f6af-4079-b8da-7d41ece1d522 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:49.873149 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-4a31a3ac-a744-4b59-b7e5-70d8abf2ac8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:04:49.873149 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:49.873149 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:49.873149 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:49.873149 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:49.873149 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:49.873149 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:49.873149 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:49.873149 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:49.873149 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:49.873149 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:49.873149 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:49.873149 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:04:49.873149 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:04:49.873149 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:04:49.873149 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:04:49.874027 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:49.874027 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:49.874027 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:49.874027 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:49.874027 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:49.874027 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:49.874027 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:49.874027 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:49.874027 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:49.874027 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:49.874027 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:49.874027 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:49.874027 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:49.874027 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:49.874027 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:49.874027 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:49.874027 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:04:49.874883 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:04:49.874883 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:04:49.874883 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:04:49.874883 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 233/469] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:04:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:49.875114 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31a3ac-a744-4b59-b7e5-70d8abf2ac8e None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:49.886277 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c97307-f6af-4079-b8da-7d41ece1d522 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:49.887743 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c97307-f6af-4079-b8da-7d41ece1d522 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:49.909104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-c3c97307-f6af-4079-b8da-7d41ece1d522 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:04:49.909104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:49.909104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:49.909104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:49.909104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:49.909104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:49.909104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:49.909104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:49.909104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:49.909104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:49.909104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:49.909104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:49.909104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:04:49.909104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:04:49.909104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:04:49.909104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:04:49.910052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:49.910052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:49.910052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:49.910052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:49.910052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:49.910052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:49.910052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:49.910052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:49.910052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:49.910052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:49.910052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:49.910052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:49.910052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:49.910052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:49.910052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:49.910052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:49.910052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:04:49.910943 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:04:49.910943 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:04:49.910943 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:04:49.910943 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 237/470] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:04:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:49.911575 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c97307-f6af-4079-b8da-7d41ece1d522 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:50.009331 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31a3ac-a744-4b59-b7e5-70d8abf2ac8e None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:50.043483 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c97307-f6af-4079-b8da-7d41ece1d522 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:50.054651 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c52c75-9b3c-4126-908d-2eb9b4eeaf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:50.055268 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c52c75-9b3c-4126-908d-2eb9b4eeaf35 None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:50.055825 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c52c75-9b3c-4126-908d-2eb9b4eeaf35 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:50.055944 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c52c75-9b3c-4126-908d-2eb9b4eeaf35 None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:50.056574 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c52c75-9b3c-4126-908d-2eb9b4eeaf35 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:50.058155 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c52c75-9b3c-4126-908d-2eb9b4eeaf35 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:50.081759 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 234/471] 10.222.0.79 () {60 vars in 1132 bytes} [Wed Aug 31 19:04:49 2022] POST /identity/v3/users => generated 248 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:04:50.081938 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67638ea0-61d9-4e14-a6c9-791fae82d3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:50.082585 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67638ea0-61d9-4e14-a6c9-791fae82d3d2 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:50.082865 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67638ea0-61d9-4e14-a6c9-791fae82d3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:50.083139 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67638ea0-61d9-4e14-a6c9-791fae82d3d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:50.083797 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67638ea0-61d9-4e14-a6c9-791fae82d3d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:50.084104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67638ea0-61d9-4e14-a6c9-791fae82d3d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:50.084215 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c52c75-9b3c-4126-908d-2eb9b4eeaf35 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:50.085563 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67638ea0-61d9-4e14-a6c9-791fae82d3d2 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:50.100231 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 238/472] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:50.101551 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac51a51-541e-4545-8c66-f9b94ad19444 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:50.102321 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac51a51-541e-4545-8c66-f9b94ad19444 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:50.102721 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac51a51-541e-4545-8c66-f9b94ad19444 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:50.106330 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:50.108226 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 239/473] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:50.109490 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0057b4-ffe3-4b21-b60e-34b789939715 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:50.109775 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0057b4-ffe3-4b21-b60e-34b789939715 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:50.110046 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0057b4-ffe3-4b21-b60e-34b789939715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:50.132005 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-ce0057b4-ffe3-4b21-b60e-34b789939715 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:50.133138 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ce0057b4-ffe3-4b21-b60e-34b789939715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:50.150963 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:50.218935 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 240/474] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:50.219956 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0057b4-ffe3-4b21-b60e-34b789939715 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:50.234425 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c52c75-9b3c-4126-908d-2eb9b4eeaf35 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:50.280649 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146383ad-f060-4d2b-b637-7d6d937145cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:50.281293 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146383ad-f060-4d2b-b637-7d6d937145cc None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:50.281576 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146383ad-f060-4d2b-b637-7d6d937145cc None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:50.281910 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146383ad-f060-4d2b-b637-7d6d937145cc None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:50.282604 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146383ad-f060-4d2b-b637-7d6d937145cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:50.282918 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146383ad-f060-4d2b-b637-7d6d937145cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:50.284840 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146383ad-f060-4d2b-b637-7d6d937145cc None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:50.298445 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 235/475] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:04:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:50.304673 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146383ad-f060-4d2b-b637-7d6d937145cc None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:50.358427 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0057b4-ffe3-4b21-b60e-34b789939715 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:50.399169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b322c7c-8b12-42af-ab3a-f216eb4ae7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:50.399837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b322c7c-8b12-42af-ab3a-f216eb4ae7bc None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:50.400141 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b322c7c-8b12-42af-ab3a-f216eb4ae7bc None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:50.400520 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b322c7c-8b12-42af-ab3a-f216eb4ae7bc None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:50.401825 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b322c7c-8b12-42af-ab3a-f216eb4ae7bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:50.403282 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:50.405179 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b322c7c-8b12-42af-ab3a-f216eb4ae7bc None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:50.435480 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146383ad-f060-4d2b-b637-7d6d937145cc None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:50.436503 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 241/476] 10.222.0.79 () {60 vars in 1132 bytes} [Wed Aug 31 19:04:50 2022] POST /identity/v3/users => generated 248 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:04:50.485103 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294fa7dd-0557-4e7b-9101-b91b6d19c2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:50.485884 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fa7dd-0557-4e7b-9101-b91b6d19c2e4 None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:50.486204 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fa7dd-0557-4e7b-9101-b91b6d19c2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:50.486506 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fa7dd-0557-4e7b-9101-b91b6d19c2e4 None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:50.487157 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294fa7dd-0557-4e7b-9101-b91b6d19c2e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:50.489062 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294fa7dd-0557-4e7b-9101-b91b6d19c2e4 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:50.518208 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 236/477] 10.222.0.79 () {60 vars in 1132 bytes} [Wed Aug 31 19:04:50 2022] POST /identity/v3/users => generated 249 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:04:50.526562 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b322c7c-8b12-42af-ab3a-f216eb4ae7bc None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:50.529755 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:50.658741 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b322c7c-8b12-42af-ab3a-f216eb4ae7bc None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:50.698705 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f1e00-e73c-45df-b5f6-974a4b5a950e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:50.699331 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f1e00-e73c-45df-b5f6-974a4b5a950e None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:50.699613 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f1e00-e73c-45df-b5f6-974a4b5a950e None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:50.699887 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f1e00-e73c-45df-b5f6-974a4b5a950e None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:50.700592 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f1e00-e73c-45df-b5f6-974a4b5a950e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:50.701981 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f1e00-e73c-45df-b5f6-974a4b5a950e None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:50.710648 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.sql.core [None req-8f6f1e00-e73c-45df-b5f6-974a4b5a950e None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 19:04:50.710648 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 31 19:04:50.710648 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [parameters: {'id': 'dcedad3e7eb94dd5b7bc3ac61a60b21b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 31 19:04:50.710648 dv-cinder-852210-6-smb devstack@keystone.service[81683]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81683) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 19:04:50.727744 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-8f6f1e00-e73c-45df-b5f6-974a4b5a950e None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 31 19:04:50.727744 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:50.727744 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 19:04:50.727744 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 19:04:50.727744 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 19:04:50.727744 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 19:04:50.727744 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 19:04:50.727744 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 19:04:50.727744 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 19:04:50.727744 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application conn.query(q) Aug 31 19:04:50.727744 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 19:04:50.727744 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 19:04:50.727744 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 19:04:50.727744 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application result.read() Aug 31 19:04:50.727744 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 19:04:50.728688 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 19:04:50.728688 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 19:04:50.728688 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 19:04:50.728688 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 19:04:50.728688 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 19:04:50.728688 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 19:04:50.728688 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 19:04:50.728688 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 19:04:50.728688 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:04:50.728688 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 19:04:50.728688 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:04:50.728688 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:50.728688 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 19:04:50.728688 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 19:04:50.728688 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 31 19:04:50.728688 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return ref.to_dict() Aug 31 19:04:50.728688 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 19:04:50.728688 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application next(self.gen) Aug 31 19:04:50.729583 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 19:04:50.729583 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application yield resource Aug 31 19:04:50.729583 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 19:04:50.729583 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application next(self.gen) Aug 31 19:04:50.729583 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 19:04:50.729583 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 19:04:50.729583 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 19:04:50.729583 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 19:04:50.729583 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 19:04:50.729583 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise self.value Aug 31 19:04:50.729583 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 19:04:50.729583 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 19:04:50.729583 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 19:04:50.729583 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application session.commit() Aug 31 19:04:50.729583 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 19:04:50.729583 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 19:04:50.729583 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 19:04:50.730418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 19:04:50.730418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 19:04:50.730418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self.session.flush() Aug 31 19:04:50.730418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 19:04:50.730418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 19:04:50.730418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 19:04:50.730418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 19:04:50.730418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 19:04:50.730418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application compat.raise_( Aug 31 19:04:50.730418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 19:04:50.730418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception Aug 31 19:04:50.730418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 19:04:50.730418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 19:04:50.730418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 19:04:50.730418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 19:04:50.730418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 19:04:50.730418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 19:04:50.731316 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 19:04:50.731316 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 19:04:50.731316 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 31 19:04:50.731316 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 31 19:04:50.731316 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 19:04:50.731316 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 19:04:50.731316 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 19:04:50.731316 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 19:04:50.731316 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 19:04:50.731316 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 19:04:50.731316 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 19:04:50.731316 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 19:04:50.731316 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 19:04:50.731316 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 19:04:50.731316 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 19:04:50.731316 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception Aug 31 19:04:50.732118 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 19:04:50.732118 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 19:04:50.732118 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 19:04:50.732118 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 19:04:50.732118 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 19:04:50.732118 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 19:04:50.732118 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 19:04:50.732118 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application conn.query(q) Aug 31 19:04:50.732118 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 19:04:50.732118 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 19:04:50.732118 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 19:04:50.732118 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application result.read() Aug 31 19:04:50.732118 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 19:04:50.732118 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 19:04:50.732118 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 19:04:50.732118 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 19:04:50.732902 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 19:04:50.732902 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 19:04:50.732902 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 19:04:50.732902 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 19:04:50.732902 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 19:04:50.732902 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 31 19:04:50.732902 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [parameters: {'id': 'dcedad3e7eb94dd5b7bc3ac61a60b21b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 31 19:04:50.732902 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 19:04:50.732902 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:04:50.732902 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:04:50.732902 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:04:50.732902 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:50.732902 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:50.732902 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:50.732902 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:50.732902 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:50.733697 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:50.733697 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:50.733697 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:50.733697 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:50.733697 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:50.733697 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:50.733697 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 31 19:04:50.733697 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 31 19:04:50.733697 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:50.733697 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:50.733697 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 31 19:04:50.733697 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 31 19:04:50.733697 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 19:04:50.733697 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 19:04:50.733697 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 31 19:04:50.733697 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:04:50.740005 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 242/478] 10.222.0.79 () {60 vars in 1131 bytes} [Wed Aug 31 19:04:50 2022] POST /identity/v3/roles => generated 144 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:04:50.741923 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294fa7dd-0557-4e7b-9101-b91b6d19c2e4 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:50.856133 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294fa7dd-0557-4e7b-9101-b91b6d19c2e4 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:50.890181 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:50.900953 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b91ba8-4bee-4009-8142-172ba22f5289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:50.901929 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b91ba8-4bee-4009-8142-172ba22f5289 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:50.902416 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b91ba8-4bee-4009-8142-172ba22f5289 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:50.902966 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b91ba8-4bee-4009-8142-172ba22f5289 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:50.915831 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b91ba8-4bee-4009-8142-172ba22f5289 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:50.921498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-21b91ba8-4bee-4009-8142-172ba22f5289 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:04:50.921498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:50.921498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:50.921498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:50.921498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:50.921498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:50.921498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:50.921498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:50.921498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:50.921498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:50.921498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:50.921498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:50.921498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:50.921498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:50.921498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:50.921498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:50.922594 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:50.922594 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:50.922594 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:50.922594 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:50.922594 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:50.922594 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:50.922594 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:50.922594 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:50.922594 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:50.922594 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:50.922594 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:50.922594 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:50.922594 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:50.922594 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:50.922594 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:50.922594 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:50.923666 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:50.923666 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:50.923666 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:50.923666 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:50.923666 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:50.923666 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:50.923666 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:50.923666 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:50.923666 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:50.923666 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:50.923666 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 19:04:50.923666 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:04:50.925935 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 237/479] 10.222.0.79 () {56 vars in 1114 bytes} [Wed Aug 31 19:04:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:50.931928 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f1e00-e73c-45df-b5f6-974a4b5a950e None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:51.006984 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:51.057803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f1e00-e73c-45df-b5f6-974a4b5a950e None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:51.101006 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab80b37-f564-4f7a-a06f-aae7ac363aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:51.101868 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab80b37-f564-4f7a-a06f-aae7ac363aa1 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:51.102146 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab80b37-f564-4f7a-a06f-aae7ac363aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:51.102411 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab80b37-f564-4f7a-a06f-aae7ac363aa1 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:51.103122 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab80b37-f564-4f7a-a06f-aae7ac363aa1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:51.103424 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab80b37-f564-4f7a-a06f-aae7ac363aa1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:51.104795 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab80b37-f564-4f7a-a06f-aae7ac363aa1 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:51.118670 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 243/480] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:04:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:52.009222 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe7fc0-177e-4c80-832e-91388d9c4d4f None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:52.011234 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe7fc0-177e-4c80-832e-91388d9c4d4f None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:52.011652 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe7fc0-177e-4c80-832e-91388d9c4d4f None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:52.013415 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 238/481] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:52.018732 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc51730-1581-4f31-9b2a-69f4a65bd149 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:52.019560 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc51730-1581-4f31-9b2a-69f4a65bd149 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:52.019982 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc51730-1581-4f31-9b2a-69f4a65bd149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:52.048561 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-fbc51730-1581-4f31-9b2a-69f4a65bd149 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:52.050394 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-fbc51730-1581-4f31-9b2a-69f4a65bd149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:52.149693 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 244/482] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:52.569861 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe7fc0-177e-4c80-832e-91388d9c4d4f None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:52.679903 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbc6da-30d5-4ace-b619-fb822636b92f None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:52.680555 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbc6da-30d5-4ace-b619-fb822636b92f None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:52.681046 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbc6da-30d5-4ace-b619-fb822636b92f None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:52.683736 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 245/483] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:52.690949 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ed285-1100-4cb1-a1f9-83a0315ccca8 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:52.691504 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ed285-1100-4cb1-a1f9-83a0315ccca8 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:52.692257 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ed285-1100-4cb1-a1f9-83a0315ccca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:52.715400 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe7fc0-177e-4c80-832e-91388d9c4d4f None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:52.724141 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-114ed285-1100-4cb1-a1f9-83a0315ccca8 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:52.725379 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-114ed285-1100-4cb1-a1f9-83a0315ccca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:52.757092 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed22ccc-4caf-47d9-a8c4-ef88c0c61545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:52.757735 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed22ccc-4caf-47d9-a8c4-ef88c0c61545 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:52.758018 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed22ccc-4caf-47d9-a8c4-ef88c0c61545 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:52.758291 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed22ccc-4caf-47d9-a8c4-ef88c0c61545 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:52.770339 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed22ccc-4caf-47d9-a8c4-ef88c0c61545 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:52.777698 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-4ed22ccc-4caf-47d9-a8c4-ef88c0c61545 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:04:52.777698 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:52.777698 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:52.777698 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:52.777698 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:52.777698 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:52.777698 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:52.777698 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:52.777698 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:52.777698 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:52.777698 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:52.777698 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:52.777698 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:52.777698 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:52.777698 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:52.777698 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:52.778611 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:52.778611 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:52.778611 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:52.778611 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:52.778611 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:52.778611 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:52.778611 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:52.778611 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:52.778611 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:52.778611 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:52.778611 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:52.778611 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:52.778611 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:52.778611 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:52.778611 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:52.778611 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:52.779415 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:52.779415 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:52.779415 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:52.779415 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:52.779415 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:52.779415 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:52.779415 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:52.779415 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:52.779415 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:52.779415 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:52.779415 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:04:52.779415 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:04:52.779415 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 239/484] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 19:04:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:52.784540 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed22ccc-4caf-47d9-a8c4-ef88c0c61545 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:52.819241 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:52.837953 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 246/485] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:52.889432 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:52.958789 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed22ccc-4caf-47d9-a8c4-ef88c0c61545 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:52.998013 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9f188-6092-4773-9fcc-34e8cc4d9982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:52.998997 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9f188-6092-4773-9fcc-34e8cc4d9982 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:52.999478 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9f188-6092-4773-9fcc-34e8cc4d9982 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:52.999982 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9f188-6092-4773-9fcc-34e8cc4d9982 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:53.000866 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9f188-6092-4773-9fcc-34e8cc4d9982 None admin] RBAC: Adding query filter params (name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:53.001430 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9f188-6092-4773-9fcc-34e8cc4d9982 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:53.003062 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9f188-6092-4773-9fcc-34e8cc4d9982 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:53.012918 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 240/486] 10.222.0.79 () {56 vars in 1103 bytes} [Wed Aug 31 19:04:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:53.019595 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ed285-1100-4cb1-a1f9-83a0315ccca8 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:53.081721 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c67a5d-cc31-4929-a11e-000f13c0719d None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:53.082373 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c67a5d-cc31-4929-a11e-000f13c0719d None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:53.082872 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c67a5d-cc31-4929-a11e-000f13c0719d None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:53.085174 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 241/487] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:53.092570 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c21e46-baf3-4fe8-bccd-541eb54e15da None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:53.093275 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c21e46-baf3-4fe8-bccd-541eb54e15da None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:53.093753 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c21e46-baf3-4fe8-bccd-541eb54e15da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:53.137925 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-e7c21e46-baf3-4fe8-bccd-541eb54e15da None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:53.139163 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-e7c21e46-baf3-4fe8-bccd-541eb54e15da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:53.186738 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ed285-1100-4cb1-a1f9-83a0315ccca8 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:53.246686 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9b606-a6ed-4b7b-8d7b-01e50ee9edf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:53.247325 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9b606-a6ed-4b7b-8d7b-01e50ee9edf0 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:53.247611 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9b606-a6ed-4b7b-8d7b-01e50ee9edf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:53.247887 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9b606-a6ed-4b7b-8d7b-01e50ee9edf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:53.254026 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 242/488] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:53.257794 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c21e46-baf3-4fe8-bccd-541eb54e15da None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:53.259211 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a9b606-a6ed-4b7b-8d7b-01e50ee9edf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:53.260691 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a9b606-a6ed-4b7b-8d7b-01e50ee9edf0 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:53.279009 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-73a9b606-a6ed-4b7b-8d7b-01e50ee9edf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:04:53.279009 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:53.279009 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:53.279009 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:53.279009 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:53.279009 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:53.279009 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:53.279009 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:53.279009 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:53.279009 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:53.279009 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:53.279009 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:53.279009 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:04:53.279009 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:04:53.279009 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:04:53.279009 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:04:53.279958 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:53.279958 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:53.279958 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:53.279958 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:53.279958 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:53.279958 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:53.279958 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:53.279958 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:53.279958 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:53.279958 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:53.279958 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:53.279958 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:53.279958 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:53.279958 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:53.279958 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:53.279958 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:53.279958 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:04:53.280812 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:04:53.280812 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:04:53.280812 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:04:53.280812 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 247/489] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:04:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:53.285994 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f7c01-d010-4c38-b3b8-960df4131362 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:53.285994 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f7c01-d010-4c38-b3b8-960df4131362 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:53.285994 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f7c01-d010-4c38-b3b8-960df4131362 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:53.285994 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 248/490] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:53.286663 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f7c01-d010-4c38-b3b8-960df4131362 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:53.326678 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:53.338327 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:53.380638 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c21e46-baf3-4fe8-bccd-541eb54e15da None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:53.405599 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f7c01-d010-4c38-b3b8-960df4131362 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:53.415993 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4a31b-51c4-4844-ba79-53ed03838394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:53.416871 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4a31b-51c4-4844-ba79-53ed03838394 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:53.417322 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4a31b-51c4-4844-ba79-53ed03838394 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:53.417764 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4a31b-51c4-4844-ba79-53ed03838394 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:53.428961 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf4a31b-51c4-4844-ba79-53ed03838394 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:53.434102 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-edf4a31b-51c4-4844-ba79-53ed03838394 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:04:53.434102 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:53.434102 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:53.434102 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:53.434102 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:53.434102 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:53.434102 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:53.434102 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:53.434102 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:53.434102 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:53.434102 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:53.434102 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:53.434102 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:53.434102 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:53.434102 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:53.434102 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:53.434994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:53.434994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:53.434994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:53.434994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:53.434994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:53.434994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:53.434994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:53.434994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:53.434994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:53.434994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:53.434994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:53.434994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:53.434994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:53.434994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:53.434994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:53.434994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:53.435787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:53.435787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:53.435787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:53.435787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:53.435787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:53.435787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:53.435787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:53.435787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:53.435787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:53.435787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:53.435787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:04:53.435787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:04:53.438325 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 243/491] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 19:04:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:53.440857 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfb8d1-a6bc-4480-a2c1-ca4e3c84c093 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:53.441342 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfb8d1-a6bc-4480-a2c1-ca4e3c84c093 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:53.441787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfb8d1-a6bc-4480-a2c1-ca4e3c84c093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:53.448238 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b4967-6826-4c7f-9de8-adad3f1c9241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:53.448984 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b4967-6826-4c7f-9de8-adad3f1c9241 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:53.449247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b4967-6826-4c7f-9de8-adad3f1c9241 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:53.449522 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b4967-6826-4c7f-9de8-adad3f1c9241 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:53.450178 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b4967-6826-4c7f-9de8-adad3f1c9241 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:53.451350 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b4967-6826-4c7f-9de8-adad3f1c9241 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:53.451992 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b4967-6826-4c7f-9de8-adad3f1c9241 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:53.462336 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-f3cfb8d1-a6bc-4480-a2c1-ca4e3c84c093 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:53.463846 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f3cfb8d1-a6bc-4480-a2c1-ca4e3c84c093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:53.470273 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 249/492] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:53.470273 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b4967-6826-4c7f-9de8-adad3f1c9241 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:53.551027 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 244/493] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:53.552231 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfb8d1-a6bc-4480-a2c1-ca4e3c84c093 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:53.576623 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:53.581443 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b4967-6826-4c7f-9de8-adad3f1c9241 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:53.593219 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:53.624316 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b1de3-0510-4410-85b6-c96453edbe1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:53.625083 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b1de3-0510-4410-85b6-c96453edbe1d None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:53.625661 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b1de3-0510-4410-85b6-c96453edbe1d None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:53.625941 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b1de3-0510-4410-85b6-c96453edbe1d None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:53.627427 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b1de3-0510-4410-85b6-c96453edbe1d None admin] RBAC: Adding query filter params (name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:53.627731 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b1de3-0510-4410-85b6-c96453edbe1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:53.629913 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b1de3-0510-4410-85b6-c96453edbe1d None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:53.639342 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 250/494] 10.222.0.79 () {56 vars in 1103 bytes} [Wed Aug 31 19:04:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:53.640139 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b1de3-0510-4410-85b6-c96453edbe1d None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:53.668985 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfb8d1-a6bc-4480-a2c1-ca4e3c84c093 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:53.705741 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b220c25-850a-4072-a6d0-b85d0f4b389d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:53.706397 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b220c25-850a-4072-a6d0-b85d0f4b389d None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:53.706706 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b220c25-850a-4072-a6d0-b85d0f4b389d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:53.707161 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b220c25-850a-4072-a6d0-b85d0f4b389d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:53.715759 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b220c25-850a-4072-a6d0-b85d0f4b389d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:53.717194 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b220c25-850a-4072-a6d0-b85d0f4b389d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:53.730892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-5b220c25-850a-4072-a6d0-b85d0f4b389d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:04:53.730892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:53.730892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:53.730892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:53.730892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:53.730892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:53.730892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:53.730892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:53.730892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:53.730892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:53.730892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:53.730892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:53.730892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:04:53.730892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:04:53.730892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:04:53.730892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:04:53.732034 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:53.732034 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:53.732034 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:04:53.732034 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:04:53.732034 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:04:53.732034 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:04:53.732034 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:53.732034 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:53.732034 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:53.732034 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:53.732034 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:53.732034 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:53.732034 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:53.732034 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:53.732034 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:53.732034 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:53.732034 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:53.732034 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:53.733292 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:53.733292 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:53.733292 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:04:53.733292 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:04:53.733292 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:04:53.733292 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:04:53.733292 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:04:53.733292 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:04:53.733292 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:04:53.733292 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:04:53.733292 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 245/495] 10.222.0.79 () {56 vars in 1093 bytes} [Wed Aug 31 19:04:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:53.733292 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a49247-05b4-4880-92a9-d7edfcdb1e71 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:53.734240 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a49247-05b4-4880-92a9-d7edfcdb1e71 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:53.734240 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a49247-05b4-4880-92a9-d7edfcdb1e71 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:53.741302 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 246/496] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:53.741302 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a49247-05b4-4880-92a9-d7edfcdb1e71 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:53.754177 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b1de3-0510-4410-85b6-c96453edbe1d None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:53.789952 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02ed19-e0c0-4a76-bdb0-57598a7930bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:53.790594 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02ed19-e0c0-4a76-bdb0-57598a7930bb None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:53.790870 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02ed19-e0c0-4a76-bdb0-57598a7930bb None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:53.791135 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02ed19-e0c0-4a76-bdb0-57598a7930bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:53.801756 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02ed19-e0c0-4a76-bdb0-57598a7930bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:53.806936 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-1b02ed19-e0c0-4a76-bdb0-57598a7930bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:04:53.806936 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:53.806936 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:53.806936 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:53.806936 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:53.806936 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:53.806936 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:53.806936 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:53.806936 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:53.806936 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:53.806936 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:53.806936 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:53.806936 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:53.806936 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:53.806936 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:53.806936 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:53.807797 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:53.807797 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:53.807797 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:53.807797 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:53.807797 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:53.807797 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:53.807797 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:53.807797 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:53.807797 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:53.807797 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:53.807797 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:53.807797 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:53.807797 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:53.807797 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:53.807797 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:53.807797 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:53.808613 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:53.808613 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:53.808613 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:53.808613 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:53.808613 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:53.808613 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:53.808613 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:53.808613 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:53.808613 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:53.808613 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:53.808613 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:04:53.808613 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:04:53.808613 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 251/497] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 19:04:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:53.809742 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a8b2a-d5eb-44b7-a202-3895aee2294b None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:53.809944 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a8b2a-d5eb-44b7-a202-3895aee2294b None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:53.810218 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a8b2a-d5eb-44b7-a202-3895aee2294b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:53.828398 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-e48a8b2a-d5eb-44b7-a202-3895aee2294b None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:53.829960 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e48a8b2a-d5eb-44b7-a202-3895aee2294b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:53.846551 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:53.846698 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:53.857745 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a49247-05b4-4880-92a9-d7edfcdb1e71 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:53.892298 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf8d5d-e86e-4e76-a7d0-56b661eb21ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:53.892916 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf8d5d-e86e-4e76-a7d0-56b661eb21ef None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:53.893188 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf8d5d-e86e-4e76-a7d0-56b661eb21ef None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:53.893453 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf8d5d-e86e-4e76-a7d0-56b661eb21ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:53.896807 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 252/498] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:53.897643 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a8b2a-d5eb-44b7-a202-3895aee2294b None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:53.904125 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf8d5d-e86e-4e76-a7d0-56b661eb21ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:53.905567 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf8d5d-e86e-4e76-a7d0-56b661eb21ef None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:53.921534 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-f0bf8d5d-e86e-4e76-a7d0-56b661eb21ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:04:53.921534 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:53.921534 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:53.921534 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:53.921534 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:53.921534 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:53.921534 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:53.921534 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:53.921534 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:53.921534 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:53.921534 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:53.921534 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:53.921534 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:04:53.921534 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:04:53.921534 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:04:53.921534 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:04:53.922481 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:53.922481 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:53.922481 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:53.922481 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:53.922481 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:53.922481 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:53.922481 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:53.922481 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:53.922481 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:53.922481 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:53.922481 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:53.922481 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:53.922481 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:53.922481 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:53.922481 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:53.922481 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:53.922481 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:04:53.923370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:04:53.923370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:04:53.923370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:04:53.923370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 247/499] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:04:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:53.923662 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf8d5d-e86e-4e76-a7d0-56b661eb21ef None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:54.021466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a8b2a-d5eb-44b7-a202-3895aee2294b None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:54.035424 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf8d5d-e86e-4e76-a7d0-56b661eb21ef None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:54.057742 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5cf71d-3778-445d-87e1-e18f0daae795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:54.058366 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cf71d-3778-445d-87e1-e18f0daae795 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:54.058670 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cf71d-3778-445d-87e1-e18f0daae795 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:54.058945 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cf71d-3778-445d-87e1-e18f0daae795 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:54.059678 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5cf71d-3778-445d-87e1-e18f0daae795 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:54.060109 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5cf71d-3778-445d-87e1-e18f0daae795 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:54.061416 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5cf71d-3778-445d-87e1-e18f0daae795 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:54.071287 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbb6b6-f229-4523-85c3-ac1ee452e6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:54.071891 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbb6b6-f229-4523-85c3-ac1ee452e6b5 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:54.072176 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbb6b6-f229-4523-85c3-ac1ee452e6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:54.072443 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbb6b6-f229-4523-85c3-ac1ee452e6b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:54.073113 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cbb6b6-f229-4523-85c3-ac1ee452e6b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:54.073416 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cbb6b6-f229-4523-85c3-ac1ee452e6b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:54.074792 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cbb6b6-f229-4523-85c3-ac1ee452e6b5 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:54.083918 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 248/500] 10.222.0.79 () {56 vars in 1103 bytes} [Wed Aug 31 19:04:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:54.088925 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbb6b6-f229-4523-85c3-ac1ee452e6b5 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:54.098710 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:54.104441 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 253/501] 10.222.0.79 () {56 vars in 1133 bytes} [Wed Aug 31 19:04:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:54.104441 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5cf71d-3778-445d-87e1-e18f0daae795 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:54.117466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:54.201181 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbb6b6-f229-4523-85c3-ac1ee452e6b5 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:54.209239 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5cf71d-3778-445d-87e1-e18f0daae795 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:54.235117 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d7e61-abbf-4321-8543-51861b0c36d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:54.235736 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d7e61-abbf-4321-8543-51861b0c36d3 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:54.236040 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d7e61-abbf-4321-8543-51861b0c36d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:54.236811 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d7e61-abbf-4321-8543-51861b0c36d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:54.243800 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85715904-7a2a-4582-85e1-7e6964e8a0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:54.244524 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85715904-7a2a-4582-85e1-7e6964e8a0a2 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:54.244803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85715904-7a2a-4582-85e1-7e6964e8a0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:54.245072 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85715904-7a2a-4582-85e1-7e6964e8a0a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:54.245712 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85715904-7a2a-4582-85e1-7e6964e8a0a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:54.246014 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85715904-7a2a-4582-85e1-7e6964e8a0a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:54.246831 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d7e61-abbf-4321-8543-51861b0c36d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:54.247421 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85715904-7a2a-4582-85e1-7e6964e8a0a2 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:54.252612 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-406d7e61-abbf-4321-8543-51861b0c36d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:04:54.252612 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:54.252612 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:54.252612 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:54.252612 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:54.252612 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:54.252612 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:54.252612 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:54.252612 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:54.252612 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:54.252612 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:54.252612 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:54.252612 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:54.252612 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:54.252612 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:54.252612 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:54.253626 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:54.253626 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:54.253626 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:54.253626 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:54.253626 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:54.253626 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:54.253626 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:54.253626 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:54.253626 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:54.253626 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:54.253626 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:54.253626 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:54.253626 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:54.253626 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:54.253626 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:54.253626 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:54.254523 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:54.254523 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:54.254523 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:54.254523 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:54.254523 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:54.254523 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:54.254523 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:54.254523 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:54.254523 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:54.254523 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:54.254523 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:04:54.254523 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:04:54.258574 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 249/502] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 19:04:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:54.259402 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d7e61-abbf-4321-8543-51861b0c36d3 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:54.259575 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 254/503] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:54.260417 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85715904-7a2a-4582-85e1-7e6964e8a0a2 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:54.324179 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:54.329160 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:54.360123 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d7e61-abbf-4321-8543-51861b0c36d3 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:54.362600 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85715904-7a2a-4582-85e1-7e6964e8a0a2 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:54.393525 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b580f35-4eb6-40ab-9f99-c402396eb623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:54.394144 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b580f35-4eb6-40ab-9f99-c402396eb623 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:54.394419 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b580f35-4eb6-40ab-9f99-c402396eb623 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:54.394722 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b580f35-4eb6-40ab-9f99-c402396eb623 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:54.394839 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24c90c-d55d-45f5-ab55-78f038fac24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:54.395448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24c90c-d55d-45f5-ab55-78f038fac24d None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:54.395791 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24c90c-d55d-45f5-ab55-78f038fac24d None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:54.396006 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24c90c-d55d-45f5-ab55-78f038fac24d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:54.405159 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b580f35-4eb6-40ab-9f99-c402396eb623 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:54.406635 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b580f35-4eb6-40ab-9f99-c402396eb623 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:54.421129 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-7b580f35-4eb6-40ab-9f99-c402396eb623 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:04:54.421129 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:54.421129 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:54.421129 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:54.421129 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:54.421129 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:54.421129 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:54.421129 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:54.421129 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:54.421129 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:54.421129 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:54.421129 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:54.421129 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:04:54.421129 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:04:54.421129 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:04:54.421129 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:04:54.422049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:54.422049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:54.422049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:54.422049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:54.422049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:54.422049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:54.422049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:54.422049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:54.422049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:54.422049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:54.422049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:54.422049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:54.422049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:54.422049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:54.422049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:54.422049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:54.422049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:04:54.422938 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:04:54.422938 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:04:54.422938 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:04:54.422938 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 250/504] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:04:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:54.423151 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b580f35-4eb6-40ab-9f99-c402396eb623 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:54.469265 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b24c90c-d55d-45f5-ab55-78f038fac24d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:54.470774 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b24c90c-d55d-45f5-ab55-78f038fac24d None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:54.522535 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b580f35-4eb6-40ab-9f99-c402396eb623 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:54.540921 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:54.541696 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:54.558119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88680166-e944-44a4-b86e-8c7ae37a295c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:54.558813 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88680166-e944-44a4-b86e-8c7ae37a295c None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:54.559094 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88680166-e944-44a4-b86e-8c7ae37a295c None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:54.559367 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88680166-e944-44a4-b86e-8c7ae37a295c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:54.570862 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88680166-e944-44a4-b86e-8c7ae37a295c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:54.572319 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88680166-e944-44a4-b86e-8c7ae37a295c None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:54.573784 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 255/505] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:04:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:04:54.574644 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24c90c-d55d-45f5-ab55-78f038fac24d None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:54.591661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-88680166-e944-44a4-b86e-8c7ae37a295c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:04:54.591661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:54.591661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:54.591661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:54.591661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:54.591661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:54.591661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:54.591661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:54.591661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:54.591661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:54.591661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:54.591661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:54.591661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:04:54.591661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:04:54.591661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:04:54.591661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:04:54.592615 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:54.592615 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:54.592615 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:54.592615 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:54.592615 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:54.592615 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:54.592615 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:54.592615 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:54.592615 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:54.592615 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:54.592615 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:54.592615 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:54.592615 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:54.592615 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:54.592615 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:54.592615 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:54.592615 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:04:54.593464 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:04:54.593464 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:04:54.593464 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:04:54.593464 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 251/506] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:04:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:54.593961 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88680166-e944-44a4-b86e-8c7ae37a295c None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:54.677759 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24c90c-d55d-45f5-ab55-78f038fac24d None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:54.696330 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88680166-e944-44a4-b86e-8c7ae37a295c None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:54.712330 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcc20b-bd0a-481a-a9d5-3680e15e0da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:54.712938 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcc20b-bd0a-481a-a9d5-3680e15e0da5 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:54.713218 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcc20b-bd0a-481a-a9d5-3680e15e0da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:54.713494 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcc20b-bd0a-481a-a9d5-3680e15e0da5 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:54.714156 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fcc20b-bd0a-481a-a9d5-3680e15e0da5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:54.714479 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fcc20b-bd0a-481a-a9d5-3680e15e0da5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:54.715868 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fcc20b-bd0a-481a-a9d5-3680e15e0da5 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:54.724236 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 256/507] 10.222.0.79 () {56 vars in 1103 bytes} [Wed Aug 31 19:04:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:54.724236 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcc20b-bd0a-481a-a9d5-3680e15e0da5 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:54.731961 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b520d-21a5-4ec2-89ed-6421d0b71501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:54.732585 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b520d-21a5-4ec2-89ed-6421d0b71501 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:54.732861 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b520d-21a5-4ec2-89ed-6421d0b71501 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:54.733130 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b520d-21a5-4ec2-89ed-6421d0b71501 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:54.740648 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7b520d-21a5-4ec2-89ed-6421d0b71501 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:54.742067 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7b520d-21a5-4ec2-89ed-6421d0b71501 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:54.752965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-4d7b520d-21a5-4ec2-89ed-6421d0b71501 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 19:04:54.752965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:54.752965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:54.752965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:54.752965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:54.752965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:54.752965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:54.752965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:54.752965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:54.752965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:54.752965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:54.752965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:54.752965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:04:54.752965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:04:54.752965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:04:54.752965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:04:54.753818 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:54.753818 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:54.753818 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:04:54.753818 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:04:54.753818 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:04:54.753818 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:04:54.753818 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:54.753818 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:54.753818 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:54.753818 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:54.753818 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:54.753818 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:54.753818 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:54.753818 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:54.753818 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:54.753818 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:54.753818 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:54.753818 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:54.754729 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:54.754729 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:54.754729 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:04:54.754729 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:04:54.754729 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:04:54.754729 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:04:54.754729 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:04:54.754729 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:04:54.754729 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 19:04:54.754729 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:04:54.754729 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 252/508] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:04:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:54.755285 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b520d-21a5-4ec2-89ed-6421d0b71501 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:54.762279 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:54.786105 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:54.833765 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcc20b-bd0a-481a-a9d5-3680e15e0da5 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:54.857591 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b520d-21a5-4ec2-89ed-6421d0b71501 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:54.867011 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68773f9b-da9f-43e7-b352-d9e3eaa0293d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:54.867609 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68773f9b-da9f-43e7-b352-d9e3eaa0293d None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:54.867886 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68773f9b-da9f-43e7-b352-d9e3eaa0293d None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:54.868153 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68773f9b-da9f-43e7-b352-d9e3eaa0293d None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:54.868790 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68773f9b-da9f-43e7-b352-d9e3eaa0293d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:54.869086 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68773f9b-da9f-43e7-b352-d9e3eaa0293d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:54.870436 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68773f9b-da9f-43e7-b352-d9e3eaa0293d None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:54.882446 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 257/509] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:54.883256 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68773f9b-da9f-43e7-b352-d9e3eaa0293d None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:54.894376 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da6b1a-f82c-4715-9cba-7c6a61bbe087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:54.895038 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da6b1a-f82c-4715-9cba-7c6a61bbe087 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:54.895316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da6b1a-f82c-4715-9cba-7c6a61bbe087 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:54.895592 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da6b1a-f82c-4715-9cba-7c6a61bbe087 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:54.905910 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1da6b1a-f82c-4715-9cba-7c6a61bbe087 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:54.907366 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1da6b1a-f82c-4715-9cba-7c6a61bbe087 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:54.921727 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-b1da6b1a-f82c-4715-9cba-7c6a61bbe087 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:04:54.921727 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:54.921727 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:54.921727 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:54.921727 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:54.921727 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:54.921727 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:54.921727 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:54.921727 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:54.921727 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:54.921727 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:54.921727 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:54.921727 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:04:54.921727 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:04:54.921727 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:04:54.921727 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:04:54.922697 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:54.922697 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:54.922697 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:54.922697 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:54.922697 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:54.922697 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:54.922697 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:54.922697 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:54.922697 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:54.922697 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:54.922697 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:54.922697 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:54.922697 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:54.922697 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:54.922697 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:54.922697 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:54.922697 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:04:54.923590 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:04:54.923590 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:04:54.923590 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:04:54.923590 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 253/510] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:04:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:54.923590 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da6b1a-f82c-4715-9cba-7c6a61bbe087 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:54.975532 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:54.984735 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68773f9b-da9f-43e7-b352-d9e3eaa0293d None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:55.002530 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:55.018111 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c04e1-057b-4ff6-8c88-e47ca6be4ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:55.018745 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c04e1-057b-4ff6-8c88-e47ca6be4ed9 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:55.019020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c04e1-057b-4ff6-8c88-e47ca6be4ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:55.019282 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c04e1-057b-4ff6-8c88-e47ca6be4ed9 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:55.019913 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c04e1-057b-4ff6-8c88-e47ca6be4ed9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:55.020208 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c04e1-057b-4ff6-8c88-e47ca6be4ed9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:55.020912 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da6b1a-f82c-4715-9cba-7c6a61bbe087 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:55.021549 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c04e1-057b-4ff6-8c88-e47ca6be4ed9 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:55.032583 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 258/511] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:55.033916 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c04e1-057b-4ff6-8c88-e47ca6be4ed9 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:55.059731 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1120d1-fafe-4ded-93a9-20009ea7c48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:55.060359 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1120d1-fafe-4ded-93a9-20009ea7c48d None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:55.060637 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1120d1-fafe-4ded-93a9-20009ea7c48d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:55.060931 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1120d1-fafe-4ded-93a9-20009ea7c48d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:55.072312 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1120d1-fafe-4ded-93a9-20009ea7c48d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:55.073823 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1120d1-fafe-4ded-93a9-20009ea7c48d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:55.089424 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-aa1120d1-fafe-4ded-93a9-20009ea7c48d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:04:55.089424 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:55.089424 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:55.089424 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:55.089424 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:55.089424 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:55.089424 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:55.089424 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:55.089424 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:55.089424 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:55.089424 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:55.089424 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:55.089424 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:04:55.089424 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:04:55.089424 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:04:55.089424 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:04:55.090557 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:55.090557 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:55.090557 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:55.090557 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:55.090557 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:55.090557 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:55.090557 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:55.090557 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:55.090557 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:55.090557 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:55.090557 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:55.090557 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:55.090557 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:55.090557 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:55.090557 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:55.090557 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:55.090557 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:04:55.091401 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:04:55.091401 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:04:55.091401 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:04:55.091401 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 254/512] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:04:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:55.091619 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1120d1-fafe-4ded-93a9-20009ea7c48d None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:55.138882 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c04e1-057b-4ff6-8c88-e47ca6be4ed9 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:55.173437 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84d2f3-697a-4f87-9970-3203624e2664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:55.174046 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84d2f3-697a-4f87-9970-3203624e2664 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:55.174326 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84d2f3-697a-4f87-9970-3203624e2664 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:55.174640 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84d2f3-697a-4f87-9970-3203624e2664 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:55.175426 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a84d2f3-697a-4f87-9970-3203624e2664 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:55.175679 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a84d2f3-697a-4f87-9970-3203624e2664 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:55.177114 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a84d2f3-697a-4f87-9970-3203624e2664 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:55.194898 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 259/513] 10.222.0.79 () {56 vars in 1137 bytes} [Wed Aug 31 19:04:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:55.195616 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84d2f3-697a-4f87-9970-3203624e2664 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:55.196418 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1120d1-fafe-4ded-93a9-20009ea7c48d None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:55.207689 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:55.232596 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882661af-20ca-440c-bb06-b7196da800c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:55.233152 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882661af-20ca-440c-bb06-b7196da800c7 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:55.233431 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882661af-20ca-440c-bb06-b7196da800c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:55.233700 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882661af-20ca-440c-bb06-b7196da800c7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:55.235616 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:55.242820 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882661af-20ca-440c-bb06-b7196da800c7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:55.244303 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882661af-20ca-440c-bb06-b7196da800c7 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:55.255951 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-882661af-20ca-440c-bb06-b7196da800c7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 19:04:55.255951 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:55.255951 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:55.255951 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:55.255951 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:55.255951 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:55.255951 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:55.255951 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:55.255951 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:55.255951 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:55.255951 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:55.255951 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:55.255951 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:04:55.255951 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:04:55.255951 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:04:55.255951 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:04:55.256885 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:55.256885 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:55.256885 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:04:55.256885 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:04:55.256885 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:04:55.256885 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:04:55.256885 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:55.256885 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:55.256885 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:55.256885 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:55.256885 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:55.256885 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:55.256885 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:55.256885 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:55.256885 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:55.256885 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:55.256885 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:55.256885 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:55.257762 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:55.257762 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:55.257762 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:04:55.257762 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:04:55.257762 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:04:55.257762 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:04:55.257762 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:04:55.257762 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:04:55.257762 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 19:04:55.257762 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:04:55.257762 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 255/514] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 19:04:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:55.258307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882661af-20ca-440c-bb06-b7196da800c7 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:55.298580 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84d2f3-697a-4f87-9970-3203624e2664 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:55.332802 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52280373-c6a8-4204-a971-d24093b3ce93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:55.333407 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52280373-c6a8-4204-a971-d24093b3ce93 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:55.333719 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52280373-c6a8-4204-a971-d24093b3ce93 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:55.333948 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52280373-c6a8-4204-a971-d24093b3ce93 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:55.334617 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52280373-c6a8-4204-a971-d24093b3ce93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:55.334914 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52280373-c6a8-4204-a971-d24093b3ce93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:55.336274 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52280373-c6a8-4204-a971-d24093b3ce93 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:55.347058 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 260/515] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:04:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:55.347830 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52280373-c6a8-4204-a971-d24093b3ce93 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:55.357672 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882661af-20ca-440c-bb06-b7196da800c7 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:55.391887 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543f1c9-c657-4281-ba88-6c726cb631f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:55.393012 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543f1c9-c657-4281-ba88-6c726cb631f3 None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:55.393283 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543f1c9-c657-4281-ba88-6c726cb631f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:55.393551 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543f1c9-c657-4281-ba88-6c726cb631f3 None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:55.394189 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543f1c9-c657-4281-ba88-6c726cb631f3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:55.395639 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543f1c9-c657-4281-ba88-6c726cb631f3 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:55.417053 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 256/516] 10.222.0.79 () {60 vars in 1132 bytes} [Wed Aug 31 19:04:55 2022] POST /identity/v3/users => generated 247 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:04:55.417833 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543f1c9-c657-4281-ba88-6c726cb631f3 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:55.420970 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:55.459305 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52280373-c6a8-4204-a971-d24093b3ce93 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:55.480831 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:55.499101 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe03d46-111a-4180-925a-26a7f819d741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:55.499626 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe03d46-111a-4180-925a-26a7f819d741 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:55.499904 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe03d46-111a-4180-925a-26a7f819d741 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:55.500176 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe03d46-111a-4180-925a-26a7f819d741 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:55.500826 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe03d46-111a-4180-925a-26a7f819d741 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:55.501135 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe03d46-111a-4180-925a-26a7f819d741 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:55.503145 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe03d46-111a-4180-925a-26a7f819d741 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:55.527328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 261/517] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:04:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:55.527328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe03d46-111a-4180-925a-26a7f819d741 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:55.553812 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543f1c9-c657-4281-ba88-6c726cb631f3 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:55.595002 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b3bf1-6a2a-4708-a8a0-1b04ca0cee7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:55.595204 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b3bf1-6a2a-4708-a8a0-1b04ca0cee7a None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:55.595441 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b3bf1-6a2a-4708-a8a0-1b04ca0cee7a None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:55.595679 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b3bf1-6a2a-4708-a8a0-1b04ca0cee7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:55.643698 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe03d46-111a-4180-925a-26a7f819d741 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:55.673122 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105b3bf1-6a2a-4708-a8a0-1b04ca0cee7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:55.674884 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:55.675016 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105b3bf1-6a2a-4708-a8a0-1b04ca0cee7a None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:55.681669 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd8526-48dd-4363-8b64-4cacd00da0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:55.682283 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd8526-48dd-4363-8b64-4cacd00da0f9 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:55.682590 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd8526-48dd-4363-8b64-4cacd00da0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:55.683268 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd8526-48dd-4363-8b64-4cacd00da0f9 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:55.684026 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd8526-48dd-4363-8b64-4cacd00da0f9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:55.684332 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd8526-48dd-4363-8b64-4cacd00da0f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:55.686127 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd8526-48dd-4363-8b64-4cacd00da0f9 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:55.706061 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 262/518] 10.222.0.79 () {56 vars in 1139 bytes} [Wed Aug 31 19:04:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:55.707047 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd8526-48dd-4363-8b64-4cacd00da0f9 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:55.730672 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:55.788202 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 257/519] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:04:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:04:55.788202 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b3bf1-6a2a-4708-a8a0-1b04ca0cee7a None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:55.822050 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd8526-48dd-4363-8b64-4cacd00da0f9 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:55.858344 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7a873-0845-4fea-84f3-bd7cee287f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:55.859002 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7a873-0845-4fea-84f3-bd7cee287f7e None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:55.859278 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7a873-0845-4fea-84f3-bd7cee287f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:55.859550 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7a873-0845-4fea-84f3-bd7cee287f7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:55.866407 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a7a873-0845-4fea-84f3-bd7cee287f7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:55.867877 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a7a873-0845-4fea-84f3-bd7cee287f7e None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:55.882011 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-16a7a873-0845-4fea-84f3-bd7cee287f7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:04:55.882011 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:55.882011 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:55.882011 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:55.882011 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:55.882011 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:55.882011 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:55.882011 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:55.882011 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:55.882011 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:55.882011 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:55.882011 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:55.882011 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:04:55.882011 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:04:55.882011 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:04:55.883014 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:04:55.883014 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:55.883014 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:55.883014 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:55.883014 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:55.883014 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:55.883014 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:55.883014 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:55.883014 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:55.883014 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:55.883014 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:55.883014 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:55.883014 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:55.883014 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:55.883014 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:55.883014 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:55.883014 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:55.884247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:04:55.884247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:04:55.884247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:04:55.884247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:04:55.884247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:04:55.884247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:04:55.884247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:04:55.884247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:04:55.884247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 263/520] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:04:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:55.884725 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7a873-0845-4fea-84f3-bd7cee287f7e None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:55.899788 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b3bf1-6a2a-4708-a8a0-1b04ca0cee7a None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:55.936060 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d8bfc-85d6-4391-8de5-9b28ee3d261e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:55.936698 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d8bfc-85d6-4391-8de5-9b28ee3d261e None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:55.936978 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d8bfc-85d6-4391-8de5-9b28ee3d261e None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:55.937248 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d8bfc-85d6-4391-8de5-9b28ee3d261e None admin] PATH_INFO: `/v3/users/glance` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:55.942570 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:55.945137 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d8bfc-85d6-4391-8de5-9b28ee3d261e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:55.946620 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d8bfc-85d6-4391-8de5-9b28ee3d261e None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:55.958687 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-423d8bfc-85d6-4391-8de5-9b28ee3d261e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 19:04:55.958687 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:55.958687 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:55.958687 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:55.958687 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:55.958687 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:55.958687 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:55.958687 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:55.958687 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:55.958687 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:55.958687 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:55.958687 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:55.958687 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:04:55.958687 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:04:55.958687 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:04:55.958687 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:04:55.959620 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:55.959620 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:55.959620 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:04:55.959620 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:04:55.959620 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:04:55.959620 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:04:55.959620 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:55.959620 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:55.959620 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:55.959620 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:55.959620 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:55.959620 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:55.959620 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:55.959620 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:55.959620 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:55.959620 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:55.959620 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:55.959620 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:55.960500 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:55.960500 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:55.960500 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:04:55.960500 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:04:55.960500 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:04:55.960500 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:04:55.960500 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:04:55.960500 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:04:55.960500 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 19:04:55.960500 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:04:55.960500 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 258/521] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:04:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:55.961057 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d8bfc-85d6-4391-8de5-9b28ee3d261e None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:55.979068 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:56.009471 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7a873-0845-4fea-84f3-bd7cee287f7e None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:56.046336 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250a1f5-09c7-47a4-9991-ae18199592af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:56.047697 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250a1f5-09c7-47a4-9991-ae18199592af None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:56.048094 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250a1f5-09c7-47a4-9991-ae18199592af None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:56.049173 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250a1f5-09c7-47a4-9991-ae18199592af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:56.077067 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d8bfc-85d6-4391-8de5-9b28ee3d261e None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:56.114013 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d9c67-ba72-4317-aa09-054fbcbd43ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:56.114668 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d9c67-ba72-4317-aa09-054fbcbd43ea None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:56.114955 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d9c67-ba72-4317-aa09-054fbcbd43ea None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:56.115234 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d9c67-ba72-4317-aa09-054fbcbd43ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:56.123895 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5250a1f5-09c7-47a4-9991-ae18199592af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:56.125362 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5250a1f5-09c7-47a4-9991-ae18199592af None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:56.126475 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d9c67-ba72-4317-aa09-054fbcbd43ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:56.127938 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d9c67-ba72-4317-aa09-054fbcbd43ea None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:56.142388 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-940d9c67-ba72-4317-aa09-054fbcbd43ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:04:56.142388 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:56.142388 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:56.142388 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:56.142388 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:56.142388 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:56.142388 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:56.142388 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:56.142388 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:56.142388 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:56.142388 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:56.142388 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:56.142388 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:04:56.142388 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:04:56.142388 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:04:56.142388 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:04:56.143502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:56.143502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:56.143502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:56.143502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:56.143502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:56.143502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:56.143502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:56.143502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:56.143502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:56.143502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:56.143502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:56.143502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:56.143502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:56.143502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:56.143502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:56.143502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:56.143502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:04:56.144685 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:04:56.144685 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:04:56.144685 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:04:56.148152 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 259/522] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:04:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:56.148986 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d9c67-ba72-4317-aa09-054fbcbd43ea None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:56.177977 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:56.216247 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:56.234978 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 264/523] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:04:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:04:56.234978 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250a1f5-09c7-47a4-9991-ae18199592af None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:56.262105 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d9c67-ba72-4317-aa09-054fbcbd43ea None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:56.297677 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d9c75-a531-4398-9922-5af0ba66874f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:56.298207 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d9c75-a531-4398-9922-5af0ba66874f None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:56.298529 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d9c75-a531-4398-9922-5af0ba66874f None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:56.298806 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d9c75-a531-4398-9922-5af0ba66874f None admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:56.299507 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d9c75-a531-4398-9922-5af0ba66874f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:56.299812 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d9c75-a531-4398-9922-5af0ba66874f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:56.301499 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d9c75-a531-4398-9922-5af0ba66874f None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:56.320377 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 260/524] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 19:04:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:56.321328 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d9c75-a531-4398-9922-5af0ba66874f None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:56.336954 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250a1f5-09c7-47a4-9991-ae18199592af None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:56.373568 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037fa2a8-fb31-4a6c-96ef-f50d1b2e232a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:56.374176 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037fa2a8-fb31-4a6c-96ef-f50d1b2e232a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:56.374470 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037fa2a8-fb31-4a6c-96ef-f50d1b2e232a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:56.374754 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037fa2a8-fb31-4a6c-96ef-f50d1b2e232a None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:56.375542 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037fa2a8-fb31-4a6c-96ef-f50d1b2e232a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:56.375847 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037fa2a8-fb31-4a6c-96ef-f50d1b2e232a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:56.377325 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037fa2a8-fb31-4a6c-96ef-f50d1b2e232a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:56.398511 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 265/525] 10.222.0.79 () {56 vars in 1137 bytes} [Wed Aug 31 19:04:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:56.398511 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037fa2a8-fb31-4a6c-96ef-f50d1b2e232a None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:56.404411 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:56.438501 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d9c75-a531-4398-9922-5af0ba66874f None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:56.456524 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:56.470004 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e828c4-fc90-4596-a023-f5fe81f709bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:56.471219 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e828c4-fc90-4596-a023-f5fe81f709bb None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:56.471533 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e828c4-fc90-4596-a023-f5fe81f709bb None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:56.471846 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e828c4-fc90-4596-a023-f5fe81f709bb None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:56.472535 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e828c4-fc90-4596-a023-f5fe81f709bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:56.472870 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e828c4-fc90-4596-a023-f5fe81f709bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:56.474279 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e828c4-fc90-4596-a023-f5fe81f709bb None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:56.486485 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 261/526] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:04:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:56.487286 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e828c4-fc90-4596-a023-f5fe81f709bb None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:56.509129 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037fa2a8-fb31-4a6c-96ef-f50d1b2e232a None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:56.555029 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0108c9-4ee6-4a4f-b278-a85740200152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:56.555712 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0108c9-4ee6-4a4f-b278-a85740200152 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:56.556005 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0108c9-4ee6-4a4f-b278-a85740200152 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:56.556595 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0108c9-4ee6-4a4f-b278-a85740200152 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:56.568289 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0108c9-4ee6-4a4f-b278-a85740200152 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:56.569761 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0108c9-4ee6-4a4f-b278-a85740200152 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:56.585284 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-6a0108c9-4ee6-4a4f-b278-a85740200152 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:04:56.585284 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:56.585284 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:56.585284 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:56.585284 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:56.585284 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:56.585284 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:56.585284 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:56.585284 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:56.585284 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:56.585284 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:56.585284 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:56.585284 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:04:56.585284 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:04:56.585284 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:04:56.585284 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:04:56.586176 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:56.586176 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:56.586176 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:56.586176 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:56.586176 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:56.586176 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:56.586176 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:56.586176 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:56.586176 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:56.586176 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:56.586176 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:56.586176 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:56.586176 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:56.586176 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:56.586176 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:56.586176 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:56.586176 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:04:56.587067 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:04:56.587067 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:04:56.587067 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:04:56.587067 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 266/527] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:04:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:56.587313 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0108c9-4ee6-4a4f-b278-a85740200152 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:56.602491 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e828c4-fc90-4596-a023-f5fe81f709bb None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:56.640894 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f38c1-dbf0-4524-9032-b5bfd1223845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:56.641249 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f38c1-dbf0-4524-9032-b5bfd1223845 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:56.641531 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f38c1-dbf0-4524-9032-b5bfd1223845 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:56.641809 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f38c1-dbf0-4524-9032-b5bfd1223845 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:56.642588 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f38c1-dbf0-4524-9032-b5bfd1223845 None admin] RBAC: Adding query filter params (role.id=0230e2e79da94067a82374ceada29d3f, scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507, user.id=1fd6d45d1bc3479da72cb1a1990a6137) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:56.642900 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f38c1-dbf0-4524-9032-b5bfd1223845 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:56.644331 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f38c1-dbf0-4524-9032-b5bfd1223845 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:56.654505 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 262/528] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:04:56 2022] GET /identity/v3/role_assignments?user.id=1fd6d45d1bc3479da72cb1a1990a6137&scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507&role.id=0230e2e79da94067a82374ceada29d3f => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:56.654505 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f38c1-dbf0-4524-9032-b5bfd1223845 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:56.665877 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:56.725855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:56.731959 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0108c9-4ee6-4a4f-b278-a85740200152 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:56.778383 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d0233-56b1-4004-9f95-e2e894a23d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:56.779250 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d0233-56b1-4004-9f95-e2e894a23d03 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:56.779536 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d0233-56b1-4004-9f95-e2e894a23d03 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:56.779851 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d0233-56b1-4004-9f95-e2e894a23d03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:56.800004 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f38c1-dbf0-4524-9032-b5bfd1223845 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:56.839009 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625d1e4-1187-4603-933f-89d753b329f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:56.839643 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625d1e4-1187-4603-933f-89d753b329f5 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:56.839921 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625d1e4-1187-4603-933f-89d753b329f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:56.840204 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625d1e4-1187-4603-933f-89d753b329f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:56.849283 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625d1e4-1187-4603-933f-89d753b329f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:56.851227 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625d1e4-1187-4603-933f-89d753b329f5 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:56.862709 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d0233-56b1-4004-9f95-e2e894a23d03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:56.864264 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d0233-56b1-4004-9f95-e2e894a23d03 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:56.868577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-2625d1e4-1187-4603-933f-89d753b329f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:04:56.868577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:56.868577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:56.868577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:56.868577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:56.868577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:56.868577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:56.868577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:56.868577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:56.868577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:56.868577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:56.868577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:56.868577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:04:56.868577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:04:56.868577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:04:56.869410 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:04:56.869410 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:56.869410 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:56.869410 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:56.869410 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:56.869410 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:56.869410 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:56.869410 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:56.869410 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:56.869410 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:56.869410 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:56.869410 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:56.869410 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:56.869410 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:56.869410 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:56.869410 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:56.869410 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:56.870246 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:04:56.870246 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:04:56.870246 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:04:56.870246 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:04:56.870246 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:04:56.870246 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:04:56.870246 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:04:56.870246 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:04:56.874567 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 263/529] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:04:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:56.875473 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625d1e4-1187-4603-933f-89d753b329f5 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:56.943283 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:57.000908 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 267/530] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:04:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:04:57.001924 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d0233-56b1-4004-9f95-e2e894a23d03 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:57.003253 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625d1e4-1187-4603-933f-89d753b329f5 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:57.012454 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:57.048047 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd5657-cd45-473b-a207-33bd03141846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:57.048719 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd5657-cd45-473b-a207-33bd03141846 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:57.049001 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd5657-cd45-473b-a207-33bd03141846 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:57.049274 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd5657-cd45-473b-a207-33bd03141846 None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:57.050280 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd5657-cd45-473b-a207-33bd03141846 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:57.050631 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd5657-cd45-473b-a207-33bd03141846 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:57.052136 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd5657-cd45-473b-a207-33bd03141846 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:57.070662 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 264/531] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:04:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:57.071580 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd5657-cd45-473b-a207-33bd03141846 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:57.116900 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d0233-56b1-4004-9f95-e2e894a23d03 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:57.152463 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86f000-76a1-49a3-862f-c52e8ed93407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:57.153140 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86f000-76a1-49a3-862f-c52e8ed93407 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:57.153424 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86f000-76a1-49a3-862f-c52e8ed93407 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:57.153699 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86f000-76a1-49a3-862f-c52e8ed93407 None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:57.154397 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86f000-76a1-49a3-862f-c52e8ed93407 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:57.154730 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86f000-76a1-49a3-862f-c52e8ed93407 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:57.156350 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86f000-76a1-49a3-862f-c52e8ed93407 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:57.181492 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 268/532] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 19:04:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:57.182395 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86f000-76a1-49a3-862f-c52e8ed93407 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:57.185932 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd5657-cd45-473b-a207-33bd03141846 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:57.202710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:57.222830 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4595fc-49a6-471e-96ce-5dffb92f0c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:57.223463 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4595fc-49a6-471e-96ce-5dffb92f0c8d None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:57.223746 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4595fc-49a6-471e-96ce-5dffb92f0c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:57.224017 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4595fc-49a6-471e-96ce-5dffb92f0c8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:57.235589 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4595fc-49a6-471e-96ce-5dffb92f0c8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:57.237766 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4595fc-49a6-471e-96ce-5dffb92f0c8d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:57.254956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-df4595fc-49a6-471e-96ce-5dffb92f0c8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:04:57.254956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:57.254956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:57.254956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:57.254956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:57.254956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:57.254956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:57.254956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:57.254956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:57.254956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:57.254956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:57.254956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:57.254956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:04:57.254956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:04:57.254956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:04:57.254956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:04:57.257072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:57.257072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:57.257072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:57.257072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:57.257072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:57.257072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:57.257072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:57.257072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:57.257072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:57.257072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:57.257072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:57.257072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:57.257072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:57.257072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:57.257072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:57.257072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:57.257072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:04:57.259234 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:04:57.259234 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:04:57.259234 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:04:57.259234 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 265/533] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:04:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:57.259234 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4595fc-49a6-471e-96ce-5dffb92f0c8d None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:57.278437 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:57.290818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86f000-76a1-49a3-862f-c52e8ed93407 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:57.326704 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997947d0-06b4-4969-9ec9-c90407778c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:57.327340 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997947d0-06b4-4969-9ec9-c90407778c40 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:57.327619 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997947d0-06b4-4969-9ec9-c90407778c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:57.327893 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997947d0-06b4-4969-9ec9-c90407778c40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:57.335747 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997947d0-06b4-4969-9ec9-c90407778c40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:57.337273 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997947d0-06b4-4969-9ec9-c90407778c40 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:57.349173 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-997947d0-06b4-4969-9ec9-c90407778c40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:04:57.349173 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:57.349173 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:57.349173 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:57.349173 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:57.349173 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:57.349173 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:57.349173 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:57.349173 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:57.349173 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:57.349173 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:57.349173 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:57.349173 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:04:57.349173 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:04:57.349173 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:04:57.351476 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:04:57.351476 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:57.351476 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:57.351476 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:57.351476 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:57.351476 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:57.351476 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:57.351476 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:57.351476 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:57.351476 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:57.351476 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:57.351476 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:57.351476 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:57.351476 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:57.351476 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:57.351476 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:57.351476 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:57.353865 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:04:57.353865 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:04:57.353865 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:04:57.353865 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:04:57.353865 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:04:57.353865 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:04:57.353865 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:04:57.353865 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:04:57.353865 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 269/534] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:04:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:57.353865 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997947d0-06b4-4969-9ec9-c90407778c40 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:57.367382 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4595fc-49a6-471e-96ce-5dffb92f0c8d None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:57.406922 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9127198-aaa7-47a7-8ce1-c8021274a388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:57.407531 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9127198-aaa7-47a7-8ce1-c8021274a388 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:57.407842 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9127198-aaa7-47a7-8ce1-c8021274a388 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:57.408119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9127198-aaa7-47a7-8ce1-c8021274a388 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:57.408904 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9127198-aaa7-47a7-8ce1-c8021274a388 None admin] RBAC: Adding query filter params (role.id=0230e2e79da94067a82374ceada29d3f, scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507, user.id=17e0a157474749939b6f8d2af26d7d4e) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:57.409169 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9127198-aaa7-47a7-8ce1-c8021274a388 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:57.410893 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9127198-aaa7-47a7-8ce1-c8021274a388 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:57.416766 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 266/535] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:04:57 2022] GET /identity/v3/role_assignments?user.id=17e0a157474749939b6f8d2af26d7d4e&scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507&role.id=0230e2e79da94067a82374ceada29d3f => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:57.417394 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9127198-aaa7-47a7-8ce1-c8021274a388 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:57.447709 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:57.474905 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997947d0-06b4-4969-9ec9-c90407778c40 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:57.514265 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d485d-2c53-4f65-ac19-578169b3ec5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:57.514901 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d485d-2c53-4f65-ac19-578169b3ec5f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:57.515177 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d485d-2c53-4f65-ac19-578169b3ec5f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:57.515446 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d485d-2c53-4f65-ac19-578169b3ec5f None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:57.516098 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13d485d-2c53-4f65-ac19-578169b3ec5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:57.516395 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13d485d-2c53-4f65-ac19-578169b3ec5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:57.518402 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13d485d-2c53-4f65-ac19-578169b3ec5f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:57.536356 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:57.544502 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 270/536] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:04:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:57.545948 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73775da-68d8-4197-a060-50a7fad5afbf None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:57.546332 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73775da-68d8-4197-a060-50a7fad5afbf None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:57.546755 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73775da-68d8-4197-a060-50a7fad5afbf None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:57.548456 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 271/537] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:57.553456 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73775da-68d8-4197-a060-50a7fad5afbf None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:57.566004 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9127198-aaa7-47a7-8ce1-c8021274a388 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:57.611399 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796bded-ae30-469d-9c3c-147b2ba19a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:57.612315 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796bded-ae30-469d-9c3c-147b2ba19a5a None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:57.613277 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796bded-ae30-469d-9c3c-147b2ba19a5a None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:57.613854 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796bded-ae30-469d-9c3c-147b2ba19a5a None admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:57.614861 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796bded-ae30-469d-9c3c-147b2ba19a5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:57.615591 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796bded-ae30-469d-9c3c-147b2ba19a5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:57.617787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796bded-ae30-469d-9c3c-147b2ba19a5a None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:57.635686 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 267/538] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 19:04:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:57.637633 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6793250-b3a7-4591-99cc-dd0c19e9fd0d None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:57.638090 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6793250-b3a7-4591-99cc-dd0c19e9fd0d None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:57.639148 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6793250-b3a7-4591-99cc-dd0c19e9fd0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:57.659582 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-e6793250-b3a7-4591-99cc-dd0c19e9fd0d None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:57.660915 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-e6793250-b3a7-4591-99cc-dd0c19e9fd0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:57.677301 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73775da-68d8-4197-a060-50a7fad5afbf None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:57.724075 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43227762-449c-4f0e-8521-7ccb397c38d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:57.725172 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43227762-449c-4f0e-8521-7ccb397c38d3 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:57.725915 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43227762-449c-4f0e-8521-7ccb397c38d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:57.727019 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43227762-449c-4f0e-8521-7ccb397c38d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:57.730438 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 268/539] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:04:57.731166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6793250-b3a7-4591-99cc-dd0c19e9fd0d None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:57.738082 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43227762-449c-4f0e-8521-7ccb397c38d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:57.740403 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43227762-449c-4f0e-8521-7ccb397c38d3 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:57.743240 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:57.758139 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-43227762-449c-4f0e-8521-7ccb397c38d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:04:57.758139 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:57.758139 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:57.758139 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:57.758139 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:57.758139 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:57.758139 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:57.758139 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:57.758139 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:57.758139 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:57.758139 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:57.758139 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:57.758139 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:04:57.758139 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:04:57.758139 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:04:57.759121 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:04:57.759121 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:57.759121 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:57.759121 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:57.759121 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:57.759121 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:57.759121 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:57.759121 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:57.759121 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:57.759121 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:57.759121 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:57.759121 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:57.759121 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:57.759121 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:57.759121 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:57.759121 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:57.759121 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:57.759957 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:04:57.759957 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:04:57.759957 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:04:57.759957 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:04:57.759957 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:04:57.759957 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:04:57.759957 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:04:57.759957 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:04:57.762241 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 272/540] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:04:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:57.768003 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43227762-449c-4f0e-8521-7ccb397c38d3 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:57.822971 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:57.835975 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6793250-b3a7-4591-99cc-dd0c19e9fd0d None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:57.877295 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abffa1a3-f3c8-4629-93a8-8cfc1c935884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:57.877788 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffa1a3-f3c8-4629-93a8-8cfc1c935884 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:57.878082 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffa1a3-f3c8-4629-93a8-8cfc1c935884 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:57.878325 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffa1a3-f3c8-4629-93a8-8cfc1c935884 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:57.882280 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abffa1a3-f3c8-4629-93a8-8cfc1c935884 None admin] RBAC: Adding query filter params (role.id=0230e2e79da94067a82374ceada29d3f, scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507, user.id=a91998a2818444a595adc06f1f481fe1) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:57.882280 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abffa1a3-f3c8-4629-93a8-8cfc1c935884 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:57.882280 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abffa1a3-f3c8-4629-93a8-8cfc1c935884 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:57.888246 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 269/541] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:04:57 2022] GET /identity/v3/role_assignments?user.id=a91998a2818444a595adc06f1f481fe1&scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507&role.id=0230e2e79da94067a82374ceada29d3f => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:57.954226 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43227762-449c-4f0e-8521-7ccb397c38d3 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:58.008616 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dcc9e8-331f-4769-b3fb-3d9d5f3b68b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:58.009249 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcc9e8-331f-4769-b3fb-3d9d5f3b68b8 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:58.009527 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcc9e8-331f-4769-b3fb-3d9d5f3b68b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:58.009798 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcc9e8-331f-4769-b3fb-3d9d5f3b68b8 None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:58.010531 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dcc9e8-331f-4769-b3fb-3d9d5f3b68b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:58.010838 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dcc9e8-331f-4769-b3fb-3d9d5f3b68b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:58.012326 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dcc9e8-331f-4769-b3fb-3d9d5f3b68b8 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:58.037120 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 273/542] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 19:04:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:58.043224 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abffa1a3-f3c8-4629-93a8-8cfc1c935884 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:58.046446 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dcc9e8-331f-4769-b3fb-3d9d5f3b68b8 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:58.191743 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abffa1a3-f3c8-4629-93a8-8cfc1c935884 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:58.210832 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:58.237097 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab0dc3-ee2d-42e5-a88e-aece77b099bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:58.237767 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab0dc3-ee2d-42e5-a88e-aece77b099bb None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:58.238044 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab0dc3-ee2d-42e5-a88e-aece77b099bb None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:58.238309 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab0dc3-ee2d-42e5-a88e-aece77b099bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:58.239067 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab0dc3-ee2d-42e5-a88e-aece77b099bb None admin] RBAC: Adding query filter params (role.id=0230e2e79da94067a82374ceada29d3f, scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507, user.id=254dd957da6345f79bcab42b27b8d2cc) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:58.239372 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab0dc3-ee2d-42e5-a88e-aece77b099bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:58.243188 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab0dc3-ee2d-42e5-a88e-aece77b099bb None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:58.251881 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:58.259602 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 270/543] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:04:58 2022] GET /identity/v3/role_assignments?user.id=254dd957da6345f79bcab42b27b8d2cc&scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507&role.id=0230e2e79da94067a82374ceada29d3f => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:58.297425 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dcc9e8-331f-4769-b3fb-3d9d5f3b68b8 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:58.365530 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4fffb1-b6fd-4292-bb39-f3c0e98a931b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:58.366193 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4fffb1-b6fd-4292-bb39-f3c0e98a931b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:58.366563 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4fffb1-b6fd-4292-bb39-f3c0e98a931b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:58.366837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4fffb1-b6fd-4292-bb39-f3c0e98a931b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:58.383185 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4fffb1-b6fd-4292-bb39-f3c0e98a931b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:58.388296 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-ad4fffb1-b6fd-4292-bb39-f3c0e98a931b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:04:58.388296 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:58.388296 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:58.388296 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:58.388296 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:58.388296 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:58.388296 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:58.388296 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:58.388296 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:58.388296 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:58.388296 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:58.388296 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:58.388296 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:58.388296 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:58.388296 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:58.388296 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:58.389210 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:58.389210 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:58.389210 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:58.389210 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:58.389210 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:58.389210 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:58.389210 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:58.389210 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:58.389210 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:58.389210 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:58.389210 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:58.389210 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:58.389210 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:58.389210 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:58.389210 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:58.389210 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:58.390447 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:58.390447 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:58.390447 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:58.390447 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:58.390447 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:58.390447 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:58.390447 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:58.390447 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:58.390447 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:58.390447 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:58.390447 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:04:58.390447 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:04:58.390447 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 274/544] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 19:04:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:04:58.399593 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab0dc3-ee2d-42e5-a88e-aece77b099bb None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:58.527209 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab0dc3-ee2d-42e5-a88e-aece77b099bb None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:58.583797 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f4349-026a-4738-93d4-dc4d05326807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:58.584418 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f4349-026a-4738-93d4-dc4d05326807 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:58.584700 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f4349-026a-4738-93d4-dc4d05326807 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:58.584976 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f4349-026a-4738-93d4-dc4d05326807 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:58.585711 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f4349-026a-4738-93d4-dc4d05326807 None admin] RBAC: Adding query filter params (name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:58.586015 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f4349-026a-4738-93d4-dc4d05326807 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:58.587422 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f4349-026a-4738-93d4-dc4d05326807 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:58.596399 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 271/545] 10.222.0.79 () {56 vars in 1103 bytes} [Wed Aug 31 19:04:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:58.602245 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4fffb1-b6fd-4292-bb39-f3c0e98a931b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:58.727770 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4fffb1-b6fd-4292-bb39-f3c0e98a931b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:58.747368 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:58.773994 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf346f5-91c2-453e-979a-492f7da10fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:58.775022 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf346f5-91c2-453e-979a-492f7da10fcd None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:58.775495 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf346f5-91c2-453e-979a-492f7da10fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:58.775985 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf346f5-91c2-453e-979a-492f7da10fcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:58.792270 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf346f5-91c2-453e-979a-492f7da10fcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:58.794030 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf346f5-91c2-453e-979a-492f7da10fcd None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:58.822808 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-ccf346f5-91c2-453e-979a-492f7da10fcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:04:58.822808 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:58.822808 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:58.822808 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:58.822808 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:58.822808 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:58.822808 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:58.822808 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:58.822808 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:58.822808 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:58.822808 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:58.822808 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:58.822808 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:04:58.822808 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:04:58.822808 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:04:58.822808 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:04:58.823771 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:58.823771 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:58.823771 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:58.823771 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:58.823771 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:58.823771 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:58.823771 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:58.823771 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:58.823771 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:58.823771 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:58.823771 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:58.823771 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:58.823771 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:58.823771 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:58.823771 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:58.823771 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:58.823771 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:04:58.824630 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:04:58.824630 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:04:58.824630 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:04:58.827104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 275/546] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:04:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:58.833173 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f4349-026a-4738-93d4-dc4d05326807 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:58.961712 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:59.011001 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440287a-51b0-478e-a66c-d079a3431cac None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:59.011404 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440287a-51b0-478e-a66c-d079a3431cac None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:59.011680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440287a-51b0-478e-a66c-d079a3431cac None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:59.014246 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 276/547] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:59.018210 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdb035-9d50-48e5-8a36-ebba747d7eb1 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:59.018522 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdb035-9d50-48e5-8a36-ebba747d7eb1 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:59.018805 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdb035-9d50-48e5-8a36-ebba747d7eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:59.038131 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-c3bdb035-9d50-48e5-8a36-ebba747d7eb1 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:59.039366 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c3bdb035-9d50-48e5-8a36-ebba747d7eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:04:59.044435 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f4349-026a-4738-93d4-dc4d05326807 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:59.110403 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719ab81-46f7-45b8-9244-badcdaaac1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:59.111593 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719ab81-46f7-45b8-9244-badcdaaac1c5 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:59.111873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719ab81-46f7-45b8-9244-badcdaaac1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:59.112147 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719ab81-46f7-45b8-9244-badcdaaac1c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:59.112798 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719ab81-46f7-45b8-9244-badcdaaac1c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:59.113100 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719ab81-46f7-45b8-9244-badcdaaac1c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:59.114853 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719ab81-46f7-45b8-9244-badcdaaac1c5 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:59.122655 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 277/548] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 19:04:59.128461 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 272/549] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:59.139556 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdb035-9d50-48e5-8a36-ebba747d7eb1 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:59.291808 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:59.295402 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdb035-9d50-48e5-8a36-ebba747d7eb1 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:59.348070 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db0118-6f11-48a6-b29b-ffc26b69c696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:59.348724 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db0118-6f11-48a6-b29b-ffc26b69c696 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:59.349007 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db0118-6f11-48a6-b29b-ffc26b69c696 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:59.349281 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db0118-6f11-48a6-b29b-ffc26b69c696 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:59.358438 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db0118-6f11-48a6-b29b-ffc26b69c696 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:59.360179 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db0118-6f11-48a6-b29b-ffc26b69c696 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:59.375093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-52db0118-6f11-48a6-b29b-ffc26b69c696 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 19:04:59.375093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:59.375093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:59.375093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:59.375093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:59.375093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:59.375093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:59.375093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:59.375093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:59.375093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:59.375093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:59.375093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:59.375093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:04:59.375093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:04:59.375093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:04:59.375093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:04:59.377304 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:59.377304 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:59.377304 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:04:59.377304 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:04:59.377304 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:04:59.377304 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:04:59.377304 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:59.377304 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:59.377304 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:59.377304 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:59.377304 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:59.377304 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:59.377304 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:59.377304 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:59.377304 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:59.377304 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:59.377304 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:59.377304 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:59.378865 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:59.378865 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:59.378865 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:04:59.378865 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:04:59.378865 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:04:59.378865 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:04:59.378865 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:04:59.378865 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:04:59.378865 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 19:04:59.378865 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:04:59.381160 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 278/550] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 19:04:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:04:59.391496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719ab81-46f7-45b8-9244-badcdaaac1c5 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:59.469430 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db0118-6f11-48a6-b29b-ffc26b69c696 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:59.499775 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719ab81-46f7-45b8-9244-badcdaaac1c5 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:59.538134 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d54617b-1ece-4007-824d-a2b3aa2ee70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:59.539016 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54617b-1ece-4007-824d-a2b3aa2ee70a None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:59.539458 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54617b-1ece-4007-824d-a2b3aa2ee70a None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:59.539857 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54617b-1ece-4007-824d-a2b3aa2ee70a None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:59.540722 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d54617b-1ece-4007-824d-a2b3aa2ee70a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:59.541154 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d54617b-1ece-4007-824d-a2b3aa2ee70a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:59.542802 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d54617b-1ece-4007-824d-a2b3aa2ee70a None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:59.554856 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:59.589689 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 273/551] 10.222.0.79 () {56 vars in 1135 bytes} [Wed Aug 31 19:04:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:59.595917 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d54617b-1ece-4007-824d-a2b3aa2ee70a None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:59.704270 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db0118-6f11-48a6-b29b-ffc26b69c696 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:59.714793 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d54617b-1ece-4007-824d-a2b3aa2ee70a None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:59.739904 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64af251-9709-46f1-97e6-24f5534b6dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:59.740527 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64af251-9709-46f1-97e6-24f5534b6dea None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:59.740803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64af251-9709-46f1-97e6-24f5534b6dea None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:59.741074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64af251-9709-46f1-97e6-24f5534b6dea None admin] PATH_INFO: `/v3/roles/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:59.752114 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64af251-9709-46f1-97e6-24f5534b6dea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:04:59.757394 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-f64af251-9709-46f1-97e6-24f5534b6dea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:04:59.757394 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:04:59.757394 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:04:59.757394 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:04:59.757394 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:04:59.757394 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:04:59.757394 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:04:59.757394 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:04:59.757394 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:04:59.757394 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:04:59.757394 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:04:59.757394 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:04:59.757394 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:04:59.757394 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:04:59.757394 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:04:59.757394 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:04:59.758451 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:04:59.758451 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:04:59.758451 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:04:59.758451 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:04:59.758451 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:04:59.758451 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:04:59.758451 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:04:59.758451 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:04:59.758451 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:04:59.758451 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:04:59.758451 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:04:59.758451 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:04:59.758451 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:04:59.758451 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:04:59.758451 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:04:59.758451 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:04:59.759321 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:04:59.759321 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:04:59.759321 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:04:59.759321 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:04:59.759321 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:04:59.759321 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:04:59.759321 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:04:59.759321 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:04:59.759321 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:04:59.759321 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:04:59.759321 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:04:59.759321 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:04:59.759321 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 279/552] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 19:04:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:04:59.759994 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37a280-1a49-4825-9529-d7d85dfb0917 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:59.759994 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37a280-1a49-4825-9529-d7d85dfb0917 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:59.760705 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37a280-1a49-4825-9529-d7d85dfb0917 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:59.763182 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 280/553] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:04:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:04:59.763309 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b4b2a-c422-4fdc-8e91-c06d2a71d08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:59.763928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b4b2a-c422-4fdc-8e91-c06d2a71d08a None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:59.764203 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b4b2a-c422-4fdc-8e91-c06d2a71d08a None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:59.764519 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b4b2a-c422-4fdc-8e91-c06d2a71d08a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:59.765785 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37a280-1a49-4825-9529-d7d85dfb0917 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:59.792082 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:59.822583 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:04:59.843300 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b4b2a-c422-4fdc-8e91-c06d2a71d08a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:59.845128 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b4b2a-c422-4fdc-8e91-c06d2a71d08a None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:59.884751 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37a280-1a49-4825-9529-d7d85dfb0917 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:04:59.922077 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fadd0cf-e3c7-433a-85d3-9b00c3704caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:04:59.922751 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadd0cf-e3c7-433a-85d3-9b00c3704caf None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:59.923034 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadd0cf-e3c7-433a-85d3-9b00c3704caf None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:59.923310 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadd0cf-e3c7-433a-85d3-9b00c3704caf None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:59.924547 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fadd0cf-e3c7-433a-85d3-9b00c3704caf None admin] RBAC: Adding query filter params (name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:04:59.924852 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fadd0cf-e3c7-433a-85d3-9b00c3704caf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:04:59.926231 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fadd0cf-e3c7-433a-85d3-9b00c3704caf None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:04:59.940295 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 281/554] 10.222.0.79 () {56 vars in 1103 bytes} [Wed Aug 31 19:04:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:04:59.941618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368bea6-097c-4009-b933-094510511a31 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:04:59.942006 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368bea6-097c-4009-b933-094510511a31 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:04:59.942293 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368bea6-097c-4009-b933-094510511a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:04:59.956783 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 274/555] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:04:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:04:59.957641 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b4b2a-c422-4fdc-8e91-c06d2a71d08a None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:04:59.962865 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-1368bea6-097c-4009-b933-094510511a31 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:04:59.964068 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1368bea6-097c-4009-b933-094510511a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:00.038905 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 282/556] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:04:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:05:00.046911 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:00.048628 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1368bea6-097c-4009-b933-094510511a31 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:00.067645 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b4b2a-c422-4fdc-8e91-c06d2a71d08a None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:00.073873 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:00.107634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada99b1d-1a9d-40d1-8d08-ca008aebef8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:00.108569 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada99b1d-1a9d-40d1-8d08-ca008aebef8f None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:00.109026 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada99b1d-1a9d-40d1-8d08-ca008aebef8f None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:00.109514 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada99b1d-1a9d-40d1-8d08-ca008aebef8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:00.120446 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada99b1d-1a9d-40d1-8d08-ca008aebef8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:00.122341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada99b1d-1a9d-40d1-8d08-ca008aebef8f None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:00.138518 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-ada99b1d-1a9d-40d1-8d08-ca008aebef8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:00.138518 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:00.138518 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:00.138518 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:00.138518 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:00.138518 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:00.138518 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:00.138518 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:00.138518 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:00.138518 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:00.138518 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:00.138518 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:00.138518 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:00.138518 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:00.138518 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:00.138518 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:00.139496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:00.139496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:00.139496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:00.139496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:00.139496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:00.139496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:00.139496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:00.139496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:00.139496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:00.139496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:00.139496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:00.139496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:00.139496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:00.139496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:00.139496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:00.139496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:00.139496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:00.140378 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:00.140378 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:00.140378 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:00.142906 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 275/557] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:04:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:00.170062 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada99b1d-1a9d-40d1-8d08-ca008aebef8f None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:00.200061 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1368bea6-097c-4009-b933-094510511a31 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:00.243260 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f492001-20f8-4a47-86de-1d47ce63cc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:00.243904 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f492001-20f8-4a47-86de-1d47ce63cc3a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:00.244185 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f492001-20f8-4a47-86de-1d47ce63cc3a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:00.244462 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f492001-20f8-4a47-86de-1d47ce63cc3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:00.267063 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f492001-20f8-4a47-86de-1d47ce63cc3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:00.268863 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f492001-20f8-4a47-86de-1d47ce63cc3a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:00.289431 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-2f492001-20f8-4a47-86de-1d47ce63cc3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:00.289431 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:00.289431 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:00.289431 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:00.289431 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:00.289431 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:00.289431 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:00.289431 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:00.289431 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:00.289431 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:00.289431 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:00.289431 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:00.289431 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:00.289431 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:00.289431 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:00.289431 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:00.291002 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:00.291002 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:00.291002 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:00.291002 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:00.291002 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:00.291002 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:00.291002 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:00.291002 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:00.291002 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:00.291002 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:00.291002 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:00.291002 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:00.291002 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:00.291002 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:00.291002 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:00.291002 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:00.291002 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:00.291881 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:00.291881 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:00.291881 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:00.291881 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 283/558] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:00.296013 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f227c5-61a8-4dc0-b7a7-7bbde145a675 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:00.296013 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f227c5-61a8-4dc0-b7a7-7bbde145a675 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:00.296013 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f227c5-61a8-4dc0-b7a7-7bbde145a675 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:00.298971 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 284/559] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:05:00.302486 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f227c5-61a8-4dc0-b7a7-7bbde145a675 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:00.335489 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada99b1d-1a9d-40d1-8d08-ca008aebef8f None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:00.373940 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:00.381371 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2448b7-d98c-4f23-924b-1cd0f271ddb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:00.382369 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2448b7-d98c-4f23-924b-1cd0f271ddb8 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:00.382777 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2448b7-d98c-4f23-924b-1cd0f271ddb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:00.383461 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2448b7-d98c-4f23-924b-1cd0f271ddb8 None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:00.384557 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2448b7-d98c-4f23-924b-1cd0f271ddb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:00.384963 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2448b7-d98c-4f23-924b-1cd0f271ddb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:00.386072 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:00.386868 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2448b7-d98c-4f23-924b-1cd0f271ddb8 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:00.409317 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 276/560] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:05:00.410874 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c93514-32f8-43b4-b729-a650e63ce70b None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:00.411268 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c93514-32f8-43b4-b729-a650e63ce70b None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:00.411648 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c93514-32f8-43b4-b729-a650e63ce70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:00.435511 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-79c93514-32f8-43b4-b729-a650e63ce70b None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:00.436745 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-79c93514-32f8-43b4-b729-a650e63ce70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:00.441609 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f227c5-61a8-4dc0-b7a7-7bbde145a675 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:00.477915 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f6015-6ed2-48b5-b6ca-6d0215b2b045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:00.478554 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f6015-6ed2-48b5-b6ca-6d0215b2b045 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:00.478836 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f6015-6ed2-48b5-b6ca-6d0215b2b045 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:00.479108 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f6015-6ed2-48b5-b6ca-6d0215b2b045 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:00.479759 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f6015-6ed2-48b5-b6ca-6d0215b2b045 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:00.480059 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f6015-6ed2-48b5-b6ca-6d0215b2b045 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:00.481470 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f6015-6ed2-48b5-b6ca-6d0215b2b045 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:00.496596 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 285/561] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:00.497714 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f6015-6ed2-48b5-b6ca-6d0215b2b045 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:00.513890 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 277/562] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:05:00.514760 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c93514-32f8-43b4-b729-a650e63ce70b None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:00.613815 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f6015-6ed2-48b5-b6ca-6d0215b2b045 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:00.626734 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c93514-32f8-43b4-b729-a650e63ce70b None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:00.639933 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:00.650963 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:00.652604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88f6da-2c7e-4acc-a165-88f8ae2a52fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:00.653313 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88f6da-2c7e-4acc-a165-88f8ae2a52fb None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:00.653707 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88f6da-2c7e-4acc-a165-88f8ae2a52fb None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:00.654005 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88f6da-2c7e-4acc-a165-88f8ae2a52fb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:00.662682 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df88f6da-2c7e-4acc-a165-88f8ae2a52fb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:00.664120 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df88f6da-2c7e-4acc-a165-88f8ae2a52fb None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:00.664333 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911e5d5-f455-476a-a107-3513a042da88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:00.664957 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911e5d5-f455-476a-a107-3513a042da88 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:00.665235 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911e5d5-f455-476a-a107-3513a042da88 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:00.665504 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911e5d5-f455-476a-a107-3513a042da88 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:00.676100 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3911e5d5-f455-476a-a107-3513a042da88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:05:00.676922 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-df88f6da-2c7e-4acc-a165-88f8ae2a52fb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:05:00.676922 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:00.676922 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:00.676922 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:00.676922 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:00.676922 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:00.676922 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:00.676922 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:00.676922 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:00.676922 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:00.676922 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:00.676922 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:00.676922 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:05:00.676922 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:05:00.676922 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:05:00.676922 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:05:00.677933 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:00.677933 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:00.677933 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:05:00.677933 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:00.677933 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:05:00.677933 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:00.677933 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:00.677933 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:00.677933 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:00.677933 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:00.677933 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:00.677933 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:00.677933 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:00.677933 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:00.677933 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:00.677933 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:00.677933 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:00.677933 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:00.679496 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:00.679496 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:00.679496 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:05:00.679496 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:05:00.679496 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:05:00.679496 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:05:00.679496 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:05:00.679496 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:05:00.679496 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:05:00.679496 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:00.680848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-3911e5d5-f455-476a-a107-3513a042da88 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:05:00.680848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:00.680848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:00.680848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:00.680848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:00.680848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:00.680848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:00.680848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:00.680848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:00.680848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:00.680848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:00.680848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:00.680848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:05:00.680848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:05:00.680848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:05:00.680848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:05:00.681728 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:05:00.681728 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:05:00.681728 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:05:00.681728 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:05:00.681728 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:00.681728 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:00.681728 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:00.681728 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:00.681728 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:00.681728 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:00.681728 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:00.681728 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:00.681728 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:00.681728 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:00.681728 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:00.681728 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:00.683707 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:00.683707 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:00.683707 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:00.683707 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:00.683707 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:05:00.683707 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:05:00.683707 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:05:00.683707 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:05:00.683707 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:05:00.683707 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:05:00.683707 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:05:00.683707 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:00.683707 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 278/563] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 19:05:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:00.685466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 286/564] 10.222.0.79 () {56 vars in 1093 bytes} [Wed Aug 31 19:05:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:00.685466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88f6da-2c7e-4acc-a165-88f8ae2a52fb None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:00.685769 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107ed66-59a6-402e-9ee6-760b446da263 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:00.685769 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107ed66-59a6-402e-9ee6-760b446da263 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:00.685769 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107ed66-59a6-402e-9ee6-760b446da263 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:00.690105 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 279/565] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:05:00.690593 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107ed66-59a6-402e-9ee6-760b446da263 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:00.790728 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88f6da-2c7e-4acc-a165-88f8ae2a52fb None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:00.797095 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107ed66-59a6-402e-9ee6-760b446da263 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:00.825049 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3ea44-d3a9-46cf-b8b2-65e710af09da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:00.825668 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3ea44-d3a9-46cf-b8b2-65e710af09da None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:00.825947 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3ea44-d3a9-46cf-b8b2-65e710af09da None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:00.826234 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3ea44-d3a9-46cf-b8b2-65e710af09da None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:00.831369 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff7de7-5f2e-4fca-a69c-f37d4a253665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:00.831964 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff7de7-5f2e-4fca-a69c-f37d4a253665 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:00.832239 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff7de7-5f2e-4fca-a69c-f37d4a253665 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:00.832510 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff7de7-5f2e-4fca-a69c-f37d4a253665 None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:00.832754 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa3ea44-d3a9-46cf-b8b2-65e710af09da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:00.833230 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff7de7-5f2e-4fca-a69c-f37d4a253665 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:00.833525 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff7de7-5f2e-4fca-a69c-f37d4a253665 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:00.834191 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa3ea44-d3a9-46cf-b8b2-65e710af09da None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:00.834951 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff7de7-5f2e-4fca-a69c-f37d4a253665 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:00.845335 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-2aa3ea44-d3a9-46cf-b8b2-65e710af09da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:00.845335 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:00.845335 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:00.845335 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:00.845335 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:00.845335 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:00.845335 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:00.845335 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:00.845335 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:00.845335 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:00.845335 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:00.845335 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:00.845335 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:05:00.845335 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:05:00.845335 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:05:00.846277 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:05:00.846277 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:00.846277 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:00.846277 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:00.846277 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:00.846277 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:00.846277 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:00.846277 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:00.846277 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:00.846277 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:00.846277 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:00.846277 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:00.846277 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:00.846277 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:00.846277 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:00.846277 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:00.846277 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:00.847201 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:05:00.847201 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:05:00.847201 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:05:00.847201 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:05:00.847201 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:05:00.847201 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:05:00.847201 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:00.847201 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:00.847201 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 287/566] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:05:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:00.847668 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3ea44-d3a9-46cf-b8b2-65e710af09da None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:00.852255 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 280/567] 10.222.0.79 () {56 vars in 1133 bytes} [Wed Aug 31 19:05:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:00.853460 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb8e16-351e-4af5-97f3-8db01501bf4d None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:00.853742 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb8e16-351e-4af5-97f3-8db01501bf4d None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:00.854008 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb8e16-351e-4af5-97f3-8db01501bf4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:00.872096 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-a2bb8e16-351e-4af5-97f3-8db01501bf4d None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:00.873196 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-a2bb8e16-351e-4af5-97f3-8db01501bf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:00.895336 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:00.907955 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:00.942130 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 281/568] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:05:00.943081 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb8e16-351e-4af5-97f3-8db01501bf4d None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:00.963661 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3ea44-d3a9-46cf-b8b2-65e710af09da None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:01.000059 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e7258-a15b-4ca7-925c-b323e5ca4413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:01.000669 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e7258-a15b-4ca7-925c-b323e5ca4413 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:01.000954 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e7258-a15b-4ca7-925c-b323e5ca4413 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:01.001238 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e7258-a15b-4ca7-925c-b323e5ca4413 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:01.002486 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e7258-a15b-4ca7-925c-b323e5ca4413 None admin] RBAC: Adding query filter params (name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:01.002799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e7258-a15b-4ca7-925c-b323e5ca4413 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:01.004174 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e7258-a15b-4ca7-925c-b323e5ca4413 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:01.012725 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 288/569] 10.222.0.79 () {56 vars in 1103 bytes} [Wed Aug 31 19:05:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:01.013523 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e7258-a15b-4ca7-925c-b323e5ca4413 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:01.058005 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb8e16-351e-4af5-97f3-8db01501bf4d None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:01.100458 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeadb7d-1887-440c-919e-9e4ce05a0c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:01.101787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeadb7d-1887-440c-919e-9e4ce05a0c13 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:01.102116 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeadb7d-1887-440c-919e-9e4ce05a0c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:01.102422 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeadb7d-1887-440c-919e-9e4ce05a0c13 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:01.118236 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeadb7d-1887-440c-919e-9e4ce05a0c13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:05:01.120220 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e7258-a15b-4ca7-925c-b323e5ca4413 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:01.123858 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-cfeadb7d-1887-440c-919e-9e4ce05a0c13 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:05:01.123858 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:01.123858 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:01.123858 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:01.123858 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:01.123858 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:01.123858 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:01.123858 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:01.123858 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:01.123858 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:01.123858 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:01.123858 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:01.123858 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:05:01.123858 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:05:01.123858 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:05:01.123858 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:05:01.124787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:05:01.124787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:05:01.124787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:05:01.124787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:05:01.124787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:01.124787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:01.124787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:01.124787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:01.124787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:01.124787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:01.124787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:01.124787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:01.124787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:01.124787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:01.124787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:01.124787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:01.131119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:01.131119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:01.131119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:01.131119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:01.131119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:05:01.131119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:05:01.131119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:05:01.131119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:05:01.131119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:05:01.131119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:05:01.131119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:05:01.131119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:01.131119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 282/570] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 19:05:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:01.131119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeadb7d-1887-440c-919e-9e4ce05a0c13 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:01.131877 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:01.160881 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a427a1f-edee-4006-98dc-dde328481bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:01.161750 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a427a1f-edee-4006-98dc-dde328481bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:01.162242 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a427a1f-edee-4006-98dc-dde328481bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:01.162720 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a427a1f-edee-4006-98dc-dde328481bd6 None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:01.163413 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a427a1f-edee-4006-98dc-dde328481bd6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:01.163718 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a427a1f-edee-4006-98dc-dde328481bd6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:01.165159 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a427a1f-edee-4006-98dc-dde328481bd6 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:01.165405 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:01.183415 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 289/571] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 19:05:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:01.183415 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a427a1f-edee-4006-98dc-dde328481bd6 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:01.243930 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeadb7d-1887-440c-919e-9e4ce05a0c13 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:01.278320 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d7819-034a-47ce-8ffd-96fa8300d6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:01.278965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d7819-034a-47ce-8ffd-96fa8300d6a0 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:01.279246 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d7819-034a-47ce-8ffd-96fa8300d6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:01.279514 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d7819-034a-47ce-8ffd-96fa8300d6a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:01.284040 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a427a1f-edee-4006-98dc-dde328481bd6 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:01.289781 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d7819-034a-47ce-8ffd-96fa8300d6a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:01.291280 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d7819-034a-47ce-8ffd-96fa8300d6a0 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:01.306634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-e29d7819-034a-47ce-8ffd-96fa8300d6a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:01.306634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:01.306634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:01.306634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:01.306634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:01.306634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:01.306634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:01.306634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:01.306634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:01.306634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:01.306634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:01.306634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:01.306634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:01.306634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:01.306634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:01.306634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:01.307653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:01.307653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:01.307653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:01.307653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:01.307653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:01.307653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:01.307653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:01.307653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:01.307653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:01.307653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:01.307653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:01.307653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:01.307653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:01.307653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:01.307653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:01.307653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:01.307653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:01.308601 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:01.308601 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:01.308601 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:01.308601 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 283/572] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:01.308601 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d7819-034a-47ce-8ffd-96fa8300d6a0 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:01.320570 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04472f-7eac-4087-8cf7-fd62a3386e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:01.321200 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04472f-7eac-4087-8cf7-fd62a3386e6e None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:01.321478 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04472f-7eac-4087-8cf7-fd62a3386e6e None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:01.321749 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04472f-7eac-4087-8cf7-fd62a3386e6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:01.331929 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d04472f-7eac-4087-8cf7-fd62a3386e6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:01.333367 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d04472f-7eac-4087-8cf7-fd62a3386e6e None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:01.348227 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-1d04472f-7eac-4087-8cf7-fd62a3386e6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:01.348227 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:01.348227 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:01.348227 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:01.348227 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:01.348227 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:01.348227 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:01.348227 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:01.348227 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:01.348227 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:01.348227 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:01.348227 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:01.348227 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:01.348227 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:01.348227 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:01.348227 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:01.349259 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:01.349259 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:01.349259 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:01.349259 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:01.349259 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:01.349259 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:01.349259 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:01.349259 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:01.349259 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:01.349259 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:01.349259 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:01.349259 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:01.349259 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:01.349259 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:01.349259 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:01.349259 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:01.349259 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:01.350190 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:01.350190 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:01.350190 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:01.350190 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 290/573] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:01.350190 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04472f-7eac-4087-8cf7-fd62a3386e6e None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:01.369985 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:01.395208 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:01.414080 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d7819-034a-47ce-8ffd-96fa8300d6a0 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:01.448068 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a29c17-612b-49cb-a4d3-c14f5fe45d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:01.448671 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a29c17-612b-49cb-a4d3-c14f5fe45d11 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:01.448951 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a29c17-612b-49cb-a4d3-c14f5fe45d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:01.449229 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a29c17-612b-49cb-a4d3-c14f5fe45d11 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:01.449895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a29c17-612b-49cb-a4d3-c14f5fe45d11 None admin] RBAC: Adding query filter params (name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:01.450202 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a29c17-612b-49cb-a4d3-c14f5fe45d11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:01.451590 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a29c17-612b-49cb-a4d3-c14f5fe45d11 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:01.451764 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04472f-7eac-4087-8cf7-fd62a3386e6e None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:01.459881 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 284/574] 10.222.0.79 () {56 vars in 1103 bytes} [Wed Aug 31 19:05:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:01.460665 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a29c17-612b-49cb-a4d3-c14f5fe45d11 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:01.491642 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c3374-2670-459d-8a0e-cda6d3c35a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:01.492251 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c3374-2670-459d-8a0e-cda6d3c35a6b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:01.492533 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c3374-2670-459d-8a0e-cda6d3c35a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:01.492839 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c3374-2670-459d-8a0e-cda6d3c35a6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:01.493578 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c3374-2670-459d-8a0e-cda6d3c35a6b None admin] RBAC: Adding query filter params (role.id=0230e2e79da94067a82374ceada29d3f, scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507, user.id=3b289a0bef53460ca5173ad946394d72) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:01.493890 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c3374-2670-459d-8a0e-cda6d3c35a6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:01.495369 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c3374-2670-459d-8a0e-cda6d3c35a6b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:01.500686 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 291/575] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:05:01 2022] GET /identity/v3/role_assignments?user.id=3b289a0bef53460ca5173ad946394d72&scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507&role.id=0230e2e79da94067a82374ceada29d3f => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:01.501521 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c3374-2670-459d-8a0e-cda6d3c35a6b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:01.590217 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a29c17-612b-49cb-a4d3-c14f5fe45d11 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:01.615845 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:01.636669 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c3374-2670-459d-8a0e-cda6d3c35a6b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:01.640400 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78820266-1f93-4977-80eb-f68a2fb61b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:01.641134 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78820266-1f93-4977-80eb-f68a2fb61b53 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:01.641484 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78820266-1f93-4977-80eb-f68a2fb61b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:01.641827 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78820266-1f93-4977-80eb-f68a2fb61b53 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:01.656600 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78820266-1f93-4977-80eb-f68a2fb61b53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:05:01.662325 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-78820266-1f93-4977-80eb-f68a2fb61b53 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:05:01.662325 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:01.662325 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:01.662325 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:01.662325 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:01.662325 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:01.662325 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:01.662325 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:01.662325 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:01.662325 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:01.662325 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:01.662325 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:01.662325 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:05:01.662325 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:05:01.662325 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:05:01.662325 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:05:01.663301 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:05:01.663301 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:05:01.663301 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:05:01.663301 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:05:01.663301 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:01.663301 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:01.663301 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:01.663301 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:01.663301 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:01.663301 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:01.663301 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:01.663301 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:01.663301 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:01.663301 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:01.663301 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:01.663301 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:01.664129 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:01.664129 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:01.664129 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:01.664129 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:01.664129 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:05:01.664129 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:05:01.664129 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:05:01.664129 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:05:01.664129 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:05:01.664129 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:05:01.664129 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:05:01.664129 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:01.664129 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 285/576] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 19:05:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:01.664816 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78820266-1f93-4977-80eb-f68a2fb61b53 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:01.669486 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:01.689968 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac932c8-078e-48cd-8997-54b10ffbd902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:01.691190 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac932c8-078e-48cd-8997-54b10ffbd902 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:01.691471 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac932c8-078e-48cd-8997-54b10ffbd902 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:01.691746 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac932c8-078e-48cd-8997-54b10ffbd902 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:01.692703 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac932c8-078e-48cd-8997-54b10ffbd902 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:01.693007 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac932c8-078e-48cd-8997-54b10ffbd902 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:01.695652 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac932c8-078e-48cd-8997-54b10ffbd902 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:01.716149 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 292/577] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:01.718173 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac932c8-078e-48cd-8997-54b10ffbd902 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:01.800042 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78820266-1f93-4977-80eb-f68a2fb61b53 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:01.847085 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac932c8-078e-48cd-8997-54b10ffbd902 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:01.847684 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5528c122-0438-408d-8216-5241d620afd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:01.848790 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5528c122-0438-408d-8216-5241d620afd7 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:01.849060 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5528c122-0438-408d-8216-5241d620afd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:01.850204 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5528c122-0438-408d-8216-5241d620afd7 None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:01.850915 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5528c122-0438-408d-8216-5241d620afd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:01.851217 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5528c122-0438-408d-8216-5241d620afd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:01.852854 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5528c122-0438-408d-8216-5241d620afd7 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:01.872543 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 286/578] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:01.872750 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5528c122-0438-408d-8216-5241d620afd7 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:01.891504 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee59925-b4cd-4e05-ac01-91245d204393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:01.892282 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee59925-b4cd-4e05-ac01-91245d204393 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:01.892634 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee59925-b4cd-4e05-ac01-91245d204393 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:01.892976 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee59925-b4cd-4e05-ac01-91245d204393 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:01.903801 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee59925-b4cd-4e05-ac01-91245d204393 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:01.905286 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee59925-b4cd-4e05-ac01-91245d204393 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:01.907522 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:01.922572 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-cee59925-b4cd-4e05-ac01-91245d204393 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:01.922572 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:01.922572 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:01.922572 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:01.922572 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:01.922572 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:01.922572 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:01.922572 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:01.922572 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:01.922572 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:01.922572 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:01.922572 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:01.922572 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:01.922572 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:01.922572 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:01.922572 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:01.924141 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:01.924141 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:01.924141 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:01.924141 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:01.924141 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:01.924141 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:01.924141 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:01.924141 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:01.924141 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:01.924141 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:01.924141 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:01.924141 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:01.924141 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:01.924141 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:01.924141 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:01.924141 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:01.924141 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:01.925015 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:01.925015 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:01.925015 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:01.925015 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 293/579] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:01.925232 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee59925-b4cd-4e05-ac01-91245d204393 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:01.950424 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:01.993394 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5528c122-0438-408d-8216-5241d620afd7 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:02.030709 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb7bb8-655d-45af-a610-3e89ed3f78a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:02.031323 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb7bb8-655d-45af-a610-3e89ed3f78a2 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:02.031603 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb7bb8-655d-45af-a610-3e89ed3f78a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:02.031883 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb7bb8-655d-45af-a610-3e89ed3f78a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:02.032547 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffb7bb8-655d-45af-a610-3e89ed3f78a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:02.033381 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffb7bb8-655d-45af-a610-3e89ed3f78a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:02.034767 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffb7bb8-655d-45af-a610-3e89ed3f78a2 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:02.034957 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee59925-b4cd-4e05-ac01-91245d204393 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:02.049933 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 287/580] 10.222.0.79 () {56 vars in 1103 bytes} [Wed Aug 31 19:05:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:02.049933 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb7bb8-655d-45af-a610-3e89ed3f78a2 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:02.081622 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c1286-d5f7-4b4d-aa50-7a3ec0914e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:02.082360 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c1286-d5f7-4b4d-aa50-7a3ec0914e0d None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:02.082681 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c1286-d5f7-4b4d-aa50-7a3ec0914e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:02.083097 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c1286-d5f7-4b4d-aa50-7a3ec0914e0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:02.091122 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c1286-d5f7-4b4d-aa50-7a3ec0914e0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:02.092599 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c1286-d5f7-4b4d-aa50-7a3ec0914e0d None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:02.106770 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-ad1c1286-d5f7-4b4d-aa50-7a3ec0914e0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:02.106770 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:02.106770 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:02.106770 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:02.106770 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:02.106770 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:02.106770 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:02.106770 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:02.106770 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:02.106770 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:02.106770 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:02.106770 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:02.106770 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:05:02.106770 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:05:02.106770 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:05:02.107712 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:05:02.107712 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:02.107712 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:02.107712 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:02.107712 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:02.107712 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:02.107712 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:02.107712 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:02.107712 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:02.107712 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:02.107712 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:02.107712 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:02.107712 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:02.107712 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:02.107712 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:02.107712 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:02.107712 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:02.108677 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:05:02.108677 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:05:02.108677 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:05:02.108677 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:05:02.108677 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:05:02.108677 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:05:02.108677 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:02.108677 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:02.108677 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 294/581] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:05:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:02.109162 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c1286-d5f7-4b4d-aa50-7a3ec0914e0d None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:02.164219 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb7bb8-655d-45af-a610-3e89ed3f78a2 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:02.167747 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:02.191861 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:02.202248 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eafdf4-df7f-46df-9eb0-74e33b75adf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:02.202919 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eafdf4-df7f-46df-9eb0-74e33b75adf1 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:02.203187 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eafdf4-df7f-46df-9eb0-74e33b75adf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:02.203460 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eafdf4-df7f-46df-9eb0-74e33b75adf1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:02.211797 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eafdf4-df7f-46df-9eb0-74e33b75adf1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:02.213214 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eafdf4-df7f-46df-9eb0-74e33b75adf1 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:02.215634 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c1286-d5f7-4b4d-aa50-7a3ec0914e0d None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:02.224374 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-c5eafdf4-df7f-46df-9eb0-74e33b75adf1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 19:05:02.224374 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:02.224374 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:02.224374 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:02.224374 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:02.224374 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:02.224374 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:02.224374 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:02.224374 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:02.224374 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:02.224374 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:02.224374 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:02.224374 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:05:02.224374 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:05:02.224374 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:05:02.224374 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:05:02.225634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:02.225634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:02.225634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:05:02.225634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:02.225634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:05:02.225634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:02.225634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:02.225634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:02.225634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:02.225634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:02.225634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:02.225634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:02.225634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:02.225634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:02.225634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:02.225634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:02.225634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:02.225634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:02.227696 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:02.227696 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:02.227696 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:05:02.227696 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:05:02.227696 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:05:02.227696 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:05:02.227696 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:05:02.227696 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:05:02.227696 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 19:05:02.227696 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:02.227696 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 288/582] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:05:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:02.227696 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eafdf4-df7f-46df-9eb0-74e33b75adf1 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:02.260383 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9e094-9aa8-4f39-84d8-b10ce7641402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:02.260984 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9e094-9aa8-4f39-84d8-b10ce7641402 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:02.261270 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9e094-9aa8-4f39-84d8-b10ce7641402 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:02.261540 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9e094-9aa8-4f39-84d8-b10ce7641402 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:02.262190 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b9e094-9aa8-4f39-84d8-b10ce7641402 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:02.262514 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b9e094-9aa8-4f39-84d8-b10ce7641402 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:02.263889 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b9e094-9aa8-4f39-84d8-b10ce7641402 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:02.277369 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 295/583] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:02.278101 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9e094-9aa8-4f39-84d8-b10ce7641402 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:02.360925 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eafdf4-df7f-46df-9eb0-74e33b75adf1 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:02.394125 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9e094-9aa8-4f39-84d8-b10ce7641402 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:02.400184 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5f7e9-5463-49a4-8dfb-67ffb1bf38a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:02.401014 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5f7e9-5463-49a4-8dfb-67ffb1bf38a0 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:02.401444 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5f7e9-5463-49a4-8dfb-67ffb1bf38a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:02.401861 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5f7e9-5463-49a4-8dfb-67ffb1bf38a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:02.410429 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:02.416212 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5f7e9-5463-49a4-8dfb-67ffb1bf38a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:02.418299 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5f7e9-5463-49a4-8dfb-67ffb1bf38a0 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:02.431932 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a180eb-56be-48c0-b71b-ddba631ab20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:02.432541 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a180eb-56be-48c0-b71b-ddba631ab20f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:02.432820 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a180eb-56be-48c0-b71b-ddba631ab20f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:02.433095 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a180eb-56be-48c0-b71b-ddba631ab20f None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:02.433792 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a180eb-56be-48c0-b71b-ddba631ab20f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:02.434101 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a180eb-56be-48c0-b71b-ddba631ab20f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:02.434971 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-e0f5f7e9-5463-49a4-8dfb-67ffb1bf38a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:02.434971 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:02.434971 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:02.434971 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:02.434971 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:02.434971 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:02.434971 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:02.434971 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:02.434971 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:02.434971 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:02.434971 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:02.434971 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:02.434971 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:02.434971 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:02.434971 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:02.434971 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:02.436096 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:02.436096 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:02.436096 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:02.436096 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:02.436096 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:02.436096 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:02.436096 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:02.436096 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:02.436096 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:02.436096 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:02.436096 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:02.436096 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:02.436096 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:02.436096 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:02.436096 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:02.436096 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:02.436096 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:02.437195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:02.437195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:02.437195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:02.437414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a180eb-56be-48c0-b71b-ddba631ab20f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:02.438822 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 289/584] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:02.439866 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5f7e9-5463-49a4-8dfb-67ffb1bf38a0 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:02.449169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 296/585] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 19:05:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:02.450572 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a180eb-56be-48c0-b71b-ddba631ab20f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:02.488806 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:02.565129 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a180eb-56be-48c0-b71b-ddba631ab20f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:02.565354 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5f7e9-5463-49a4-8dfb-67ffb1bf38a0 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:02.604207 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b5542-fffe-431c-a6f6-fb10baaf9f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:02.604831 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b5542-fffe-431c-a6f6-fb10baaf9f82 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:02.605107 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b5542-fffe-431c-a6f6-fb10baaf9f82 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:02.605440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b5542-fffe-431c-a6f6-fb10baaf9f82 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:02.608132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b1fc5-401e-4a87-b945-ddd4433f9b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:02.608839 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b1fc5-401e-4a87-b945-ddd4433f9b10 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:02.609228 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b1fc5-401e-4a87-b945-ddd4433f9b10 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:02.609595 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b1fc5-401e-4a87-b945-ddd4433f9b10 None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:02.610512 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1b1fc5-401e-4a87-b945-ddd4433f9b10 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:02.610948 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1b1fc5-401e-4a87-b945-ddd4433f9b10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:02.612514 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1b1fc5-401e-4a87-b945-ddd4433f9b10 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:02.613345 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b5542-fffe-431c-a6f6-fb10baaf9f82 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:02.614795 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b5542-fffe-431c-a6f6-fb10baaf9f82 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:02.627088 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-f22b5542-fffe-431c-a6f6-fb10baaf9f82 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 19:05:02.627088 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:02.627088 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:02.627088 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:02.627088 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:02.627088 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:02.627088 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:02.627088 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:02.627088 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:02.627088 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:02.627088 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:02.627088 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:02.627088 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:05:02.627088 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:05:02.627088 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:05:02.627088 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:05:02.628215 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:02.628215 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:02.628215 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:05:02.628215 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:02.628215 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:05:02.628215 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:02.628215 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:02.628215 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:02.628215 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:02.628215 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:02.628215 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:02.628215 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:02.628215 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:02.628215 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:02.628215 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:02.628215 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:02.628215 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:02.628215 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:02.629526 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:02.629526 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:02.629526 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:05:02.629526 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:05:02.629526 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:05:02.629526 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:05:02.629526 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:05:02.629526 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:05:02.629526 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 19:05:02.629526 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:02.630805 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 297/586] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 19:05:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:02.632310 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b5542-fffe-431c-a6f6-fb10baaf9f82 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:02.639497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 290/587] 10.222.0.79 () {56 vars in 1137 bytes} [Wed Aug 31 19:05:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:02.640441 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b1fc5-401e-4a87-b945-ddd4433f9b10 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:02.672131 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:02.739944 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:02.743889 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b5542-fffe-431c-a6f6-fb10baaf9f82 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:02.747159 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b1fc5-401e-4a87-b945-ddd4433f9b10 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:02.780498 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35582ec0-1ddc-46f7-9c57-1e238c5b5400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:02.781099 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35582ec0-1ddc-46f7-9c57-1e238c5b5400 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:02.781384 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35582ec0-1ddc-46f7-9c57-1e238c5b5400 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:02.781654 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35582ec0-1ddc-46f7-9c57-1e238c5b5400 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:02.782304 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35582ec0-1ddc-46f7-9c57-1e238c5b5400 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:02.782905 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35582ec0-1ddc-46f7-9c57-1e238c5b5400 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:02.783840 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685e2fb-088b-457e-9022-cc44abb1af0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:02.784049 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35582ec0-1ddc-46f7-9c57-1e238c5b5400 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:02.784832 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685e2fb-088b-457e-9022-cc44abb1af0d None admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:02.785253 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685e2fb-088b-457e-9022-cc44abb1af0d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:02.785668 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685e2fb-088b-457e-9022-cc44abb1af0d None admin] PATH_INFO: `/v3/projects/f9e550ea75dd4245bd9c2bcd6322c507/users/1fd6d45d1bc3479da72cb1a1990a6137/roles/0230e2e79da94067a82374ceada29d3f` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:02.797193 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 298/588] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:02.798131 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35582ec0-1ddc-46f7-9c57-1e238c5b5400 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:02.806419 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685e2fb-088b-457e-9022-cc44abb1af0d None admin] RBAC: Authorizing `identity:create_grant(project_id=f9e550ea75dd4245bd9c2bcd6322c507, user_id=1fd6d45d1bc3479da72cb1a1990a6137, role_id=0230e2e79da94067a82374ceada29d3f)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:02.808069 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685e2fb-088b-457e-9022-cc44abb1af0d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:02.824126 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 291/589] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 19:05:02 2022] PUT /identity/v3/projects/f9e550ea75dd4245bd9c2bcd6322c507/users/1fd6d45d1bc3479da72cb1a1990a6137/roles/0230e2e79da94067a82374ceada29d3f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:05:02.824963 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685e2fb-088b-457e-9022-cc44abb1af0d None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:02.919770 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:02.929367 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35582ec0-1ddc-46f7-9c57-1e238c5b5400 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:02.972157 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685e2fb-088b-457e-9022-cc44abb1af0d None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:02.974082 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025966c0-0810-4d28-8a08-9f53f8c25170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:02.974838 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025966c0-0810-4d28-8a08-9f53f8c25170 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:02.975182 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025966c0-0810-4d28-8a08-9f53f8c25170 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:02.975510 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025966c0-0810-4d28-8a08-9f53f8c25170 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:02.976383 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025966c0-0810-4d28-8a08-9f53f8c25170 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:02.977017 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025966c0-0810-4d28-8a08-9f53f8c25170 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:02.978670 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025966c0-0810-4d28-8a08-9f53f8c25170 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:02.999118 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 299/590] 10.222.0.79 () {56 vars in 1139 bytes} [Wed Aug 31 19:05:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:02.999974 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025966c0-0810-4d28-8a08-9f53f8c25170 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:03.011894 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e732d-0966-4657-803f-6df5fd1b148e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:03.012533 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e732d-0966-4657-803f-6df5fd1b148e None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:03.012828 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e732d-0966-4657-803f-6df5fd1b148e None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:03.013086 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e732d-0966-4657-803f-6df5fd1b148e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:03.024444 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e732d-0966-4657-803f-6df5fd1b148e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:03.025904 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e732d-0966-4657-803f-6df5fd1b148e None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:03.033158 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:03.043156 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-d47e732d-0966-4657-803f-6df5fd1b148e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:03.043156 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:03.043156 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:03.043156 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:03.043156 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:03.043156 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:03.043156 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:03.043156 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:03.043156 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:03.043156 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:03.043156 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:03.043156 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:03.043156 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:03.043156 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:03.043156 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:03.043156 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:03.044450 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:03.044450 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:03.044450 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:03.044450 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:03.044450 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:03.044450 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:03.044450 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:03.044450 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:03.044450 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:03.044450 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:03.044450 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:03.044450 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:03.044450 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:03.044450 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:03.044450 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:03.044450 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:03.044450 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:03.045532 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:03.045532 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:03.045532 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:03.047383 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 292/591] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:03.051445 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e732d-0966-4657-803f-6df5fd1b148e None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:03.135782 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025966c0-0810-4d28-8a08-9f53f8c25170 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:03.175103 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b975806-5b95-4246-a386-3b28679c4e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:03.175868 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b975806-5b95-4246-a386-3b28679c4e01 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:03.176248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b975806-5b95-4246-a386-3b28679c4e01 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:03.176755 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b975806-5b95-4246-a386-3b28679c4e01 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:03.180812 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e732d-0966-4657-803f-6df5fd1b148e None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:03.185355 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b975806-5b95-4246-a386-3b28679c4e01 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:03.187090 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b975806-5b95-4246-a386-3b28679c4e01 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:03.199755 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-1b975806-5b95-4246-a386-3b28679c4e01 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 19:05:03.199755 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:03.199755 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:03.199755 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:03.199755 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:03.199755 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:03.199755 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:03.199755 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:03.199755 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:03.199755 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:03.199755 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:03.199755 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:03.199755 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:05:03.199755 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:05:03.199755 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:05:03.199755 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:05:03.200940 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:03.200940 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:03.200940 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:05:03.200940 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:03.200940 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:05:03.200940 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:03.200940 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:03.200940 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:03.200940 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:03.200940 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:03.200940 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:03.200940 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:03.200940 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:03.200940 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:03.200940 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:03.200940 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:03.200940 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:03.200940 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:03.202132 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:03.202132 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:03.202132 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:05:03.202132 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:05:03.202132 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:05:03.202132 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:05:03.202132 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:05:03.202132 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:05:03.202132 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 19:05:03.202132 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:03.203873 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 300/592] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:05:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:03.205436 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b975806-5b95-4246-a386-3b28679c4e01 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:03.222136 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:03.229599 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16c736-f9d1-489e-b089-0d4baf44c445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:03.230440 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16c736-f9d1-489e-b089-0d4baf44c445 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:03.230887 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16c736-f9d1-489e-b089-0d4baf44c445 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:03.231303 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16c736-f9d1-489e-b089-0d4baf44c445 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:03.247892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b16c736-f9d1-489e-b089-0d4baf44c445 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:03.250427 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b16c736-f9d1-489e-b089-0d4baf44c445 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:03.269994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-0b16c736-f9d1-489e-b089-0d4baf44c445 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:03.269994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:03.269994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:03.269994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:03.269994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:03.269994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:03.269994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:03.269994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:03.269994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:03.269994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:03.269994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:03.269994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:03.269994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:03.269994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:03.269994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:03.269994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:03.271175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:03.271175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:03.271175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:03.271175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:03.271175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:03.271175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:03.271175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:03.271175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:03.271175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:03.271175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:03.271175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:03.271175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:03.271175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:03.271175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:03.271175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:03.271175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:03.271175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:03.272264 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:03.272264 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:03.272264 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:03.278843 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 293/593] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:03.279494 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16c736-f9d1-489e-b089-0d4baf44c445 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:03.328133 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b975806-5b95-4246-a386-3b28679c4e01 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:03.345900 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:03.364621 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc31b7-0aa2-4a38-b6cb-f011f8f8f507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:03.365230 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc31b7-0aa2-4a38-b6cb-f011f8f8f507 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:03.365508 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc31b7-0aa2-4a38-b6cb-f011f8f8f507 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:03.365837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc31b7-0aa2-4a38-b6cb-f011f8f8f507 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:03.366538 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc31b7-0aa2-4a38-b6cb-f011f8f8f507 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:03.366940 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc31b7-0aa2-4a38-b6cb-f011f8f8f507 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:03.368354 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc31b7-0aa2-4a38-b6cb-f011f8f8f507 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:03.385404 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 301/594] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:03.386306 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc31b7-0aa2-4a38-b6cb-f011f8f8f507 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:03.410009 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16c736-f9d1-489e-b089-0d4baf44c445 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:03.447555 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe1aa2-ea50-4350-a0f4-d5aa5fdb401e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:03.448175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe1aa2-ea50-4350-a0f4-d5aa5fdb401e None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:03.448417 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe1aa2-ea50-4350-a0f4-d5aa5fdb401e None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:03.448621 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe1aa2-ea50-4350-a0f4-d5aa5fdb401e None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:03.449364 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe1aa2-ea50-4350-a0f4-d5aa5fdb401e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:03.449667 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe1aa2-ea50-4350-a0f4-d5aa5fdb401e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:03.451132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe1aa2-ea50-4350-a0f4-d5aa5fdb401e None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:03.469544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 294/595] 10.222.0.79 () {56 vars in 1137 bytes} [Wed Aug 31 19:05:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:03.470918 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe1aa2-ea50-4350-a0f4-d5aa5fdb401e None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:03.481974 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:03.518252 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc31b7-0aa2-4a38-b6cb-f011f8f8f507 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:03.565995 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0286f3d-c6fb-443d-afd6-5e2f21d87e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:03.566641 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0286f3d-c6fb-443d-afd6-5e2f21d87e17 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:03.566925 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0286f3d-c6fb-443d-afd6-5e2f21d87e17 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:03.567225 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0286f3d-c6fb-443d-afd6-5e2f21d87e17 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:03.567920 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0286f3d-c6fb-443d-afd6-5e2f21d87e17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:03.568222 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0286f3d-c6fb-443d-afd6-5e2f21d87e17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:03.569631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0286f3d-c6fb-443d-afd6-5e2f21d87e17 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:03.577875 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe1aa2-ea50-4350-a0f4-d5aa5fdb401e None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:03.582515 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 302/596] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:03.584120 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032276c-ea34-481b-bff8-58020e27d164 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:03.584593 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032276c-ea34-481b-bff8-58020e27d164 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:03.585063 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032276c-ea34-481b-bff8-58020e27d164 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:03.587070 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 303/597] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:05:03.588134 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032276c-ea34-481b-bff8-58020e27d164 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:03.591391 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:03.617742 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e8b03-5783-471b-8bf9-772a5809dec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:03.618371 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e8b03-5783-471b-8bf9-772a5809dec2 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:03.618682 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e8b03-5783-471b-8bf9-772a5809dec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:03.618961 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e8b03-5783-471b-8bf9-772a5809dec2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:03.625743 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2e8b03-5783-471b-8bf9-772a5809dec2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:03.627266 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2e8b03-5783-471b-8bf9-772a5809dec2 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:03.639682 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-ea2e8b03-5783-471b-8bf9-772a5809dec2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:03.639682 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:03.639682 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:03.639682 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:03.639682 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:03.639682 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:03.639682 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:03.639682 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:03.639682 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:03.639682 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:03.639682 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:03.639682 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:03.639682 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:05:03.639682 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:05:03.639682 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:05:03.640603 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:05:03.640603 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:03.640603 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:03.640603 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:03.640603 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:03.640603 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:03.640603 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:03.640603 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:03.640603 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:03.640603 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:03.640603 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:03.640603 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:03.640603 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:03.640603 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:03.640603 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:03.640603 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:03.640603 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:03.641471 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:05:03.641471 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:05:03.641471 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:05:03.641471 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:05:03.641471 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:05:03.641471 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:05:03.641471 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:03.641471 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:03.645536 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 295/598] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:05:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:03.646364 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e8b03-5783-471b-8bf9-772a5809dec2 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:03.702497 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032276c-ea34-481b-bff8-58020e27d164 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:03.734215 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:03.741044 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d438c64-8cf8-41c2-bded-2595ec8c774f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:03.741680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d438c64-8cf8-41c2-bded-2595ec8c774f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:03.742045 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d438c64-8cf8-41c2-bded-2595ec8c774f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:03.742245 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d438c64-8cf8-41c2-bded-2595ec8c774f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:03.753699 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e8b03-5783-471b-8bf9-772a5809dec2 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:03.754660 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d438c64-8cf8-41c2-bded-2595ec8c774f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:03.756720 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d438c64-8cf8-41c2-bded-2595ec8c774f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:03.770977 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-4d438c64-8cf8-41c2-bded-2595ec8c774f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:03.770977 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:03.770977 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:03.770977 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:03.770977 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:03.770977 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:03.770977 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:03.770977 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:03.770977 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:03.770977 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:03.770977 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:03.770977 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:03.770977 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:03.770977 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:03.770977 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:03.770977 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:03.771897 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:03.771897 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:03.771897 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:03.771897 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:03.771897 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:03.771897 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:03.771897 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:03.771897 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:03.771897 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:03.771897 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:03.771897 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:03.771897 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:03.771897 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:03.771897 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:03.771897 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:03.771897 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:03.771897 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:03.772765 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:03.772765 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:03.772765 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:03.772765 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 304/599] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:03.773703 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3fa3c-4d4d-4984-b6bc-3236c8d4ddba None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:03.773703 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3fa3c-4d4d-4984-b6bc-3236c8d4ddba None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:03.773703 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3fa3c-4d4d-4984-b6bc-3236c8d4ddba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:03.791878 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-4ce3fa3c-4d4d-4984-b6bc-3236c8d4ddba None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:03.793078 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4ce3fa3c-4d4d-4984-b6bc-3236c8d4ddba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:03.794548 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83791973-3ea4-4301-91ac-711743e8e527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:03.795179 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83791973-3ea4-4301-91ac-711743e8e527 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:03.795522 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83791973-3ea4-4301-91ac-711743e8e527 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:03.795801 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83791973-3ea4-4301-91ac-711743e8e527 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:03.803135 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83791973-3ea4-4301-91ac-711743e8e527 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:03.804561 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83791973-3ea4-4301-91ac-711743e8e527 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:03.816546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-83791973-3ea4-4301-91ac-711743e8e527 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:03.816546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:03.816546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:03.816546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:03.816546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:03.816546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:03.816546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:03.816546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:03.816546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:03.816546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:03.816546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:03.816546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:03.816546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:05:03.816546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:05:03.816546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:05:03.817405 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:05:03.817405 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:03.817405 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:03.817405 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:03.817405 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:03.817405 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:03.817405 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:03.817405 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:03.817405 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:03.817405 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:03.817405 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:03.817405 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:03.817405 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:03.817405 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:03.817405 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:03.817405 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:03.817405 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:03.818891 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:05:03.818891 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:05:03.818891 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:05:03.818891 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:05:03.818891 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:05:03.818891 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:05:03.818891 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:03.818891 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:03.818891 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 296/600] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:05:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:03.818891 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83791973-3ea4-4301-91ac-711743e8e527 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:03.848460 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:03.870413 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 305/601] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:05:03.871355 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3fa3c-4d4d-4984-b6bc-3236c8d4ddba None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:03.935810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83791973-3ea4-4301-91ac-711743e8e527 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:03.973458 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f87b6c-3ca1-4446-af93-8ac7d113f8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:03.974084 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f87b6c-3ca1-4446-af93-8ac7d113f8b4 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:03.974560 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f87b6c-3ca1-4446-af93-8ac7d113f8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:03.974906 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f87b6c-3ca1-4446-af93-8ac7d113f8b4 None admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:03.975838 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f87b6c-3ca1-4446-af93-8ac7d113f8b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:03.976204 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f87b6c-3ca1-4446-af93-8ac7d113f8b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:03.977974 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f87b6c-3ca1-4446-af93-8ac7d113f8b4 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:03.992839 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 297/602] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 19:05:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:03.993921 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f87b6c-3ca1-4446-af93-8ac7d113f8b4 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:04.014630 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3fa3c-4d4d-4984-b6bc-3236c8d4ddba None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:04.040050 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:04.066745 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c3389-5458-45c2-b58e-478f59f3b89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:04.067831 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c3389-5458-45c2-b58e-478f59f3b89b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:04.068353 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c3389-5458-45c2-b58e-478f59f3b89b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:04.068807 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c3389-5458-45c2-b58e-478f59f3b89b None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:04.069783 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c3389-5458-45c2-b58e-478f59f3b89b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:04.070267 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c3389-5458-45c2-b58e-478f59f3b89b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:04.072056 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c3389-5458-45c2-b58e-478f59f3b89b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:04.086212 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 306/603] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:04.087389 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c3389-5458-45c2-b58e-478f59f3b89b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:04.098472 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:04.111659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f87b6c-3ca1-4446-af93-8ac7d113f8b4 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:04.147302 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f851b-0add-4fdf-b431-8685d58b6b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:04.148044 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f851b-0add-4fdf-b431-8685d58b6b28 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:04.148421 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f851b-0add-4fdf-b431-8685d58b6b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:04.148807 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f851b-0add-4fdf-b431-8685d58b6b28 None admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:04.149970 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f851b-0add-4fdf-b431-8685d58b6b28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:04.149970 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f851b-0add-4fdf-b431-8685d58b6b28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:04.151539 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f851b-0add-4fdf-b431-8685d58b6b28 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:04.163788 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 298/604] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 19:05:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:04.165357 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f851b-0add-4fdf-b431-8685d58b6b28 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:04.211631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c3389-5458-45c2-b58e-478f59f3b89b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:04.246868 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf80e7-e217-49d7-8b71-c8dab9a90ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:04.247454 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf80e7-e217-49d7-8b71-c8dab9a90ad5 None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:04.247734 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf80e7-e217-49d7-8b71-c8dab9a90ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:04.248020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf80e7-e217-49d7-8b71-c8dab9a90ad5 None admin] PATH_INFO: `/v3/projects/f9e550ea75dd4245bd9c2bcd6322c507/users/17e0a157474749939b6f8d2af26d7d4e/roles/0230e2e79da94067a82374ceada29d3f` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:04.263675 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf80e7-e217-49d7-8b71-c8dab9a90ad5 None admin] RBAC: Authorizing `identity:create_grant(project_id=f9e550ea75dd4245bd9c2bcd6322c507, user_id=17e0a157474749939b6f8d2af26d7d4e, role_id=0230e2e79da94067a82374ceada29d3f)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:04.265125 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf80e7-e217-49d7-8b71-c8dab9a90ad5 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:04.274447 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f851b-0add-4fdf-b431-8685d58b6b28 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:04.279604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 307/605] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 19:05:04 2022] PUT /identity/v3/projects/f9e550ea75dd4245bd9c2bcd6322c507/users/17e0a157474749939b6f8d2af26d7d4e/roles/0230e2e79da94067a82374ceada29d3f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:05:04.283428 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf80e7-e217-49d7-8b71-c8dab9a90ad5 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:04.318776 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913847c7-f63c-4ac9-bcee-bb1faa0966c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:04.319541 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913847c7-f63c-4ac9-bcee-bb1faa0966c4 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:04.319866 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913847c7-f63c-4ac9-bcee-bb1faa0966c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:04.320177 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913847c7-f63c-4ac9-bcee-bb1faa0966c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:04.322293 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:04.330937 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913847c7-f63c-4ac9-bcee-bb1faa0966c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:04.332896 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913847c7-f63c-4ac9-bcee-bb1faa0966c4 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:04.349370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-913847c7-f63c-4ac9-bcee-bb1faa0966c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:04.349370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:04.349370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:04.349370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:04.349370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:04.349370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:04.349370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:04.349370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:04.349370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:04.349370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:04.349370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:04.349370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:04.349370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:05:04.349370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:05:04.349370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:05:04.350341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:05:04.350341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:04.350341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:04.350341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:04.350341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:04.350341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:04.350341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:04.350341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:04.350341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:04.350341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:04.350341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:04.350341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:04.350341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:04.350341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:04.350341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:04.350341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:04.350341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:04.351653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:05:04.351653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:05:04.351653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:05:04.351653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:05:04.351653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:05:04.351653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:05:04.351653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:04.351653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:04.351653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 299/606] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:05:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:04.352354 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913847c7-f63c-4ac9-bcee-bb1faa0966c4 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:04.368156 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:04.435477 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf80e7-e217-49d7-8b71-c8dab9a90ad5 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:04.483448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16d860-4114-4bb9-a71a-3f06dadf65be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:04.485020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16d860-4114-4bb9-a71a-3f06dadf65be None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:04.485442 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16d860-4114-4bb9-a71a-3f06dadf65be None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:04.486402 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16d860-4114-4bb9-a71a-3f06dadf65be None admin] PATH_INFO: `/v3/projects/f9e550ea75dd4245bd9c2bcd6322c507/users/a91998a2818444a595adc06f1f481fe1/roles/0230e2e79da94067a82374ceada29d3f` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:04.486775 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913847c7-f63c-4ac9-bcee-bb1faa0966c4 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:04.506878 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df16d860-4114-4bb9-a71a-3f06dadf65be None admin] RBAC: Authorizing `identity:create_grant(project_id=f9e550ea75dd4245bd9c2bcd6322c507, user_id=a91998a2818444a595adc06f1f481fe1, role_id=0230e2e79da94067a82374ceada29d3f)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:04.508882 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df16d860-4114-4bb9-a71a-3f06dadf65be None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:04.527401 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 308/607] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 19:05:04 2022] PUT /identity/v3/projects/f9e550ea75dd4245bd9c2bcd6322c507/users/a91998a2818444a595adc06f1f481fe1/roles/0230e2e79da94067a82374ceada29d3f => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:05:04.528598 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16d860-4114-4bb9-a71a-3f06dadf65be None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:04.530699 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73f462-3df1-49c3-a733-7891c51db8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:04.531788 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73f462-3df1-49c3-a733-7891c51db8c7 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:04.532209 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73f462-3df1-49c3-a733-7891c51db8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:04.532820 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73f462-3df1-49c3-a733-7891c51db8c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:04.549582 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e73f462-3df1-49c3-a733-7891c51db8c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:05:04.557181 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-8e73f462-3df1-49c3-a733-7891c51db8c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:05:04.557181 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:04.557181 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:04.557181 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:04.557181 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:04.557181 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:04.557181 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:04.557181 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:04.557181 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:04.557181 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:04.557181 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:04.557181 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:04.557181 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:05:04.557181 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:05:04.557181 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:05:04.557181 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:05:04.558419 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:05:04.558419 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:05:04.558419 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:05:04.558419 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:05:04.558419 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:04.558419 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:04.558419 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:04.558419 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:04.558419 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:04.558419 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:04.558419 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:04.558419 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:04.558419 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:04.558419 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:04.558419 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:04.558419 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:04.559561 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:04.559561 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:04.559561 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:04.559561 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:04.559561 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:05:04.559561 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:05:04.559561 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:05:04.559561 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:05:04.559561 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:05:04.559561 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:05:04.559561 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:05:04.559561 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:04.561839 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 300/608] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 19:05:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:04.569309 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73f462-3df1-49c3-a733-7891c51db8c7 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:04.632199 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:04.656196 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:04.662483 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16d860-4114-4bb9-a71a-3f06dadf65be None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:04.682694 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73f462-3df1-49c3-a733-7891c51db8c7 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:04.715856 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc2f7a2-5b07-4cc3-ab7a-ba4d09b2b05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:04.716478 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2f7a2-5b07-4cc3-ab7a-ba4d09b2b05b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:04.716874 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2f7a2-5b07-4cc3-ab7a-ba4d09b2b05b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:04.717149 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2f7a2-5b07-4cc3-ab7a-ba4d09b2b05b None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:04.717849 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc2f7a2-5b07-4cc3-ab7a-ba4d09b2b05b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:04.718149 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc2f7a2-5b07-4cc3-ab7a-ba4d09b2b05b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:04.719666 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc2f7a2-5b07-4cc3-ab7a-ba4d09b2b05b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:04.722954 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefdbf9-6928-4aaf-87a8-59c5be96bd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:04.723814 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefdbf9-6928-4aaf-87a8-59c5be96bd1d None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:04.724237 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefdbf9-6928-4aaf-87a8-59c5be96bd1d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:04.724646 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefdbf9-6928-4aaf-87a8-59c5be96bd1d None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:04.725463 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adefdbf9-6928-4aaf-87a8-59c5be96bd1d None admin] RBAC: Adding query filter params (name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:04.725955 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adefdbf9-6928-4aaf-87a8-59c5be96bd1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:04.727779 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adefdbf9-6928-4aaf-87a8-59c5be96bd1d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:04.737715 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 301/609] 10.222.0.79 () {56 vars in 1103 bytes} [Wed Aug 31 19:05:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:04.743352 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefdbf9-6928-4aaf-87a8-59c5be96bd1d None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:04.745480 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 309/610] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 19:05:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:04.763599 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc2f7a2-5b07-4cc3-ab7a-ba4d09b2b05b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:04.862245 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefdbf9-6928-4aaf-87a8-59c5be96bd1d None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:04.899115 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195c784-0617-4113-8dec-91dc26cd60a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:04.899763 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195c784-0617-4113-8dec-91dc26cd60a0 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:04.900090 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195c784-0617-4113-8dec-91dc26cd60a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:04.900461 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195c784-0617-4113-8dec-91dc26cd60a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:04.912100 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6195c784-0617-4113-8dec-91dc26cd60a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:04.913579 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6195c784-0617-4113-8dec-91dc26cd60a0 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:04.929869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-6195c784-0617-4113-8dec-91dc26cd60a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:04.929869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:04.929869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:04.929869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:04.929869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:04.929869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:04.929869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:04.929869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:04.929869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:04.929869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:04.929869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:04.929869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:04.929869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:04.929869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:04.929869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:04.929869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:04.930892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:04.930892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:04.930892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:04.930892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:04.930892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:04.930892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:04.930892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:04.930892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:04.930892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:04.930892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:04.930892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:04.930892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:04.930892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:04.930892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:04.930892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:04.930892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:04.930892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:04.931765 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:04.931765 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:04.931765 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:04.932345 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 302/611] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:04.934974 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:04.937482 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195c784-0617-4113-8dec-91dc26cd60a0 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:04.966701 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc2f7a2-5b07-4cc3-ab7a-ba4d09b2b05b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:05.013163 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a02e04-d891-451f-a949-07b75de632e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:05.014324 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a02e04-d891-451f-a949-07b75de632e3 None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:05.014838 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a02e04-d891-451f-a949-07b75de632e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:05.015113 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a02e04-d891-451f-a949-07b75de632e3 None admin] PATH_INFO: `/v3/projects/f9e550ea75dd4245bd9c2bcd6322c507/users/254dd957da6345f79bcab42b27b8d2cc/roles/0230e2e79da94067a82374ceada29d3f` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:05.019012 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:05.037908 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a02e04-d891-451f-a949-07b75de632e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=f9e550ea75dd4245bd9c2bcd6322c507, user_id=254dd957da6345f79bcab42b27b8d2cc, role_id=0230e2e79da94067a82374ceada29d3f)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:05.039686 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a02e04-d891-451f-a949-07b75de632e3 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:05.060072 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 310/612] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 19:05:04 2022] PUT /identity/v3/projects/f9e550ea75dd4245bd9c2bcd6322c507/users/254dd957da6345f79bcab42b27b8d2cc/roles/0230e2e79da94067a82374ceada29d3f => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:05:05.061441 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafc285-8505-44f0-90c2-d0ab7bb735b9 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:05.061730 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafc285-8505-44f0-90c2-d0ab7bb735b9 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:05.062044 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafc285-8505-44f0-90c2-d0ab7bb735b9 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:05.067802 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 311/613] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:05:05.069209 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195c784-0617-4113-8dec-91dc26cd60a0 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:05.069695 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb278a32-a666-4c2b-8829-5b1042a3500a None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:05.070079 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb278a32-a666-4c2b-8829-5b1042a3500a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:05.070447 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb278a32-a666-4c2b-8829-5b1042a3500a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:05.090303 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-cb278a32-a666-4c2b-8829-5b1042a3500a None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:05.091720 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-cb278a32-a666-4c2b-8829-5b1042a3500a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:05.143304 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f8cc9-6ebf-44ed-895c-62cb3b4a8a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:05.148017 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f8cc9-6ebf-44ed-895c-62cb3b4a8a55 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:05.148377 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f8cc9-6ebf-44ed-895c-62cb3b4a8a55 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:05.148656 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f8cc9-6ebf-44ed-895c-62cb3b4a8a55 None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:05.149353 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f8cc9-6ebf-44ed-895c-62cb3b4a8a55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:05.149663 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f8cc9-6ebf-44ed-895c-62cb3b4a8a55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:05.151215 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f8cc9-6ebf-44ed-895c-62cb3b4a8a55 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:05.175423 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 312/614] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:05:05.179974 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 303/615] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:05:05.189632 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb278a32-a666-4c2b-8829-5b1042a3500a None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:05.301343 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb278a32-a666-4c2b-8829-5b1042a3500a None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:05.316870 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:05.340728 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44765f0b-8c77-4b89-b4de-dcb67ab7c316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:05.341359 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44765f0b-8c77-4b89-b4de-dcb67ab7c316 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:05.341634 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44765f0b-8c77-4b89-b4de-dcb67ab7c316 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:05.341902 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44765f0b-8c77-4b89-b4de-dcb67ab7c316 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:05.350142 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44765f0b-8c77-4b89-b4de-dcb67ab7c316 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:05.351934 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44765f0b-8c77-4b89-b4de-dcb67ab7c316 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:05.365217 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-44765f0b-8c77-4b89-b4de-dcb67ab7c316 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 19:05:05.365217 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:05.365217 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:05.365217 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:05.365217 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:05.365217 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:05.365217 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:05.365217 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:05.365217 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:05.365217 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:05.365217 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:05.365217 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:05.365217 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:05:05.365217 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:05:05.365217 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:05:05.365217 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:05:05.366192 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:05.366192 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:05.366192 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:05:05.366192 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:05.366192 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:05:05.366192 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:05.366192 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:05.366192 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:05.366192 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:05.366192 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:05.366192 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:05.366192 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:05.366192 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:05.366192 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:05.366192 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:05.366192 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:05.366192 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:05.366192 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:05.367155 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:05.367155 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:05.367155 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:05:05.367155 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:05:05.367155 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:05:05.367155 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:05:05.367155 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:05:05.367155 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:05:05.367155 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 19:05:05.367155 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:05.367155 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 313/616] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 19:05:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:05.372696 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f8cc9-6ebf-44ed-895c-62cb3b4a8a55 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:05.422049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:05.483287 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44765f0b-8c77-4b89-b4de-dcb67ab7c316 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:05.486715 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f8cc9-6ebf-44ed-895c-62cb3b4a8a55 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:05.542563 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c6623-fa2e-4734-a093-db012276c3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:05.544021 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c6623-fa2e-4734-a093-db012276c3cc None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:05.544306 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c6623-fa2e-4734-a093-db012276c3cc None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:05.544685 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c6623-fa2e-4734-a093-db012276c3cc None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:05.545446 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c6623-fa2e-4734-a093-db012276c3cc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:05.545753 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c6623-fa2e-4734-a093-db012276c3cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:05.551667 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c6623-fa2e-4734-a093-db012276c3cc None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:05.586051 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 304/617] 10.222.0.79 () {56 vars in 1135 bytes} [Wed Aug 31 19:05:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:05.591608 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c6623-fa2e-4734-a093-db012276c3cc None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:05.615339 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44765f0b-8c77-4b89-b4de-dcb67ab7c316 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:05.662528 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3aea0-eb7d-4366-90a0-357ea6dd06cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:05.663176 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3aea0-eb7d-4366-90a0-357ea6dd06cc None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:05.663458 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3aea0-eb7d-4366-90a0-357ea6dd06cc None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:05.663733 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3aea0-eb7d-4366-90a0-357ea6dd06cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:05.688710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3aea0-eb7d-4366-90a0-357ea6dd06cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:05:05.694247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-45c3aea0-eb7d-4366-90a0-357ea6dd06cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:05:05.694247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:05.694247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:05.694247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:05.694247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:05.694247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:05.694247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:05.694247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:05.694247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:05.694247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:05.694247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:05.694247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:05.694247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:05:05.694247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:05:05.694247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:05:05.694247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:05:05.695218 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:05:05.695218 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:05:05.695218 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:05:05.695218 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:05:05.695218 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:05.695218 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:05.695218 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:05.695218 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:05.695218 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:05.695218 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:05.695218 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:05.695218 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:05.695218 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:05.695218 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:05.695218 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:05.695218 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:05.696052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:05.696052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:05.696052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:05.696052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:05.696052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:05:05.696052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:05:05.696052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:05:05.696052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:05:05.696052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:05:05.696052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:05:05.696052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:05:05.696052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:05.708735 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 314/618] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 19:05:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:05:05.709667 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3aea0-eb7d-4366-90a0-357ea6dd06cc None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:05.784130 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:05.794838 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:05.806503 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c6623-fa2e-4734-a093-db012276c3cc None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:05.870123 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3aea0-eb7d-4366-90a0-357ea6dd06cc None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:05.920238 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a364186-5309-4f0e-871c-dda5d45b30bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:05.920864 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a364186-5309-4f0e-871c-dda5d45b30bd None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:05.921146 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a364186-5309-4f0e-871c-dda5d45b30bd None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:05.921420 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a364186-5309-4f0e-871c-dda5d45b30bd None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:05.922096 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a364186-5309-4f0e-871c-dda5d45b30bd None admin] RBAC: Adding query filter params (name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:05.922401 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a364186-5309-4f0e-871c-dda5d45b30bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:05.924090 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a364186-5309-4f0e-871c-dda5d45b30bd None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:05.924218 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a55ca8-bd36-4587-a9fd-4b41fc56046f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:05.924787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a55ca8-bd36-4587-a9fd-4b41fc56046f None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:05.925066 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a55ca8-bd36-4587-a9fd-4b41fc56046f None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:05.925336 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a55ca8-bd36-4587-a9fd-4b41fc56046f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:05.934040 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 315/619] 10.222.0.79 () {56 vars in 1103 bytes} [Wed Aug 31 19:05:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:05.940973 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a364186-5309-4f0e-871c-dda5d45b30bd None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:05.957869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a55ca8-bd36-4587-a9fd-4b41fc56046f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:05.959385 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a55ca8-bd36-4587-a9fd-4b41fc56046f None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:05.988444 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-41a55ca8-bd36-4587-a9fd-4b41fc56046f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:05.988444 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:05.988444 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:05.988444 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:05.988444 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:05.988444 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:05.988444 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:05.988444 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:05.988444 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:05.988444 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:05.988444 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:05.988444 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:05.988444 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:05.988444 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:05.988444 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:05.988444 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:05.989449 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:05.989449 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:05.989449 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:05.989449 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:05.989449 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:05.989449 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:05.989449 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:05.989449 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:05.989449 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:05.989449 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:05.989449 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:05.989449 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:05.989449 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:05.989449 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:05.989449 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:05.989449 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:05.989449 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:05.990334 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:05.990334 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:05.990334 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:05.993406 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 305/620] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:06.003436 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a55ca8-bd36-4587-a9fd-4b41fc56046f None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:06.059087 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:06.067599 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a364186-5309-4f0e-871c-dda5d45b30bd None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:06.106764 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703cf35-3950-44cf-bb19-8be5689b19c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:06.107399 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703cf35-3950-44cf-bb19-8be5689b19c9 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:06.107681 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703cf35-3950-44cf-bb19-8be5689b19c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:06.108246 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703cf35-3950-44cf-bb19-8be5689b19c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:06.122143 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2703cf35-3950-44cf-bb19-8be5689b19c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:06.123638 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2703cf35-3950-44cf-bb19-8be5689b19c9 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:06.140825 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-2703cf35-3950-44cf-bb19-8be5689b19c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:06.140825 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:06.140825 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:06.140825 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:06.140825 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:06.140825 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:06.140825 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:06.140825 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:06.140825 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:06.140825 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:06.140825 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:06.140825 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:06.140825 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:06.140825 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:06.140825 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:06.140825 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:06.141809 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:06.141809 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:06.141809 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:06.141809 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:06.141809 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:06.141809 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:06.141809 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:06.141809 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:06.141809 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:06.141809 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:06.141809 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:06.141809 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:06.141809 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:06.141809 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:06.141809 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:06.141809 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:06.141809 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:06.142785 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:06.142785 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:06.142785 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:06.149421 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 316/621] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:06.164601 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703cf35-3950-44cf-bb19-8be5689b19c9 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:06.261575 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a55ca8-bd36-4587-a9fd-4b41fc56046f None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:06.282729 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703cf35-3950-44cf-bb19-8be5689b19c9 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:06.323009 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f228108-0c77-4b42-ac0f-5a23b27eb156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:06.323813 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f228108-0c77-4b42-ac0f-5a23b27eb156 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:06.324096 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f228108-0c77-4b42-ac0f-5a23b27eb156 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:06.324370 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f228108-0c77-4b42-ac0f-5a23b27eb156 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:06.325186 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f228108-0c77-4b42-ac0f-5a23b27eb156 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:06.325493 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f228108-0c77-4b42-ac0f-5a23b27eb156 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:06.326894 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f228108-0c77-4b42-ac0f-5a23b27eb156 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:06.341201 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 317/622] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:06.347347 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f228108-0c77-4b42-ac0f-5a23b27eb156 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:06.358380 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b16cff-164b-49c1-b6c7-8eb20eb65401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:06.359181 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b16cff-164b-49c1-b6c7-8eb20eb65401 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:06.359296 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:06.359476 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b16cff-164b-49c1-b6c7-8eb20eb65401 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:06.359727 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b16cff-164b-49c1-b6c7-8eb20eb65401 None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:06.360384 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b16cff-164b-49c1-b6c7-8eb20eb65401 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:06.361324 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b16cff-164b-49c1-b6c7-8eb20eb65401 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:06.362768 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b16cff-164b-49c1-b6c7-8eb20eb65401 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:06.382137 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 306/623] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:06.403511 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b16cff-164b-49c1-b6c7-8eb20eb65401 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:06.446813 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:06.464105 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f228108-0c77-4b42-ac0f-5a23b27eb156 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:06.503604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf427e4-2e22-494f-821d-0c70b261ab47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:06.504380 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf427e4-2e22-494f-821d-0c70b261ab47 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:06.504770 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf427e4-2e22-494f-821d-0c70b261ab47 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:06.505049 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf427e4-2e22-494f-821d-0c70b261ab47 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:06.514599 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf427e4-2e22-494f-821d-0c70b261ab47 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:06.516059 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf427e4-2e22-494f-821d-0c70b261ab47 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:06.533972 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-fcf427e4-2e22-494f-821d-0c70b261ab47 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:05:06.533972 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:06.533972 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:06.533972 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:06.533972 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:06.533972 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:06.533972 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:06.533972 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:06.533972 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:06.533972 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:06.533972 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:06.533972 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:06.533972 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:05:06.533972 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:05:06.533972 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:05:06.533972 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:05:06.535004 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:06.535004 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:06.535004 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:05:06.535004 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:06.535004 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:05:06.535004 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:06.535004 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:06.535004 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:06.535004 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:06.535004 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:06.535004 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:06.535004 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:06.535004 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:06.535004 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:06.535004 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:06.535004 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:06.535004 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:06.535004 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:06.535958 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:06.535958 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:06.535958 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:05:06.535958 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:05:06.535958 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:05:06.535958 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:05:06.535958 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:05:06.535958 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:05:06.535958 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:05:06.535958 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:06.535958 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 318/624] 10.222.0.79 () {56 vars in 1093 bytes} [Wed Aug 31 19:05:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:06.537132 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e664f-fbb2-4b27-9e22-ea1d6d3f38ed None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:06.537417 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e664f-fbb2-4b27-9e22-ea1d6d3f38ed None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:06.537694 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e664f-fbb2-4b27-9e22-ea1d6d3f38ed None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:06.543809 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 319/625] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:05:06.547842 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e664f-fbb2-4b27-9e22-ea1d6d3f38ed None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:06.600071 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b16cff-164b-49c1-b6c7-8eb20eb65401 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:06.634893 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:06.643956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5948002-25e5-4c43-a75f-0c6ff28813be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:06.644787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5948002-25e5-4c43-a75f-0c6ff28813be None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:06.645578 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5948002-25e5-4c43-a75f-0c6ff28813be None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:06.645859 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5948002-25e5-4c43-a75f-0c6ff28813be None admin] PATH_INFO: `/v3/projects/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:06.656504 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5948002-25e5-4c43-a75f-0c6ff28813be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:06.658571 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5948002-25e5-4c43-a75f-0c6ff28813be None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:06.674483 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-a5948002-25e5-4c43-a75f-0c6ff28813be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:06.674483 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:06.674483 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:06.674483 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:06.674483 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:06.674483 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:06.674483 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:06.674483 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:06.674483 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:06.674483 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:06.674483 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:06.674483 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:06.674483 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:05:06.674483 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:05:06.674483 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:05:06.675438 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:05:06.675438 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:06.675438 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:06.675438 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:06.675438 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:06.675438 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:06.675438 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:06.675438 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:06.675438 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:06.675438 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:06.675438 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:06.675438 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:06.675438 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:06.675438 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:06.675438 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:06.675438 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:06.675438 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:06.676308 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:05:06.676308 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:05:06.676308 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:05:06.676308 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:05:06.676308 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:05:06.676308 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:05:06.676308 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:06.676308 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:06.677522 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e664f-fbb2-4b27-9e22-ea1d6d3f38ed None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:06.680204 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 307/626] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:05:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:06.683370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abdc71-f7ef-4e9e-8fcf-a6738a17b0b7 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:06.683667 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abdc71-f7ef-4e9e-8fcf-a6738a17b0b7 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:06.683949 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abdc71-f7ef-4e9e-8fcf-a6738a17b0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:06.703418 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-70abdc71-f7ef-4e9e-8fcf-a6738a17b0b7 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:06.705163 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-70abdc71-f7ef-4e9e-8fcf-a6738a17b0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:06.716305 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15321ac-181e-4a53-ae62-86caa23a5a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:06.716914 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15321ac-181e-4a53-ae62-86caa23a5a69 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:06.717193 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15321ac-181e-4a53-ae62-86caa23a5a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:06.717581 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15321ac-181e-4a53-ae62-86caa23a5a69 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:06.718361 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15321ac-181e-4a53-ae62-86caa23a5a69 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:06.718711 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15321ac-181e-4a53-ae62-86caa23a5a69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:06.720806 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15321ac-181e-4a53-ae62-86caa23a5a69 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:06.739405 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 320/627] 10.222.0.79 () {56 vars in 1133 bytes} [Wed Aug 31 19:05:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:06.740295 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15321ac-181e-4a53-ae62-86caa23a5a69 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:06.778975 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 308/628] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:05:06.780324 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58280052-ef96-42a0-a3e9-d892befbc07a None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:06.780612 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58280052-ef96-42a0-a3e9-d892befbc07a None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:06.780887 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58280052-ef96-42a0-a3e9-d892befbc07a None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:06.782434 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 309/629] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:05:06.787731 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58280052-ef96-42a0-a3e9-d892befbc07a None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:06.791132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:06.862110 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15321ac-181e-4a53-ae62-86caa23a5a69 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:06.898147 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:06.914663 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e32f26-c173-404e-9a72-f3bd86126a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:06.915812 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e32f26-c173-404e-9a72-f3bd86126a26 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:06.916557 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e32f26-c173-404e-9a72-f3bd86126a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:06.917012 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e32f26-c173-404e-9a72-f3bd86126a26 None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:06.917908 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e32f26-c173-404e-9a72-f3bd86126a26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:06.918081 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58280052-ef96-42a0-a3e9-d892befbc07a None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:06.918596 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e32f26-c173-404e-9a72-f3bd86126a26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:06.921358 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e32f26-c173-404e-9a72-f3bd86126a26 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:06.942142 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 321/630] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 19:05:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:06.944090 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994a4cc-c0ce-41ca-9681-76496b34d9ef None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:06.944847 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994a4cc-c0ce-41ca-9681-76496b34d9ef None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:06.945726 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994a4cc-c0ce-41ca-9681-76496b34d9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:06.957786 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e3f91-4a04-4522-8e17-941bdcad9b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:06.958444 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e3f91-4a04-4522-8e17-941bdcad9b87 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:06.958763 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e3f91-4a04-4522-8e17-941bdcad9b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:06.959036 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e3f91-4a04-4522-8e17-941bdcad9b87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:06.969173 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-8994a4cc-c0ce-41ca-9681-76496b34d9ef None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:06.971717 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8994a4cc-c0ce-41ca-9681-76496b34d9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:07.034833 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e3f91-4a04-4522-8e17-941bdcad9b87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:07.036805 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e3f91-4a04-4522-8e17-941bdcad9b87 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:07.038623 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:07.066542 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 322/631] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:05:07.067765 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994a4cc-c0ce-41ca-9681-76496b34d9ef None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:07.154010 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 310/632] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:05:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:05:07.154935 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e3f91-4a04-4522-8e17-941bdcad9b87 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:07.200220 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994a4cc-c0ce-41ca-9681-76496b34d9ef None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:07.219189 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:07.240083 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58dc88c-e246-430d-ab8f-3cc084acbdc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:07.240754 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58dc88c-e246-430d-ab8f-3cc084acbdc3 None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:07.241032 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58dc88c-e246-430d-ab8f-3cc084acbdc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:07.241304 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58dc88c-e246-430d-ab8f-3cc084acbdc3 None admin] PATH_INFO: `/v3/projects/f9e550ea75dd4245bd9c2bcd6322c507/users/3b289a0bef53460ca5173ad946394d72/roles/0230e2e79da94067a82374ceada29d3f` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:07.257952 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58dc88c-e246-430d-ab8f-3cc084acbdc3 None admin] RBAC: Authorizing `identity:create_grant(project_id=f9e550ea75dd4245bd9c2bcd6322c507, user_id=3b289a0bef53460ca5173ad946394d72, role_id=0230e2e79da94067a82374ceada29d3f)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:07.258814 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e3f91-4a04-4522-8e17-941bdcad9b87 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:07.259423 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58dc88c-e246-430d-ab8f-3cc084acbdc3 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:07.260608 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:07.282271 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 323/633] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 19:05:07 2022] PUT /identity/v3/projects/f9e550ea75dd4245bd9c2bcd6322c507/users/3b289a0bef53460ca5173ad946394d72/roles/0230e2e79da94067a82374ceada29d3f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:05:07.284527 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58dc88c-e246-430d-ab8f-3cc084acbdc3 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:07.299867 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d5db0-197b-44f8-94e2-a0492b88a501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:07.300658 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d5db0-197b-44f8-94e2-a0492b88a501 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:07.301665 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d5db0-197b-44f8-94e2-a0492b88a501 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:07.301665 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d5db0-197b-44f8-94e2-a0492b88a501 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:07.312916 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3d5db0-197b-44f8-94e2-a0492b88a501 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:05:07.318840 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-1d3d5db0-197b-44f8-94e2-a0492b88a501 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:05:07.318840 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:07.318840 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:07.318840 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:07.318840 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:07.318840 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:07.318840 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:07.318840 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:07.318840 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:07.318840 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:07.318840 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:07.318840 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:07.318840 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:05:07.318840 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:05:07.318840 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:05:07.318840 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:05:07.320540 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:05:07.320540 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:05:07.320540 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:05:07.320540 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:05:07.320540 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:07.320540 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:07.320540 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:07.320540 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:07.320540 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:07.320540 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:07.320540 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:07.320540 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:07.320540 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:07.320540 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:07.320540 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:07.320540 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:07.322132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:07.322132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:07.322132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:07.322132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:07.322132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:05:07.322132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:05:07.322132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:05:07.322132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:05:07.322132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:05:07.322132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:05:07.322132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:05:07.322132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:07.322132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 311/634] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 19:05:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:07.325996 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d5db0-197b-44f8-94e2-a0492b88a501 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:07.439037 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d5db0-197b-44f8-94e2-a0492b88a501 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:07.477094 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d94e1b-52f3-4e0e-a223-84eaa87ec0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:07.477725 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d94e1b-52f3-4e0e-a223-84eaa87ec0ac None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:07.478006 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d94e1b-52f3-4e0e-a223-84eaa87ec0ac None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:07.478272 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d94e1b-52f3-4e0e-a223-84eaa87ec0ac None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:07.479004 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d94e1b-52f3-4e0e-a223-84eaa87ec0ac None admin] RBAC: Adding query filter params (name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:07.479304 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d94e1b-52f3-4e0e-a223-84eaa87ec0ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:07.480863 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d94e1b-52f3-4e0e-a223-84eaa87ec0ac None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:07.486120 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58dc88c-e246-430d-ab8f-3cc084acbdc3 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:07.490182 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 312/635] 10.222.0.79 () {56 vars in 1103 bytes} [Wed Aug 31 19:05:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:07.495977 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d94e1b-52f3-4e0e-a223-84eaa87ec0ac None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:07.531298 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:07.580892 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e19fd1-fa84-4a56-acba-92fdff5a6cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:07.582398 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e19fd1-fa84-4a56-acba-92fdff5a6cdd None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:07.583199 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e19fd1-fa84-4a56-acba-92fdff5a6cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:07.584001 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e19fd1-fa84-4a56-acba-92fdff5a6cdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:07.604529 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e19fd1-fa84-4a56-acba-92fdff5a6cdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:07.608009 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e19fd1-fa84-4a56-acba-92fdff5a6cdd None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:07.612823 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d94e1b-52f3-4e0e-a223-84eaa87ec0ac None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:07.639126 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-00e19fd1-fa84-4a56-acba-92fdff5a6cdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:07.639126 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:07.639126 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:07.639126 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:07.639126 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:07.639126 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:07.639126 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:07.639126 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:07.639126 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:07.639126 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:07.639126 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:07.639126 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:07.639126 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:07.639126 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:07.639126 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:07.639126 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:07.641457 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:07.641457 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:07.641457 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:07.641457 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:07.641457 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:07.641457 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:07.641457 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:07.641457 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:07.641457 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:07.641457 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:07.641457 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:07.641457 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:07.641457 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:07.641457 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:07.641457 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:07.641457 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:07.641457 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:07.643019 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:07.643019 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:07.643019 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:07.646010 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 324/636] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:07.647704 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e19fd1-fa84-4a56-acba-92fdff5a6cdd None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:07.653910 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a9a29-6bde-4bff-81d8-e94030de487d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:07.654903 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a9a29-6bde-4bff-81d8-e94030de487d None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:07.655367 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a9a29-6bde-4bff-81d8-e94030de487d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:07.655945 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a9a29-6bde-4bff-81d8-e94030de487d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:07.671399 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7a9a29-6bde-4bff-81d8-e94030de487d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:07.672899 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7a9a29-6bde-4bff-81d8-e94030de487d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:07.679909 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:07.693924 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-bb7a9a29-6bde-4bff-81d8-e94030de487d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:07.693924 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:07.693924 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:07.693924 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:07.693924 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:07.693924 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:07.693924 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:07.693924 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:07.693924 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:07.693924 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:07.693924 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:07.693924 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:07.693924 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:07.693924 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:07.693924 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:07.693924 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:07.695493 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:07.695493 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:07.695493 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:07.695493 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:07.695493 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:07.695493 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:07.695493 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:07.695493 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:07.695493 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:07.695493 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:07.695493 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:07.695493 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:07.695493 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:07.695493 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:07.695493 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:07.695493 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:07.695493 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:07.697338 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:07.697338 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:07.697338 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:07.699438 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 313/637] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:07.700840 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d76ed-bc23-4816-a725-8dd248953c7a None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:07.701287 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d76ed-bc23-4816-a725-8dd248953c7a None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:07.701733 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d76ed-bc23-4816-a725-8dd248953c7a None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:07.703498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 314/638] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:05:07.704383 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d76ed-bc23-4816-a725-8dd248953c7a None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:07.792563 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e19fd1-fa84-4a56-acba-92fdff5a6cdd None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:07.800105 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:07.833344 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e4d0f-5513-4070-858d-be42dba5f282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:07.833987 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e4d0f-5513-4070-858d-be42dba5f282 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:07.834268 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e4d0f-5513-4070-858d-be42dba5f282 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:07.834574 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e4d0f-5513-4070-858d-be42dba5f282 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:07.834677 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d76ed-bc23-4816-a725-8dd248953c7a None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:07.852668 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e4d0f-5513-4070-858d-be42dba5f282 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:05:07.857913 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-533e4d0f-5513-4070-858d-be42dba5f282 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:05:07.857913 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:07.857913 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:07.857913 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:07.857913 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:07.857913 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:07.857913 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:07.857913 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:07.857913 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:07.857913 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:07.857913 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:07.857913 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:07.857913 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:05:07.857913 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:05:07.857913 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:05:07.857913 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:05:07.859125 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:05:07.859125 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:05:07.859125 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:05:07.859125 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:05:07.859125 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:07.859125 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:07.859125 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:07.859125 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:07.859125 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:07.859125 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:07.859125 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:07.859125 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:07.859125 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:07.859125 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:07.859125 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:07.859125 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:07.860208 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:07.860208 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:07.860208 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:07.860208 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:07.860208 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:05:07.860208 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:05:07.860208 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:05:07.860208 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:05:07.860208 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:05:07.860208 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:05:07.860208 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:05:07.860208 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:07.860208 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 325/639] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 19:05:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:07.860208 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e4d0f-5513-4070-858d-be42dba5f282 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:07.890847 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d444f-323d-4b53-8fd5-1d06ae197809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:07.891478 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d444f-323d-4b53-8fd5-1d06ae197809 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:07.891766 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d444f-323d-4b53-8fd5-1d06ae197809 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:07.892082 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d444f-323d-4b53-8fd5-1d06ae197809 None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:07.892815 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d444f-323d-4b53-8fd5-1d06ae197809 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:07.893124 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d444f-323d-4b53-8fd5-1d06ae197809 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:07.894517 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d444f-323d-4b53-8fd5-1d06ae197809 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:07.913561 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 315/640] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:07.913561 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456a2b4-45d0-47dc-9c38-51d6aa35fe68 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:07.913561 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456a2b4-45d0-47dc-9c38-51d6aa35fe68 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:07.913561 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456a2b4-45d0-47dc-9c38-51d6aa35fe68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:07.930913 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-d456a2b4-45d0-47dc-9c38-51d6aa35fe68 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:07.932118 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d456a2b4-45d0-47dc-9c38-51d6aa35fe68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:07.958085 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:07.987638 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e4d0f-5513-4070-858d-be42dba5f282 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:08.007927 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 316/641] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:05:08.015989 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456a2b4-45d0-47dc-9c38-51d6aa35fe68 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:08.036087 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5423b-09a8-463b-859f-67ca3a670e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:08.036715 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5423b-09a8-463b-859f-67ca3a670e81 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:08.036992 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5423b-09a8-463b-859f-67ca3a670e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:08.037268 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5423b-09a8-463b-859f-67ca3a670e81 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:08.038060 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf5423b-09a8-463b-859f-67ca3a670e81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:08.038406 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf5423b-09a8-463b-859f-67ca3a670e81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:08.040097 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf5423b-09a8-463b-859f-67ca3a670e81 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:08.062126 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 326/642] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:08.062126 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5423b-09a8-463b-859f-67ca3a670e81 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:08.107951 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:08.150100 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456a2b4-45d0-47dc-9c38-51d6aa35fe68 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:08.194349 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4914ed-cc2d-4ecf-b63b-98673475ff4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:08.195277 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4914ed-cc2d-4ecf-b63b-98673475ff4d None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:08.195658 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4914ed-cc2d-4ecf-b63b-98673475ff4d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:08.196031 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4914ed-cc2d-4ecf-b63b-98673475ff4d None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:08.197014 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4914ed-cc2d-4ecf-b63b-98673475ff4d None admin] RBAC: Adding query filter params (name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:08.197379 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4914ed-cc2d-4ecf-b63b-98673475ff4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:08.198893 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4914ed-cc2d-4ecf-b63b-98673475ff4d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:08.209504 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5423b-09a8-463b-859f-67ca3a670e81 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:08.213556 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 317/643] 10.222.0.79 () {56 vars in 1103 bytes} [Wed Aug 31 19:05:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:08.214679 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4914ed-cc2d-4ecf-b63b-98673475ff4d None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:08.258222 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b93eeb-38d8-496a-b057-d9db6376ca9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:08.260490 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b93eeb-38d8-496a-b057-d9db6376ca9c None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:08.260927 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b93eeb-38d8-496a-b057-d9db6376ca9c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:08.261405 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b93eeb-38d8-496a-b057-d9db6376ca9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:08.280588 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b93eeb-38d8-496a-b057-d9db6376ca9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:08.282067 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b93eeb-38d8-496a-b057-d9db6376ca9c None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:08.288616 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:08.304285 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-12b93eeb-38d8-496a-b057-d9db6376ca9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:08.304285 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:08.304285 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:08.304285 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:08.304285 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:08.304285 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:08.304285 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:08.304285 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:08.304285 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:08.304285 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:08.304285 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:08.304285 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:08.304285 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:05:08.304285 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:05:08.304285 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:05:08.305519 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:05:08.305519 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:08.305519 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:08.305519 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:08.305519 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:08.305519 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:08.305519 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:08.305519 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:08.305519 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:08.305519 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:08.305519 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:08.305519 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:08.305519 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:08.305519 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:08.305519 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:08.305519 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:08.305519 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:08.306446 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:05:08.306446 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:05:08.306446 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:05:08.306446 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:05:08.306446 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:05:08.306446 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:05:08.306446 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:08.306446 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:08.306446 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 327/644] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:05:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:08.306969 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b93eeb-38d8-496a-b057-d9db6376ca9c None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:08.379624 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4914ed-cc2d-4ecf-b63b-98673475ff4d None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:08.415982 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:08.432408 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c4968-b010-41f1-bddf-b2a504049f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:08.433058 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c4968-b010-41f1-bddf-b2a504049f50 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:08.433337 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c4968-b010-41f1-bddf-b2a504049f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:08.433608 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c4968-b010-41f1-bddf-b2a504049f50 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:08.445572 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c4968-b010-41f1-bddf-b2a504049f50 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:08.447074 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c4968-b010-41f1-bddf-b2a504049f50 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:08.459792 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-7a1c4968-b010-41f1-bddf-b2a504049f50 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 19:05:08.459792 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:08.459792 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:08.459792 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:08.459792 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:08.459792 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:08.459792 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:08.459792 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:08.459792 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:08.459792 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:08.459792 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:08.459792 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:08.459792 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:05:08.459792 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:05:08.459792 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:05:08.459792 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:05:08.461715 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:08.461715 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:08.461715 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:05:08.461715 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:08.461715 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:05:08.461715 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:08.461715 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:08.461715 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:08.461715 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:08.461715 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:08.461715 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:08.461715 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:08.461715 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:08.461715 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:08.461715 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:08.461715 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:08.461715 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:08.461715 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:08.464037 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:08.464037 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:08.464037 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:05:08.464037 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:05:08.464037 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:05:08.464037 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:05:08.464037 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:05:08.464037 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:05:08.464037 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 19:05:08.464037 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:08.464037 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 318/645] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:05:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:08.466371 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c4968-b010-41f1-bddf-b2a504049f50 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:08.472775 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b93eeb-38d8-496a-b057-d9db6376ca9c None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:08.521857 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b856e-f3c1-445b-9e17-7e5ae9ca6386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:08.523296 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b856e-f3c1-445b-9e17-7e5ae9ca6386 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:08.523933 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b856e-f3c1-445b-9e17-7e5ae9ca6386 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:08.525194 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b856e-f3c1-445b-9e17-7e5ae9ca6386 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:08.544390 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352b856e-f3c1-445b-9e17-7e5ae9ca6386 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:08.545866 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352b856e-f3c1-445b-9e17-7e5ae9ca6386 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:08.565440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-352b856e-f3c1-445b-9e17-7e5ae9ca6386 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:08.565440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:08.565440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:08.565440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:08.565440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:08.565440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:08.565440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:08.565440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:08.565440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:08.565440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:08.565440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:08.565440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:08.565440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:08.565440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:08.565440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:08.565440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:08.566440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:08.566440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:08.566440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:08.566440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:08.566440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:08.566440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:08.566440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:08.566440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:08.566440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:08.566440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:08.566440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:08.566440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:08.566440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:08.566440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:08.566440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:08.566440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:08.566440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:08.567361 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:08.567361 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:08.567361 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:08.567361 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 328/646] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:08.567361 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b856e-f3c1-445b-9e17-7e5ae9ca6386 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:08.631885 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c4968-b010-41f1-bddf-b2a504049f50 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:08.647318 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:08.682818 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c88cb-2fdf-45f5-8858-b24453ce5040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:08.683662 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c88cb-2fdf-45f5-8858-b24453ce5040 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:08.684337 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c88cb-2fdf-45f5-8858-b24453ce5040 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:08.685543 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c88cb-2fdf-45f5-8858-b24453ce5040 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:08.699266 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c88cb-2fdf-45f5-8858-b24453ce5040 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:05:08.705108 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-fd8c88cb-2fdf-45f5-8858-b24453ce5040 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:05:08.705108 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:08.705108 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:08.705108 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:08.705108 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:08.705108 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:08.705108 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:08.705108 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:08.705108 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:08.705108 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:08.705108 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:08.705108 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:08.705108 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:05:08.705108 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:05:08.705108 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:05:08.705108 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:05:08.706038 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:05:08.706038 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:05:08.706038 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:05:08.706038 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:05:08.706038 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:08.706038 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:08.706038 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:08.706038 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:08.706038 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:08.706038 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:08.706038 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:08.706038 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:08.706038 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:08.706038 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:08.706038 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:08.706038 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:08.706895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:08.706895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:08.706895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:08.706895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:08.706895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:05:08.706895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:05:08.706895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:05:08.706895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:05:08.706895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:05:08.706895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:05:08.706895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:05:08.706895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:08.706895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 319/647] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 19:05:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:08.708004 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c88cb-2fdf-45f5-8858-b24453ce5040 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:08.723902 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b856e-f3c1-445b-9e17-7e5ae9ca6386 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:08.762573 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:08.765179 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7db6f-bb40-41d5-bb8d-1bec78ad8a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:08.766043 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7db6f-bb40-41d5-bb8d-1bec78ad8a5f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:08.767688 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7db6f-bb40-41d5-bb8d-1bec78ad8a5f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:08.768138 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7db6f-bb40-41d5-bb8d-1bec78ad8a5f None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:08.769007 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f7db6f-bb40-41d5-bb8d-1bec78ad8a5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:08.769483 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f7db6f-bb40-41d5-bb8d-1bec78ad8a5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:08.771340 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f7db6f-bb40-41d5-bb8d-1bec78ad8a5f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:08.793092 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 329/648] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 19:05:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:08.798698 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7db6f-bb40-41d5-bb8d-1bec78ad8a5f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:08.826374 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c88cb-2fdf-45f5-8858-b24453ce5040 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:08.864014 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee4452-f695-41fa-b0c2-9da265afa137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:08.864699 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee4452-f695-41fa-b0c2-9da265afa137 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:08.864946 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee4452-f695-41fa-b0c2-9da265afa137 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:08.865242 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee4452-f695-41fa-b0c2-9da265afa137 None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:08.865906 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee4452-f695-41fa-b0c2-9da265afa137 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:08.866209 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee4452-f695-41fa-b0c2-9da265afa137 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:08.867813 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee4452-f695-41fa-b0c2-9da265afa137 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:08.887333 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 320/649] 10.222.0.79 () {56 vars in 1137 bytes} [Wed Aug 31 19:05:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:08.888191 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee4452-f695-41fa-b0c2-9da265afa137 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:08.913667 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7db6f-bb40-41d5-bb8d-1bec78ad8a5f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:08.929052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:08.961074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995de4ec-7dda-46e5-8e4b-f122b2cc56b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:08.961684 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995de4ec-7dda-46e5-8e4b-f122b2cc56b9 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:08.961964 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995de4ec-7dda-46e5-8e4b-f122b2cc56b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:08.962242 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995de4ec-7dda-46e5-8e4b-f122b2cc56b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:08.962927 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995de4ec-7dda-46e5-8e4b-f122b2cc56b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:08.963227 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995de4ec-7dda-46e5-8e4b-f122b2cc56b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:08.964593 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995de4ec-7dda-46e5-8e4b-f122b2cc56b9 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:08.984041 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 330/650] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:08.984041 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995de4ec-7dda-46e5-8e4b-f122b2cc56b9 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:09.024112 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee4452-f695-41fa-b0c2-9da265afa137 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:09.032149 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:09.066315 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aaa869-9180-473b-b5a8-bbb41863a607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:09.066978 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aaa869-9180-473b-b5a8-bbb41863a607 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:09.067260 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aaa869-9180-473b-b5a8-bbb41863a607 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:09.067529 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aaa869-9180-473b-b5a8-bbb41863a607 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:09.068208 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aaa869-9180-473b-b5a8-bbb41863a607 None admin] RBAC: Adding query filter params (name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:09.068510 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aaa869-9180-473b-b5a8-bbb41863a607 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:09.069877 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aaa869-9180-473b-b5a8-bbb41863a607 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:09.080492 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 321/651] 10.222.0.79 () {56 vars in 1103 bytes} [Wed Aug 31 19:05:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:09.085631 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aaa869-9180-473b-b5a8-bbb41863a607 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:09.108391 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995de4ec-7dda-46e5-8e4b-f122b2cc56b9 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:09.153369 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3db139-a33e-400b-9801-3c0d5184fe33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:09.154091 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3db139-a33e-400b-9801-3c0d5184fe33 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:09.154285 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3db139-a33e-400b-9801-3c0d5184fe33 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:09.154547 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3db139-a33e-400b-9801-3c0d5184fe33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:09.155283 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3db139-a33e-400b-9801-3c0d5184fe33 None admin] RBAC: Adding query filter params (role.id=0230e2e79da94067a82374ceada29d3f, scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507, user.id=1fd6d45d1bc3479da72cb1a1990a6137) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:09.155701 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3db139-a33e-400b-9801-3c0d5184fe33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:09.157185 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3db139-a33e-400b-9801-3c0d5184fe33 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:09.164484 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 331/652] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:05:08 2022] GET /identity/v3/role_assignments?user.id=1fd6d45d1bc3479da72cb1a1990a6137&scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507&role.id=0230e2e79da94067a82374ceada29d3f => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:09.164928 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3db139-a33e-400b-9801-3c0d5184fe33 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:09.215986 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:09.229300 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aaa869-9180-473b-b5a8-bbb41863a607 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:09.275782 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146edd6-15c1-465f-8943-401825611e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:09.276735 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146edd6-15c1-465f-8943-401825611e46 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:09.277218 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146edd6-15c1-465f-8943-401825611e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:09.277815 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146edd6-15c1-465f-8943-401825611e46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:09.314477 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3db139-a33e-400b-9801-3c0d5184fe33 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:09.333979 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:09.372832 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19561c9f-addd-4325-9008-155c61c7c9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:09.373275 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19561c9f-addd-4325-9008-155c61c7c9a6 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:09.373779 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19561c9f-addd-4325-9008-155c61c7c9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:09.374764 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19561c9f-addd-4325-9008-155c61c7c9a6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:09.377133 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146edd6-15c1-465f-8943-401825611e46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:09.379526 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146edd6-15c1-465f-8943-401825611e46 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:09.386188 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19561c9f-addd-4325-9008-155c61c7c9a6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:09.388740 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19561c9f-addd-4325-9008-155c61c7c9a6 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:09.412398 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-19561c9f-addd-4325-9008-155c61c7c9a6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 19:05:09.412398 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:09.412398 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:09.412398 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:09.412398 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:09.412398 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:09.412398 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:09.412398 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:09.412398 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:09.412398 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:09.412398 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:09.412398 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:09.412398 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:05:09.412398 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:05:09.412398 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:05:09.412398 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:05:09.414020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:09.414020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:09.414020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:05:09.414020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:09.414020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:05:09.414020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:09.414020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:09.414020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:09.414020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:09.414020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:09.414020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:09.414020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:09.414020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:09.414020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:09.414020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:09.414020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:09.414020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:09.414020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:09.415710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:09.415710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:09.415710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:05:09.415710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:05:09.415710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:05:09.415710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:05:09.415710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:05:09.415710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:05:09.415710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 19:05:09.415710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:09.418592 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 332/653] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 19:05:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:09.418592 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19561c9f-addd-4325-9008-155c61c7c9a6 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:09.546848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 322/654] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:05:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:05:09.547968 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146edd6-15c1-465f-8943-401825611e46 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:09.574526 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19561c9f-addd-4325-9008-155c61c7c9a6 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:09.576286 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:09.615384 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e8c50-6032-4192-a398-b8d5c97b681e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:09.616159 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e8c50-6032-4192-a398-b8d5c97b681e None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:09.616514 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e8c50-6032-4192-a398-b8d5c97b681e None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:09.616679 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e8c50-6032-4192-a398-b8d5c97b681e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:09.627893 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:09.629410 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e8c50-6032-4192-a398-b8d5c97b681e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:09.631383 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e8c50-6032-4192-a398-b8d5c97b681e None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:09.649104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-8f9e8c50-6032-4192-a398-b8d5c97b681e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:09.649104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:09.649104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:09.649104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:09.649104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:09.649104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:09.649104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:09.649104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:09.649104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:09.649104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:09.649104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:09.649104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:09.649104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:09.649104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:09.649104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:09.649104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:09.650618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:09.650618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:09.650618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:09.650618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:09.650618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:09.650618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:09.650618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:09.650618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:09.650618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:09.650618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:09.650618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:09.650618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:09.650618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:09.650618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:09.650618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:09.650618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:09.650618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:09.652123 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:09.652123 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:09.652123 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:09.652123 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 333/655] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:09.652123 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e8c50-6032-4192-a398-b8d5c97b681e None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:09.680717 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146edd6-15c1-465f-8943-401825611e46 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:09.719686 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e91951-bf37-4f8f-b0f8-4e80ed187785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:09.720890 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e91951-bf37-4f8f-b0f8-4e80ed187785 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:09.721169 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e91951-bf37-4f8f-b0f8-4e80ed187785 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:09.721442 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e91951-bf37-4f8f-b0f8-4e80ed187785 None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:09.722187 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e91951-bf37-4f8f-b0f8-4e80ed187785 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:09.722529 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e91951-bf37-4f8f-b0f8-4e80ed187785 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:09.723964 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e91951-bf37-4f8f-b0f8-4e80ed187785 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:09.747512 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 323/656] 10.222.0.79 () {56 vars in 1139 bytes} [Wed Aug 31 19:05:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:09.749142 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ff12d-abeb-4acc-8802-f68bf3c79cd6 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:09.749142 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ff12d-abeb-4acc-8802-f68bf3c79cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:09.749352 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ff12d-abeb-4acc-8802-f68bf3c79cd6 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:09.750732 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 324/657] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:05:09.751265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ff12d-abeb-4acc-8802-f68bf3c79cd6 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:09.774428 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e8c50-6032-4192-a398-b8d5c97b681e None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:09.811319 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257bf42-5ea2-406e-b58f-f6f37f4f8d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:09.812329 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257bf42-5ea2-406e-b58f-f6f37f4f8d61 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:09.812790 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257bf42-5ea2-406e-b58f-f6f37f4f8d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:09.813250 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257bf42-5ea2-406e-b58f-f6f37f4f8d61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:09.824409 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d257bf42-5ea2-406e-b58f-f6f37f4f8d61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:09.826141 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d257bf42-5ea2-406e-b58f-f6f37f4f8d61 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:09.834138 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:09.843739 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-d257bf42-5ea2-406e-b58f-f6f37f4f8d61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:09.843739 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:09.843739 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:09.843739 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:09.843739 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:09.843739 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:09.843739 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:09.843739 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:09.843739 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:09.843739 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:09.843739 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:09.843739 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:09.843739 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:09.843739 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:09.843739 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:09.843739 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:09.844664 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:09.844664 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:09.844664 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:09.844664 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:09.844664 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:09.844664 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:09.844664 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:09.844664 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:09.844664 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:09.844664 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:09.844664 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:09.844664 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:09.844664 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:09.844664 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:09.844664 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:09.844664 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:09.844664 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:09.846114 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:09.846114 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:09.846114 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:09.852450 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 334/658] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:09.853521 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257bf42-5ea2-406e-b58f-f6f37f4f8d61 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:09.864576 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ff12d-abeb-4acc-8802-f68bf3c79cd6 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:09.893209 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:09.904164 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1c3ed-7c38-4dcc-86c6-68412a790fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:09.904771 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1c3ed-7c38-4dcc-86c6-68412a790fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:09.905047 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1c3ed-7c38-4dcc-86c6-68412a790fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:09.905310 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1c3ed-7c38-4dcc-86c6-68412a790fb0 None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:09.905949 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1c3ed-7c38-4dcc-86c6-68412a790fb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:09.906244 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1c3ed-7c38-4dcc-86c6-68412a790fb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:09.908232 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1c3ed-7c38-4dcc-86c6-68412a790fb0 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:09.919926 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 325/659] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:09.921404 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03e703-71f6-4869-8e38-1d6fce415f7a None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:09.921894 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03e703-71f6-4869-8e38-1d6fce415f7a None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:09.922365 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03e703-71f6-4869-8e38-1d6fce415f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:09.939990 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-0b03e703-71f6-4869-8e38-1d6fce415f7a None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:09.941173 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-0b03e703-71f6-4869-8e38-1d6fce415f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:09.964865 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257bf42-5ea2-406e-b58f-f6f37f4f8d61 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:10.003766 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b11986-b8fa-4001-a58f-0bc2f417d92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:10.004889 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b11986-b8fa-4001-a58f-0bc2f417d92c None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:10.005070 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b11986-b8fa-4001-a58f-0bc2f417d92c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:10.005608 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b11986-b8fa-4001-a58f-0bc2f417d92c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:10.022640 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 326/660] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:05:10.022640 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03e703-71f6-4869-8e38-1d6fce415f7a None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:10.096520 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:10.106150 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b11986-b8fa-4001-a58f-0bc2f417d92c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:10.107659 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b11986-b8fa-4001-a58f-0bc2f417d92c None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:10.143561 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03e703-71f6-4869-8e38-1d6fce415f7a None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:10.168174 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:10.193596 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10321ead-5c5f-4e36-8ee6-9623bca7b3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:10.194510 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10321ead-5c5f-4e36-8ee6-9623bca7b3a8 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:10.195492 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10321ead-5c5f-4e36-8ee6-9623bca7b3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:10.195979 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10321ead-5c5f-4e36-8ee6-9623bca7b3a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:10.197207 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10321ead-5c5f-4e36-8ee6-9623bca7b3a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:10.197933 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10321ead-5c5f-4e36-8ee6-9623bca7b3a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:10.199804 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10321ead-5c5f-4e36-8ee6-9623bca7b3a8 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:10.217683 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 327/661] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:10.218931 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10321ead-5c5f-4e36-8ee6-9623bca7b3a8 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:10.225515 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 335/662] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:05:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:05:10.226783 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b11986-b8fa-4001-a58f-0bc2f417d92c None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:10.336008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:10.339122 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b11986-b8fa-4001-a58f-0bc2f417d92c None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:10.343200 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10321ead-5c5f-4e36-8ee6-9623bca7b3a8 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:10.377424 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b57056-73e3-4d86-8db7-a23f2d914fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:10.378056 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b57056-73e3-4d86-8db7-a23f2d914fae None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:10.378332 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b57056-73e3-4d86-8db7-a23f2d914fae None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:10.378627 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b57056-73e3-4d86-8db7-a23f2d914fae None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:10.379480 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c66c77-232e-4cab-a9f2-28701e5f1d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:10.380161 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c66c77-232e-4cab-a9f2-28701e5f1d46 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:10.380440 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c66c77-232e-4cab-a9f2-28701e5f1d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:10.380877 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c66c77-232e-4cab-a9f2-28701e5f1d46 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:10.385812 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b57056-73e3-4d86-8db7-a23f2d914fae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:10.387327 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b57056-73e3-4d86-8db7-a23f2d914fae None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:10.389469 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c66c77-232e-4cab-a9f2-28701e5f1d46 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:10.390923 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c66c77-232e-4cab-a9f2-28701e5f1d46 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:10.399278 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-93b57056-73e3-4d86-8db7-a23f2d914fae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:10.399278 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:10.399278 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:10.399278 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:10.399278 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:10.399278 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:10.399278 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:10.399278 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:10.399278 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:10.399278 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:10.399278 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:10.399278 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:10.399278 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:05:10.399278 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:05:10.399278 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:05:10.400244 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:05:10.400244 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:10.400244 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:10.400244 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:10.400244 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:10.400244 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:10.400244 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:10.400244 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:10.400244 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:10.400244 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:10.400244 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:10.400244 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:10.400244 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:10.400244 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:10.400244 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:10.400244 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:10.400244 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:10.401122 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:05:10.401122 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:05:10.401122 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:05:10.401122 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:05:10.401122 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:05:10.401122 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:05:10.401122 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:10.401122 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:10.401122 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 336/663] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:05:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:10.401623 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b57056-73e3-4d86-8db7-a23f2d914fae None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:10.405021 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-19c66c77-232e-4cab-a9f2-28701e5f1d46 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 19:05:10.405021 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:10.405021 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:10.405021 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:10.405021 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:10.405021 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:10.405021 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:10.405021 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:10.405021 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:10.405021 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:10.405021 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:10.405021 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:10.405021 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:05:10.405021 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:05:10.405021 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:05:10.405021 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:05:10.406019 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:10.406019 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:10.406019 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:05:10.406019 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:10.406019 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:05:10.406019 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:10.406019 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:10.406019 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:10.406019 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:10.406019 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:10.406019 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:10.406019 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:10.406019 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:10.406019 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:10.406019 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:10.406019 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:10.406019 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:10.406019 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:10.406998 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:10.406998 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:10.406998 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:05:10.406998 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:05:10.406998 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:05:10.406998 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:05:10.406998 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:05:10.406998 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:05:10.406998 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 19:05:10.406998 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:10.406998 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 328/664] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:05:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:10.406998 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c66c77-232e-4cab-a9f2-28701e5f1d46 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:10.444642 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:10.518083 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b57056-73e3-4d86-8db7-a23f2d914fae None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:10.518290 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c66c77-232e-4cab-a9f2-28701e5f1d46 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:10.556602 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c4d5c-93ad-4af3-963f-d1d2e069b71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:10.557229 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c4d5c-93ad-4af3-963f-d1d2e069b71c None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:10.557509 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c4d5c-93ad-4af3-963f-d1d2e069b71c None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:10.557619 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224c877-6c9a-4a9e-8998-d79a323ebe06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:10.557813 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c4d5c-93ad-4af3-963f-d1d2e069b71c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:10.558145 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224c877-6c9a-4a9e-8998-d79a323ebe06 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:10.558422 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224c877-6c9a-4a9e-8998-d79a323ebe06 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:10.558736 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224c877-6c9a-4a9e-8998-d79a323ebe06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:10.569374 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c4d5c-93ad-4af3-963f-d1d2e069b71c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:05:10.569903 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4224c877-6c9a-4a9e-8998-d79a323ebe06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:10.571371 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4224c877-6c9a-4a9e-8998-d79a323ebe06 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:10.574956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-ff4c4d5c-93ad-4af3-963f-d1d2e069b71c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:05:10.574956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:10.574956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:10.574956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:10.574956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:10.574956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:10.574956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:10.574956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:10.574956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:10.574956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:10.574956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:10.574956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:10.574956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:05:10.574956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:05:10.574956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:05:10.574956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:05:10.575869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:05:10.575869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:05:10.575869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:05:10.575869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:05:10.575869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:10.575869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:10.575869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:10.575869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:10.575869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:10.575869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:10.575869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:10.575869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:10.575869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:10.575869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:10.575869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:10.575869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:10.580011 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:10.580011 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:10.580011 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:10.580011 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:10.580011 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:05:10.580011 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:05:10.580011 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:05:10.580011 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:05:10.580011 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:05:10.580011 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:05:10.580011 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:05:10.580011 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:10.580011 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 329/665] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 19:05:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:10.580011 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c4d5c-93ad-4af3-963f-d1d2e069b71c None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:10.589934 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-4224c877-6c9a-4a9e-8998-d79a323ebe06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:10.589934 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:10.589934 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:10.589934 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:10.589934 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:10.589934 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:10.589934 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:10.589934 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:10.589934 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:10.589934 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:10.589934 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:10.589934 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:10.589934 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:10.589934 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:10.589934 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:10.589934 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:10.590879 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:10.590879 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:10.590879 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:10.590879 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:10.590879 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:10.590879 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:10.590879 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:10.590879 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:10.590879 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:10.590879 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:10.590879 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:10.590879 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:10.590879 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:10.590879 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:10.590879 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:10.590879 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:10.590879 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:10.591757 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:10.591757 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:10.591757 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:10.594604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 337/666] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:10.596304 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224c877-6c9a-4a9e-8998-d79a323ebe06 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:10.609878 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:10.681981 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:10.689346 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c4d5c-93ad-4af3-963f-d1d2e069b71c None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:10.705768 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224c877-6c9a-4a9e-8998-d79a323ebe06 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:10.726710 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d1468-dad2-43f2-8b0d-4afc777a6952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:10.727314 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d1468-dad2-43f2-8b0d-4afc777a6952 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:10.727592 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d1468-dad2-43f2-8b0d-4afc777a6952 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:10.727859 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d1468-dad2-43f2-8b0d-4afc777a6952 None admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:10.728556 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d1468-dad2-43f2-8b0d-4afc777a6952 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:10.728859 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d1468-dad2-43f2-8b0d-4afc777a6952 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:10.730274 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d1468-dad2-43f2-8b0d-4afc777a6952 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:10.747765 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 330/667] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 19:05:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:10.747934 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f7cba-a2b6-4a38-8c65-24f82d216bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:10.748052 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d1468-dad2-43f2-8b0d-4afc777a6952 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:10.748128 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f7cba-a2b6-4a38-8c65-24f82d216bcf None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:10.748128 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f7cba-a2b6-4a38-8c65-24f82d216bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:10.748128 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f7cba-a2b6-4a38-8c65-24f82d216bcf None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:10.748128 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f7cba-a2b6-4a38-8c65-24f82d216bcf None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:10.748128 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f7cba-a2b6-4a38-8c65-24f82d216bcf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:10.748128 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f7cba-a2b6-4a38-8c65-24f82d216bcf None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:10.766143 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 338/668] 10.222.0.79 () {56 vars in 1137 bytes} [Wed Aug 31 19:05:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:10.766954 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f7cba-a2b6-4a38-8c65-24f82d216bcf None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:10.847766 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:10.864195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d1468-dad2-43f2-8b0d-4afc777a6952 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:10.888676 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f7cba-a2b6-4a38-8c65-24f82d216bcf None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:10.900824 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bd8c5-4ad0-4173-a6bc-14419a4d273d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:10.901563 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bd8c5-4ad0-4173-a6bc-14419a4d273d None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:10.901843 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bd8c5-4ad0-4173-a6bc-14419a4d273d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:10.902111 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bd8c5-4ad0-4173-a6bc-14419a4d273d None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:10.902907 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263bd8c5-4ad0-4173-a6bc-14419a4d273d None admin] RBAC: Adding query filter params (name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:10.903323 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263bd8c5-4ad0-4173-a6bc-14419a4d273d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:10.904706 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263bd8c5-4ad0-4173-a6bc-14419a4d273d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:10.919612 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 331/669] 10.222.0.79 () {56 vars in 1103 bytes} [Wed Aug 31 19:05:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:10.920270 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bd8c5-4ad0-4173-a6bc-14419a4d273d None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:10.924629 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f48ef5-9b91-489b-8462-d4d8ea8d4775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:10.925240 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f48ef5-9b91-489b-8462-d4d8ea8d4775 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:10.925520 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f48ef5-9b91-489b-8462-d4d8ea8d4775 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:10.925790 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f48ef5-9b91-489b-8462-d4d8ea8d4775 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:10.926446 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f48ef5-9b91-489b-8462-d4d8ea8d4775 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:10.926775 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f48ef5-9b91-489b-8462-d4d8ea8d4775 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:10.928150 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f48ef5-9b91-489b-8462-d4d8ea8d4775 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:10.944235 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 339/670] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:10.944235 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f48ef5-9b91-489b-8462-d4d8ea8d4775 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:10.945299 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:11.050543 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bd8c5-4ad0-4173-a6bc-14419a4d273d None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:11.065971 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f48ef5-9b91-489b-8462-d4d8ea8d4775 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:11.089829 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cbe497-8bcc-4ada-b4a2-1104d240aae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:11.090996 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbe497-8bcc-4ada-b4a2-1104d240aae4 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:11.091623 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbe497-8bcc-4ada-b4a2-1104d240aae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:11.092109 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbe497-8bcc-4ada-b4a2-1104d240aae4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:11.092989 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cbe497-8bcc-4ada-b4a2-1104d240aae4 None admin] RBAC: Adding query filter params (role.id=0230e2e79da94067a82374ceada29d3f, scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507, user.id=17e0a157474749939b6f8d2af26d7d4e) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:11.093299 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cbe497-8bcc-4ada-b4a2-1104d240aae4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:11.094634 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:11.096630 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cbe497-8bcc-4ada-b4a2-1104d240aae4 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:11.104428 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca9575-3c3d-4f02-bb2c-73b9efa6239d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:11.114854 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 332/671] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:05:10 2022] GET /identity/v3/role_assignments?user.id=17e0a157474749939b6f8d2af26d7d4e&scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507&role.id=0230e2e79da94067a82374ceada29d3f => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:11.115088 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca9575-3c3d-4f02-bb2c-73b9efa6239d None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:11.115088 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca9575-3c3d-4f02-bb2c-73b9efa6239d None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:11.115088 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca9575-3c3d-4f02-bb2c-73b9efa6239d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:11.115322 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cbe497-8bcc-4ada-b4a2-1104d240aae4 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:11.215553 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca9575-3c3d-4f02-bb2c-73b9efa6239d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:11.216393 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:11.218113 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca9575-3c3d-4f02-bb2c-73b9efa6239d None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:11.239502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cbe497-8bcc-4ada-b4a2-1104d240aae4 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:11.279402 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe17948-6a2d-4b5a-86ee-e77b5dc7e927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:11.280041 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe17948-6a2d-4b5a-86ee-e77b5dc7e927 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:11.280324 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe17948-6a2d-4b5a-86ee-e77b5dc7e927 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:11.280599 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe17948-6a2d-4b5a-86ee-e77b5dc7e927 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:11.293090 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe17948-6a2d-4b5a-86ee-e77b5dc7e927 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:11.294690 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe17948-6a2d-4b5a-86ee-e77b5dc7e927 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:11.310939 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-abe17948-6a2d-4b5a-86ee-e77b5dc7e927 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:11.310939 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:11.310939 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:11.310939 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:11.310939 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:11.310939 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:11.310939 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:11.310939 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:11.310939 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:11.310939 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:11.310939 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:11.310939 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:11.310939 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:11.310939 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:11.310939 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:11.310939 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:11.312000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:11.312000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:11.312000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:11.312000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:11.312000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:11.312000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:11.312000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:11.312000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:11.312000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:11.312000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:11.312000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:11.312000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:11.312000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:11.312000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:11.312000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:11.312000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:11.312000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:11.312901 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:11.312901 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:11.312901 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:11.312901 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 333/672] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:11.313309 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe17948-6a2d-4b5a-86ee-e77b5dc7e927 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:11.346011 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 340/673] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:05:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:05:11.347778 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c07aa-6d72-456c-a4a4-6dfedb79bb2a None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:11.348546 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c07aa-6d72-456c-a4a4-6dfedb79bb2a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:11.349265 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c07aa-6d72-456c-a4a4-6dfedb79bb2a None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:11.350911 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 341/674] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:05:11.355988 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c07aa-6d72-456c-a4a4-6dfedb79bb2a None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:11.385003 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:11.423354 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe17948-6a2d-4b5a-86ee-e77b5dc7e927 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:11.459470 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda382fa-48bf-4319-a2fb-6c75e017ba64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:11.460112 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda382fa-48bf-4319-a2fb-6c75e017ba64 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:11.460394 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda382fa-48bf-4319-a2fb-6c75e017ba64 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:11.460670 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda382fa-48bf-4319-a2fb-6c75e017ba64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:11.462622 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:11.468792 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda382fa-48bf-4319-a2fb-6c75e017ba64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:11.471071 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda382fa-48bf-4319-a2fb-6c75e017ba64 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:11.472113 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c07aa-6d72-456c-a4a4-6dfedb79bb2a None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:11.483078 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-eda382fa-48bf-4319-a2fb-6c75e017ba64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:11.483078 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:11.483078 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:11.483078 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:11.483078 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:11.483078 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:11.483078 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:11.483078 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:11.483078 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:11.483078 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:11.483078 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:11.483078 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:11.483078 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:05:11.483078 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:05:11.483078 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:05:11.484195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:05:11.484195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:11.484195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:11.484195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:11.484195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:11.484195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:11.484195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:11.484195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:11.484195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:11.484195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:11.484195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:11.484195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:11.484195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:11.484195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:11.484195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:11.484195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:11.484195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:11.485117 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:05:11.485117 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:05:11.485117 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:05:11.485117 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:05:11.485117 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:05:11.485117 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:05:11.485117 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:11.485117 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:11.485117 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 334/675] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:05:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:11.486140 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda382fa-48bf-4319-a2fb-6c75e017ba64 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:11.517768 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d5e96-80d5-4fad-9e31-b9c9bc051ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:11.519116 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d5e96-80d5-4fad-9e31-b9c9bc051ec8 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:11.519555 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d5e96-80d5-4fad-9e31-b9c9bc051ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:11.520301 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d5e96-80d5-4fad-9e31-b9c9bc051ec8 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:11.521275 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d5e96-80d5-4fad-9e31-b9c9bc051ec8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:11.522033 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d5e96-80d5-4fad-9e31-b9c9bc051ec8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:11.523905 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d5e96-80d5-4fad-9e31-b9c9bc051ec8 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:11.545418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 342/676] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:11.545418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf477a-3afb-4581-87aa-865bee7437cf None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:11.545418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf477a-3afb-4581-87aa-865bee7437cf None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:11.545418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf477a-3afb-4581-87aa-865bee7437cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:11.560435 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-bbdf477a-3afb-4581-87aa-865bee7437cf None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:11.561605 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-bbdf477a-3afb-4581-87aa-865bee7437cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:11.603856 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda382fa-48bf-4319-a2fb-6c75e017ba64 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:11.638793 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 343/677] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:05:11.643860 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14280fd7-2259-49a9-a63c-df975a30e034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:11.644552 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14280fd7-2259-49a9-a63c-df975a30e034 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:11.644829 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14280fd7-2259-49a9-a63c-df975a30e034 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:11.645098 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14280fd7-2259-49a9-a63c-df975a30e034 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:11.645762 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf477a-3afb-4581-87aa-865bee7437cf None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:11.656606 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14280fd7-2259-49a9-a63c-df975a30e034 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:11.658094 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14280fd7-2259-49a9-a63c-df975a30e034 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:11.673318 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-14280fd7-2259-49a9-a63c-df975a30e034 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:11.673318 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:11.673318 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:11.673318 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:11.673318 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:11.673318 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:11.673318 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:11.673318 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:11.673318 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:11.673318 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:11.673318 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:11.673318 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:11.673318 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:11.673318 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:11.673318 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:11.673318 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:11.674307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:11.674307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:11.674307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:11.674307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:11.674307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:11.674307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:11.674307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:11.674307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:11.674307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:11.674307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:11.674307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:11.674307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:11.674307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:11.674307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:11.674307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:11.674307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:11.674307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:11.675237 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:11.675237 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:11.675237 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:11.675945 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:11.678936 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 335/678] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:11.679830 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14280fd7-2259-49a9-a63c-df975a30e034 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:11.732648 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:11.775450 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf477a-3afb-4581-87aa-865bee7437cf None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:11.806598 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14280fd7-2259-49a9-a63c-df975a30e034 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:11.815715 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5bb7d-c0ba-46d8-b1a8-4129989f17b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:11.817183 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5bb7d-c0ba-46d8-b1a8-4129989f17b3 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:11.817692 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5bb7d-c0ba-46d8-b1a8-4129989f17b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:11.818210 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5bb7d-c0ba-46d8-b1a8-4129989f17b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:11.819610 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e5bb7d-c0ba-46d8-b1a8-4129989f17b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:11.820560 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e5bb7d-c0ba-46d8-b1a8-4129989f17b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:11.822586 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e5bb7d-c0ba-46d8-b1a8-4129989f17b3 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:11.839199 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 344/679] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 19:05:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:11.840240 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5bb7d-c0ba-46d8-b1a8-4129989f17b3 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:11.855770 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8f1e7-0b36-4925-b426-840b9bd94ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:11.856903 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8f1e7-0b36-4925-b426-840b9bd94ceb None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:11.857241 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8f1e7-0b36-4925-b426-840b9bd94ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:11.857521 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8f1e7-0b36-4925-b426-840b9bd94ceb None admin] PATH_INFO: `/v3/users/swift` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:11.868148 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef8f1e7-0b36-4925-b426-840b9bd94ceb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:11.870188 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef8f1e7-0b36-4925-b426-840b9bd94ceb None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:11.886303 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-8ef8f1e7-0b36-4925-b426-840b9bd94ceb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 19:05:11.886303 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:11.886303 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:11.886303 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:11.886303 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:11.886303 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:11.886303 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:11.886303 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:11.886303 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:11.886303 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:11.886303 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:11.886303 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:11.886303 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:05:11.886303 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:05:11.886303 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:05:11.886303 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:05:11.887430 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:11.887430 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:11.887430 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:05:11.887430 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:11.887430 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:05:11.887430 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:11.887430 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:11.887430 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:11.887430 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:11.887430 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:11.887430 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:11.887430 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:11.887430 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:11.887430 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:11.887430 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:11.887430 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:11.887430 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:11.887430 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:11.888355 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:11.888355 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:11.888355 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:05:11.888355 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:05:11.888355 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:05:11.888355 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:05:11.888355 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:05:11.888355 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:05:11.888355 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 19:05:11.888355 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:11.890804 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 336/680] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 19:05:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:11.893108 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8f1e7-0b36-4925-b426-840b9bd94ceb None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:11.935320 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:11.961612 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5bb7d-c0ba-46d8-b1a8-4129989f17b3 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:11.999444 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b925488-f787-4487-b0b2-9ddbb937060b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:11.999976 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b925488-f787-4487-b0b2-9ddbb937060b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:12.000270 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b925488-f787-4487-b0b2-9ddbb937060b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:12.000558 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b925488-f787-4487-b0b2-9ddbb937060b None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:12.001901 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b925488-f787-4487-b0b2-9ddbb937060b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:12.002018 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b925488-f787-4487-b0b2-9ddbb937060b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:12.003461 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b925488-f787-4487-b0b2-9ddbb937060b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:12.006252 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8f1e7-0b36-4925-b426-840b9bd94ceb None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:12.014012 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:12.019957 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 345/681] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:12.019957 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b925488-f787-4487-b0b2-9ddbb937060b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:12.052983 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e62f3-32ed-4b40-a231-8f62279b7515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:12.053590 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e62f3-32ed-4b40-a231-8f62279b7515 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:12.053872 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e62f3-32ed-4b40-a231-8f62279b7515 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:12.054150 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e62f3-32ed-4b40-a231-8f62279b7515 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:12.054926 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e62f3-32ed-4b40-a231-8f62279b7515 None admin] RBAC: Adding query filter params (role.id=0230e2e79da94067a82374ceada29d3f, scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507, user.id=a91998a2818444a595adc06f1f481fe1) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:12.055288 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e62f3-32ed-4b40-a231-8f62279b7515 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:12.056722 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e62f3-32ed-4b40-a231-8f62279b7515 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:12.062616 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 337/682] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:05:11 2022] GET /identity/v3/role_assignments?user.id=a91998a2818444a595adc06f1f481fe1&scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507&role.id=0230e2e79da94067a82374ceada29d3f => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:12.063402 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e62f3-32ed-4b40-a231-8f62279b7515 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:12.149054 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b925488-f787-4487-b0b2-9ddbb937060b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:12.195148 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4261d0-6349-4e95-8f57-0e7031ae775b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:12.196438 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4261d0-6349-4e95-8f57-0e7031ae775b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:12.196913 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4261d0-6349-4e95-8f57-0e7031ae775b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:12.197479 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4261d0-6349-4e95-8f57-0e7031ae775b None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:12.198427 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4261d0-6349-4e95-8f57-0e7031ae775b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:12.199615 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4261d0-6349-4e95-8f57-0e7031ae775b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:12.201511 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4261d0-6349-4e95-8f57-0e7031ae775b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:12.214009 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:12.215105 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e62f3-32ed-4b40-a231-8f62279b7515 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:12.228402 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 346/683] 10.222.0.79 () {56 vars in 1135 bytes} [Wed Aug 31 19:05:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:12.233606 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4261d0-6349-4e95-8f57-0e7031ae775b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:12.274267 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f54320f-a52e-46d2-92ee-4d0ba7695fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:12.275607 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54320f-a52e-46d2-92ee-4d0ba7695fa9 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:12.275607 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54320f-a52e-46d2-92ee-4d0ba7695fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:12.275959 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54320f-a52e-46d2-92ee-4d0ba7695fa9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:12.290085 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f54320f-a52e-46d2-92ee-4d0ba7695fa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:05:12.296415 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-6f54320f-a52e-46d2-92ee-4d0ba7695fa9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:05:12.296415 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:12.296415 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:12.296415 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:12.296415 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:12.296415 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:12.296415 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:12.296415 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:12.296415 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:12.296415 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:12.296415 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:12.296415 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:12.296415 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:05:12.296415 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:05:12.296415 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:05:12.296415 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:05:12.297346 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:05:12.297346 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:05:12.297346 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:05:12.297346 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:05:12.297346 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:12.297346 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:12.297346 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:12.297346 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:12.297346 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:12.297346 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:12.297346 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:12.297346 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:12.297346 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:12.297346 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:12.297346 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:12.297346 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:12.298205 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:12.298205 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:12.298205 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:12.298205 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:12.298205 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:05:12.298205 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:05:12.298205 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:05:12.298205 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:05:12.298205 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:05:12.298205 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:05:12.298205 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:05:12.298205 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:12.298205 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 338/684] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 19:05:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:12.298968 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f54320f-a52e-46d2-92ee-4d0ba7695fa9 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:12.334331 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:12.368082 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4261d0-6349-4e95-8f57-0e7031ae775b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:12.408047 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f54320f-a52e-46d2-92ee-4d0ba7695fa9 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:12.414205 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8f83b-8579-43d0-a250-dcbe406dc0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:12.414865 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8f83b-8579-43d0-a250-dcbe406dc0e7 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:12.415159 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8f83b-8579-43d0-a250-dcbe406dc0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:12.415420 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8f83b-8579-43d0-a250-dcbe406dc0e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:12.425357 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b8f83b-8579-43d0-a250-dcbe406dc0e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:12.427470 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b8f83b-8579-43d0-a250-dcbe406dc0e7 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:12.443075 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-81b8f83b-8579-43d0-a250-dcbe406dc0e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:12.443075 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:12.443075 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:12.443075 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:12.443075 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:12.443075 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:12.443075 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:12.443075 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:12.443075 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:12.443075 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:12.443075 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:12.443075 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:12.443075 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:05:12.443075 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:05:12.443075 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:05:12.444174 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:05:12.444174 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:12.444174 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:12.444174 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:12.444174 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:12.444174 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:12.444174 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:12.444174 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:12.444174 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:12.444174 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:12.444174 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:12.444174 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:12.444174 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:12.444174 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:12.444174 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:12.444174 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:12.444174 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:12.445278 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:05:12.445278 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:05:12.445278 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:05:12.445278 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:05:12.445278 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:05:12.445278 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:05:12.445278 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:12.445278 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:12.445278 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 347/685] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:05:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:12.445278 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8f83b-8579-43d0-a250-dcbe406dc0e7 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:12.452396 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af70f4-7985-4b73-a4a7-34a016556d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:12.453191 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af70f4-7985-4b73-a4a7-34a016556d90 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:12.453609 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af70f4-7985-4b73-a4a7-34a016556d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:12.454015 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af70f4-7985-4b73-a4a7-34a016556d90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:12.513697 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:12.553487 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63af70f4-7985-4b73-a4a7-34a016556d90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:12.555256 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63af70f4-7985-4b73-a4a7-34a016556d90 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:12.566310 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8f83b-8579-43d0-a250-dcbe406dc0e7 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:12.595920 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:12.605305 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90aedc-2af2-4678-a4cd-f113d30c8f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:12.606343 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90aedc-2af2-4678-a4cd-f113d30c8f3e None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:12.606865 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90aedc-2af2-4678-a4cd-f113d30c8f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:12.607329 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90aedc-2af2-4678-a4cd-f113d30c8f3e None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:12.608215 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90aedc-2af2-4678-a4cd-f113d30c8f3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:12.608759 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90aedc-2af2-4678-a4cd-f113d30c8f3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:12.610343 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90aedc-2af2-4678-a4cd-f113d30c8f3e None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:12.625255 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 348/686] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:05:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:12.627302 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90aedc-2af2-4678-a4cd-f113d30c8f3e None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:12.682614 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 339/687] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:05:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:05:12.683851 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af70f4-7985-4b73-a4a7-34a016556d90 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:12.769540 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90aedc-2af2-4678-a4cd-f113d30c8f3e None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:12.789354 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:12.796979 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af70f4-7985-4b73-a4a7-34a016556d90 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:12.812597 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caff039-1ffd-4b8e-81a7-0bd0aff2450d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:12.813741 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caff039-1ffd-4b8e-81a7-0bd0aff2450d None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:12.814028 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caff039-1ffd-4b8e-81a7-0bd0aff2450d None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:12.814301 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caff039-1ffd-4b8e-81a7-0bd0aff2450d None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:12.815052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caff039-1ffd-4b8e-81a7-0bd0aff2450d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:12.815611 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caff039-1ffd-4b8e-81a7-0bd0aff2450d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:12.817310 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caff039-1ffd-4b8e-81a7-0bd0aff2450d None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:12.831491 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:12.842161 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 349/688] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 19:05:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:12.842161 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caff039-1ffd-4b8e-81a7-0bd0aff2450d None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:12.844235 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e5d18-3bb7-4a9c-ac66-5beee33dc2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:12.845675 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e5d18-3bb7-4a9c-ac66-5beee33dc2ab None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:12.846145 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e5d18-3bb7-4a9c-ac66-5beee33dc2ab None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:12.846653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e5d18-3bb7-4a9c-ac66-5beee33dc2ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:12.858254 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e5d18-3bb7-4a9c-ac66-5beee33dc2ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:12.859988 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e5d18-3bb7-4a9c-ac66-5beee33dc2ab None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:12.875834 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-c76e5d18-3bb7-4a9c-ac66-5beee33dc2ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:12.875834 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:12.875834 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:12.875834 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:12.875834 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:12.875834 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:12.875834 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:12.875834 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:12.875834 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:12.875834 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:12.875834 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:12.875834 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:12.875834 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:12.875834 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:12.875834 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:12.875834 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:12.876855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:12.876855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:12.876855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:12.876855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:12.876855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:12.876855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:12.876855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:12.876855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:12.876855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:12.876855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:12.876855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:12.876855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:12.876855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:12.876855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:12.876855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:12.876855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:12.876855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:12.877747 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:12.877747 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:12.877747 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:12.884395 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 340/689] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:12.885598 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e5d18-3bb7-4a9c-ac66-5beee33dc2ab None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:12.968189 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caff039-1ffd-4b8e-81a7-0bd0aff2450d None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:12.997517 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e5d18-3bb7-4a9c-ac66-5beee33dc2ab None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:13.016788 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03413ca1-2993-43b3-bd93-47dc00f8e851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:13.017425 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03413ca1-2993-43b3-bd93-47dc00f8e851 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:13.017706 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03413ca1-2993-43b3-bd93-47dc00f8e851 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:13.017980 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03413ca1-2993-43b3-bd93-47dc00f8e851 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:13.032310 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03413ca1-2993-43b3-bd93-47dc00f8e851 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:13.033792 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03413ca1-2993-43b3-bd93-47dc00f8e851 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:13.035298 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0b6a4-3de1-4f40-a830-ea787269a3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:13.036165 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0b6a4-3de1-4f40-a830-ea787269a3ac None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:13.036638 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0b6a4-3de1-4f40-a830-ea787269a3ac None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:13.037097 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0b6a4-3de1-4f40-a830-ea787269a3ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:13.038039 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0b6a4-3de1-4f40-a830-ea787269a3ac None admin] RBAC: Adding query filter params (role.id=0230e2e79da94067a82374ceada29d3f, scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507, user.id=254dd957da6345f79bcab42b27b8d2cc) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:13.038580 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0b6a4-3de1-4f40-a830-ea787269a3ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:13.040331 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0b6a4-3de1-4f40-a830-ea787269a3ac None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:13.048920 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 341/690] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:05:12 2022] GET /identity/v3/role_assignments?user.id=254dd957da6345f79bcab42b27b8d2cc&scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507&role.id=0230e2e79da94067a82374ceada29d3f => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:13.053119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0b6a4-3de1-4f40-a830-ea787269a3ac None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:13.058532 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-03413ca1-2993-43b3-bd93-47dc00f8e851 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:13.058532 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:13.058532 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:13.058532 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:13.058532 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:13.058532 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:13.058532 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:13.058532 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:13.058532 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:13.058532 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:13.058532 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:13.058532 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:13.058532 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:13.058532 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:13.058532 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:13.058532 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:13.059512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:13.059512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:13.059512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:13.059512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:13.059512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:13.059512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:13.059512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:13.059512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:13.059512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:13.059512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:13.059512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:13.059512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:13.059512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:13.059512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:13.059512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:13.059512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:13.059512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:13.060500 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:13.060500 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:13.060500 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:13.062491 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 350/691] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:13.069906 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03413ca1-2993-43b3-bd93-47dc00f8e851 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:13.132086 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:13.139124 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:13.210849 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0b6a4-3de1-4f40-a830-ea787269a3ac None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:13.240159 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03413ca1-2993-43b3-bd93-47dc00f8e851 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:13.256890 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ea14a-4c24-4336-9ba7-df53b5531730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:13.257705 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ea14a-4c24-4336-9ba7-df53b5531730 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:13.258268 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ea14a-4c24-4336-9ba7-df53b5531730 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:13.258879 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ea14a-4c24-4336-9ba7-df53b5531730 None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:13.260202 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ea14a-4c24-4336-9ba7-df53b5531730 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:13.260873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ea14a-4c24-4336-9ba7-df53b5531730 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:13.263668 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ea14a-4c24-4336-9ba7-df53b5531730 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:13.280177 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 342/692] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:13.281480 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2c44c-6a95-417b-8b79-6ad39bdc8938 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:13.281831 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2c44c-6a95-417b-8b79-6ad39bdc8938 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:13.282201 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2c44c-6a95-417b-8b79-6ad39bdc8938 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:13.284030 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 343/693] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:05:13.291186 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241efc15-bc36-45c2-b0e4-411cab4f8576 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:13.291635 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241efc15-bc36-45c2-b0e4-411cab4f8576 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:13.292017 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241efc15-bc36-45c2-b0e4-411cab4f8576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:13.295258 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe30a0-b32e-48cf-8d0b-60e0275af9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:13.295902 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe30a0-b32e-48cf-8d0b-60e0275af9cc None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:13.296186 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe30a0-b32e-48cf-8d0b-60e0275af9cc None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:13.296464 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe30a0-b32e-48cf-8d0b-60e0275af9cc None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:13.297148 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe30a0-b32e-48cf-8d0b-60e0275af9cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:13.297630 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe30a0-b32e-48cf-8d0b-60e0275af9cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:13.299449 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe30a0-b32e-48cf-8d0b-60e0275af9cc None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:13.315125 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 351/694] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:05:13.316070 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe30a0-b32e-48cf-8d0b-60e0275af9cc None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:13.318105 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-241efc15-bc36-45c2-b0e4-411cab4f8576 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:13.319828 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-241efc15-bc36-45c2-b0e4-411cab4f8576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:13.412041 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 344/695] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:05:13.412733 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241efc15-bc36-45c2-b0e4-411cab4f8576 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:13.450646 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:13.469595 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe30a0-b32e-48cf-8d0b-60e0275af9cc None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:13.497685 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:13.582860 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241efc15-bc36-45c2-b0e4-411cab4f8576 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:13.587214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c0c5d-2f62-4eb7-8565-01c6c98d3c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:13.587878 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c0c5d-2f62-4eb7-8565-01c6c98d3c5e None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:13.588162 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c0c5d-2f62-4eb7-8565-01c6c98d3c5e None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:13.588442 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c0c5d-2f62-4eb7-8565-01c6c98d3c5e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:13.603402 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34c0c5d-2f62-4eb7-8565-01c6c98d3c5e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:13.604904 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34c0c5d-2f62-4eb7-8565-01c6c98d3c5e None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:13.623853 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f9302-3e22-4bb1-9699-31c44a9d8ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:13.624925 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f9302-3e22-4bb1-9699-31c44a9d8ec3 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:13.625448 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f9302-3e22-4bb1-9699-31c44a9d8ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:13.625978 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f9302-3e22-4bb1-9699-31c44a9d8ec3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:13.635703 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f9302-3e22-4bb1-9699-31c44a9d8ec3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:13.636169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-e34c0c5d-2f62-4eb7-8565-01c6c98d3c5e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:05:13.636169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:13.636169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:13.636169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:13.636169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:13.636169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:13.636169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:13.636169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:13.636169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:13.636169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:13.636169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:13.636169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:13.636169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:05:13.636169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:05:13.636169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:05:13.636169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:05:13.637195 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:13.637195 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:13.637195 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:05:13.637195 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:13.637195 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:05:13.637195 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:13.637195 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:13.637195 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:13.637195 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:13.637195 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:13.637195 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:13.637195 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:13.637195 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:13.637195 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:13.637195 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:13.637195 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:13.637195 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:13.637195 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:13.638947 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:13.638947 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:13.638947 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:05:13.638947 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:05:13.638947 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:05:13.638947 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:05:13.638947 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:05:13.638947 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:05:13.638947 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:05:13.638947 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:13.642626 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f9302-3e22-4bb1-9699-31c44a9d8ec3 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:13.642886 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 352/696] 10.222.0.79 () {56 vars in 1093 bytes} [Wed Aug 31 19:05:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:13.643729 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c0c5d-2f62-4eb7-8565-01c6c98d3c5e None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:13.657445 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-f98f9302-3e22-4bb1-9699-31c44a9d8ec3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:13.657445 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:13.657445 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:13.657445 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:13.657445 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:13.657445 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:13.657445 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:13.657445 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:13.657445 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:13.657445 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:13.657445 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:13.657445 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:13.657445 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:05:13.657445 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:05:13.657445 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:05:13.658958 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:05:13.658958 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:13.658958 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:13.658958 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:13.658958 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:13.658958 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:13.658958 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:13.658958 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:13.658958 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:13.658958 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:13.658958 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:13.658958 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:13.658958 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:13.658958 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:13.658958 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:13.658958 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:13.658958 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:13.659842 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:05:13.659842 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:05:13.659842 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:05:13.659842 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:05:13.659842 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:05:13.659842 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:05:13.659842 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:13.659842 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:13.661951 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 345/697] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:05:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:13.668564 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f9302-3e22-4bb1-9699-31c44a9d8ec3 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:13.812079 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:13.820610 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f9302-3e22-4bb1-9699-31c44a9d8ec3 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:13.820895 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c0c5d-2f62-4eb7-8565-01c6c98d3c5e None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:13.859944 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39761014-2b0f-47fb-b772-2a240b2bbbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:13.860292 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ebbd4-729e-4490-a264-6ae9b77c94c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:13.860929 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ebbd4-729e-4490-a264-6ae9b77c94c8 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:13.861213 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ebbd4-729e-4490-a264-6ae9b77c94c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:13.861489 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ebbd4-729e-4490-a264-6ae9b77c94c8 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:13.861796 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39761014-2b0f-47fb-b772-2a240b2bbbdd None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:13.862242 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ebbd4-729e-4490-a264-6ae9b77c94c8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:13.862452 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39761014-2b0f-47fb-b772-2a240b2bbbdd None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:13.862629 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ebbd4-729e-4490-a264-6ae9b77c94c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:13.863086 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39761014-2b0f-47fb-b772-2a240b2bbbdd None admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:13.863973 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39761014-2b0f-47fb-b772-2a240b2bbbdd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:13.864076 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ebbd4-729e-4490-a264-6ae9b77c94c8 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:13.864576 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39761014-2b0f-47fb-b772-2a240b2bbbdd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:13.866195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39761014-2b0f-47fb-b772-2a240b2bbbdd None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:13.880360 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 346/698] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 19:05:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:13.881550 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39761014-2b0f-47fb-b772-2a240b2bbbdd None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:13.894797 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 353/699] 10.222.0.79 () {56 vars in 1133 bytes} [Wed Aug 31 19:05:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:13.895961 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ebbd4-729e-4490-a264-6ae9b77c94c8 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:13.908689 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:13.994811 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39761014-2b0f-47fb-b772-2a240b2bbbdd None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:14.011256 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ebbd4-729e-4490-a264-6ae9b77c94c8 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:14.030665 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e7e4b-969c-4364-98cd-879e8f372b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:14.031646 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e7e4b-969c-4364-98cd-879e8f372b29 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:14.032121 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e7e4b-969c-4364-98cd-879e8f372b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:14.033106 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e7e4b-969c-4364-98cd-879e8f372b29 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:14.033911 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036e7e4b-969c-4364-98cd-879e8f372b29 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:14.035691 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036e7e4b-969c-4364-98cd-879e8f372b29 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:14.047520 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-036e7e4b-969c-4364-98cd-879e8f372b29 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 19:05:14.047520 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:14.047520 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:05:14.047520 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:05:14.047520 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:05:14.047520 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:05:14.047520 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:05:14.047520 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:05:14.047520 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 19:05:14.047520 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:14.047520 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:05:14.047520 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:14.047520 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:14.047520 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:14.047520 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:14.047520 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:14.047520 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:14.049104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:14.049104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:14.049104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:14.049104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:14.049104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:14.049104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:14.049104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:05:14.049104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:05:14.049104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:05:14.049104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:05:14.049104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:14.049104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:14.049104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:14.049104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:14.049104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:14.049104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:14.049942 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:14.049942 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:14.049942 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:14.049942 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:14.049942 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:14.049942 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:14.049942 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:14.049942 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:14.049942 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:14.049942 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:14.049942 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:05:14.049942 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:05:14.049942 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 19:05:14.049942 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:14.055654 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 347/700] 10.222.0.79 () {56 vars in 1129 bytes} [Wed Aug 31 19:05:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:14.055654 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e7e4b-969c-4364-98cd-879e8f372b29 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:14.057365 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896fff03-cf14-4c47-b45e-4767c6171de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:14.057993 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fff03-cf14-4c47-b45e-4767c6171de4 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:14.058273 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fff03-cf14-4c47-b45e-4767c6171de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:14.058644 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fff03-cf14-4c47-b45e-4767c6171de4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:14.059388 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896fff03-cf14-4c47-b45e-4767c6171de4 None admin] RBAC: Adding query filter params (role.id=0230e2e79da94067a82374ceada29d3f, scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507, user.id=3b289a0bef53460ca5173ad946394d72) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:14.059758 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896fff03-cf14-4c47-b45e-4767c6171de4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:14.061306 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896fff03-cf14-4c47-b45e-4767c6171de4 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:14.068882 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 354/701] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:05:13 2022] GET /identity/v3/role_assignments?user.id=3b289a0bef53460ca5173ad946394d72&scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507&role.id=0230e2e79da94067a82374ceada29d3f => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:14.069633 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896fff03-cf14-4c47-b45e-4767c6171de4 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:14.081511 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:14.156719 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:14.167158 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e7e4b-969c-4364-98cd-879e8f372b29 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:14.195237 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896fff03-cf14-4c47-b45e-4767c6171de4 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:14.238419 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113bf0a-e1c1-4b3e-9850-06caf92d3f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:14.239720 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113bf0a-e1c1-4b3e-9850-06caf92d3f15 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:14.240335 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113bf0a-e1c1-4b3e-9850-06caf92d3f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:14.240776 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c21ac-9c39-4102-a4aa-e94eaf3611e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:14.241069 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113bf0a-e1c1-4b3e-9850-06caf92d3f15 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:14.241446 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c21ac-9c39-4102-a4aa-e94eaf3611e4 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:14.241761 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c21ac-9c39-4102-a4aa-e94eaf3611e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:14.242082 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c21ac-9c39-4102-a4aa-e94eaf3611e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:14.242777 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2113bf0a-e1c1-4b3e-9850-06caf92d3f15 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:14.243291 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2113bf0a-e1c1-4b3e-9850-06caf92d3f15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:14.244991 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2113bf0a-e1c1-4b3e-9850-06caf92d3f15 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:14.251919 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 355/702] 10.222.0.79 () {56 vars in 1124 bytes} [Wed Aug 31 19:05:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:14.258516 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2520787-a8ac-4b23-a6a0-5f8c3c497ca3 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:14.258516 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2520787-a8ac-4b23-a6a0-5f8c3c497ca3 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:14.258516 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2520787-a8ac-4b23-a6a0-5f8c3c497ca3 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:14.260394 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 356/703] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:05:14.261353 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2520787-a8ac-4b23-a6a0-5f8c3c497ca3 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:14.351673 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327c21ac-9c39-4102-a4aa-e94eaf3611e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:14.352488 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327c21ac-9c39-4102-a4aa-e94eaf3611e4 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:14.377510 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:14.397999 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2520787-a8ac-4b23-a6a0-5f8c3c497ca3 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:14.441775 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f926c7b-0a90-4dfe-8a40-a789aed0a145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:14.442403 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f926c7b-0a90-4dfe-8a40-a789aed0a145 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:14.442716 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f926c7b-0a90-4dfe-8a40-a789aed0a145 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:14.442989 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f926c7b-0a90-4dfe-8a40-a789aed0a145 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:14.443639 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f926c7b-0a90-4dfe-8a40-a789aed0a145 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:14.443942 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f926c7b-0a90-4dfe-8a40-a789aed0a145 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:14.445316 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f926c7b-0a90-4dfe-8a40-a789aed0a145 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:14.449241 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:14.453266 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 357/704] 10.222.0.79 () {56 vars in 1124 bytes} [Wed Aug 31 19:05:14 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:14.463506 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d20eb-ff62-40c0-9532-4ef997b4ce1b None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:14.464343 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d20eb-ff62-40c0-9532-4ef997b4ce1b None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:14.464894 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d20eb-ff62-40c0-9532-4ef997b4ce1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:14.485169 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 348/705] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:05:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 19:05:14.492940 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c21ac-9c39-4102-a4aa-e94eaf3611e4 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:14.502185 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-8c6d20eb-ff62-40c0-9532-4ef997b4ce1b None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:14.507475 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8c6d20eb-ff62-40c0-9532-4ef997b4ce1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:14.643108 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 358/706] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:05:14.685851 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c21ac-9c39-4102-a4aa-e94eaf3611e4 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:14.710381 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:14.726946 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67286cf-8fac-4244-bcb6-0b4acfe69dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:14.728040 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67286cf-8fac-4244-bcb6-0b4acfe69dce None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:14.728321 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67286cf-8fac-4244-bcb6-0b4acfe69dce None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:14.728589 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67286cf-8fac-4244-bcb6-0b4acfe69dce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:14.739772 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67286cf-8fac-4244-bcb6-0b4acfe69dce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:14.743011 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67286cf-8fac-4244-bcb6-0b4acfe69dce None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:14.758892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-c67286cf-8fac-4244-bcb6-0b4acfe69dce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:14.758892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:14.758892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:14.758892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:14.758892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:14.758892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:14.758892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:14.758892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:14.758892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:14.758892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:14.758892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:14.758892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:14.758892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:14.758892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:14.758892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:14.758892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:14.759902 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:14.759902 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:14.759902 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:14.759902 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:14.759902 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:14.759902 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:14.759902 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:14.759902 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:14.759902 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:14.759902 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:14.759902 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:14.759902 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:14.759902 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:14.759902 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:14.759902 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:14.759902 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:14.759902 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:14.761147 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:14.761147 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:14.761147 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:14.761147 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 349/707] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:14.765750 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d20eb-ff62-40c0-9532-4ef997b4ce1b None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:14.878385 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d20eb-ff62-40c0-9532-4ef997b4ce1b None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:14.912044 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:14.918645 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc3efe-946e-4df7-b3c4-7da324626c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:14.919268 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc3efe-946e-4df7-b3c4-7da324626c5b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:14.919550 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc3efe-946e-4df7-b3c4-7da324626c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:14.919824 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc3efe-946e-4df7-b3c4-7da324626c5b None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:14.920908 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc3efe-946e-4df7-b3c4-7da324626c5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:14.921395 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc3efe-946e-4df7-b3c4-7da324626c5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:14.922944 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc3efe-946e-4df7-b3c4-7da324626c5b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:14.935743 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 359/708] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:14.941884 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67286cf-8fac-4244-bcb6-0b4acfe69dce None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:15.050551 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67286cf-8fac-4244-bcb6-0b4acfe69dce None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:15.086312 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ebfcc-05e4-4fc4-8388-76bde3b3ec06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:15.087026 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ebfcc-05e4-4fc4-8388-76bde3b3ec06 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:15.087630 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ebfcc-05e4-4fc4-8388-76bde3b3ec06 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:15.087905 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ebfcc-05e4-4fc4-8388-76bde3b3ec06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:15.095457 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ebfcc-05e4-4fc4-8388-76bde3b3ec06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:15.097005 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ebfcc-05e4-4fc4-8388-76bde3b3ec06 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:15.104985 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc3efe-946e-4df7-b3c4-7da324626c5b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:15.124258 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-297ebfcc-05e4-4fc4-8388-76bde3b3ec06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:15.124258 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:15.124258 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:15.124258 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:15.124258 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:15.124258 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:15.124258 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:15.124258 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:15.124258 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:15.124258 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:15.124258 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:15.124258 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:15.124258 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:05:15.124258 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:05:15.124258 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:05:15.125201 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:05:15.125201 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:15.125201 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:15.125201 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:15.125201 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:15.125201 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:15.125201 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:15.125201 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:15.125201 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:15.125201 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:15.125201 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:15.125201 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:15.125201 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:15.125201 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:15.125201 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:15.125201 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:15.125201 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:15.126691 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:05:15.126691 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:05:15.126691 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:05:15.126691 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:05:15.126691 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:05:15.126691 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:05:15.126691 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:15.126691 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:15.130154 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 350/709] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:05:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:15.152651 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ebfcc-05e4-4fc4-8388-76bde3b3ec06 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:15.190915 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:15.282926 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ebfcc-05e4-4fc4-8388-76bde3b3ec06 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:15.312280 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc3efe-946e-4df7-b3c4-7da324626c5b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:15.349149 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d48e7a-4865-4c30-a0c6-d5ad218ff228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:15.349836 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d48e7a-4865-4c30-a0c6-d5ad218ff228 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:15.350119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d48e7a-4865-4c30-a0c6-d5ad218ff228 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:15.350393 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d48e7a-4865-4c30-a0c6-d5ad218ff228 None admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:15.351124 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d48e7a-4865-4c30-a0c6-d5ad218ff228 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:15.351692 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d48e7a-4865-4c30-a0c6-d5ad218ff228 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:15.353124 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d48e7a-4865-4c30-a0c6-d5ad218ff228 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:15.375498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 351/710] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 19:05:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:05:15.376876 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f8831-d5f0-47ac-9b00-2edf7cf435a2 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:15.377160 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f8831-d5f0-47ac-9b00-2edf7cf435a2 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:15.377433 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f8831-d5f0-47ac-9b00-2edf7cf435a2 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:15.378959 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 352/711] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:05:15.383049 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f699ac5-d499-49d3-b595-91e7fb6bacc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:15.383304 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f8831-d5f0-47ac-9b00-2edf7cf435a2 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:15.383684 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f699ac5-d499-49d3-b595-91e7fb6bacc4 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:15.383970 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f699ac5-d499-49d3-b595-91e7fb6bacc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:15.384347 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f699ac5-d499-49d3-b595-91e7fb6bacc4 None admin] PATH_INFO: `/v3/services/network` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:15.384947 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f699ac5-d499-49d3-b595-91e7fb6bacc4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:15.386311 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f699ac5-d499-49d3-b595-91e7fb6bacc4 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:15.397997 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-6f699ac5-d499-49d3-b595-91e7fb6bacc4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 19:05:15.397997 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:15.397997 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:05:15.397997 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:05:15.397997 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:05:15.397997 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:05:15.397997 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:05:15.397997 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:05:15.397997 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 19:05:15.397997 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:15.397997 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:05:15.397997 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:15.397997 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:15.397997 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:15.397997 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:15.397997 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:15.397997 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:15.399265 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:15.399265 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:15.399265 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:15.399265 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:15.399265 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:15.399265 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:15.399265 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:05:15.399265 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:05:15.399265 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:05:15.399265 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:05:15.399265 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:15.399265 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:15.399265 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:15.399265 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:15.399265 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:15.399265 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:15.400365 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:15.400365 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:15.400365 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:15.400365 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:15.400365 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:15.400365 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:15.400365 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:15.400365 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:15.400365 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:15.400365 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:15.400365 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:05:15.400365 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:05:15.400365 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 19:05:15.400365 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:15.400365 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 360/712] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:05:15 2022] GET /identity/v3/services/network => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:15.401477 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff61652-6433-4c7b-9047-4be911b48ba2 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:15.401477 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff61652-6433-4c7b-9047-4be911b48ba2 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:15.401477 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff61652-6433-4c7b-9047-4be911b48ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:15.419764 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-0ff61652-6433-4c7b-9047-4be911b48ba2 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:15.421465 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0ff61652-6433-4c7b-9047-4be911b48ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:15.492384 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:15.508060 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:15.512679 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 361/713] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:05:15.513518 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff61652-6433-4c7b-9047-4be911b48ba2 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:15.520245 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f8831-d5f0-47ac-9b00-2edf7cf435a2 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:15.559971 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525be96-3345-4c2a-b5f8-23f63262e3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:15.560984 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525be96-3345-4c2a-b5f8-23f63262e3ce None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:15.561466 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525be96-3345-4c2a-b5f8-23f63262e3ce None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:15.561934 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525be96-3345-4c2a-b5f8-23f63262e3ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:15.563028 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525be96-3345-4c2a-b5f8-23f63262e3ce None admin] RBAC: Adding query filter params (role.id=edc551338adb4ae88bdafc591ad69582, scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507, user.id=1fd6d45d1bc3479da72cb1a1990a6137) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:15.564103 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525be96-3345-4c2a-b5f8-23f63262e3ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:15.565884 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525be96-3345-4c2a-b5f8-23f63262e3ce None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:15.572809 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 353/714] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:05:15 2022] GET /identity/v3/role_assignments?user.id=1fd6d45d1bc3479da72cb1a1990a6137&scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507&role.id=edc551338adb4ae88bdafc591ad69582 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:15.623614 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff61652-6433-4c7b-9047-4be911b48ba2 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:15.660949 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00cfa81-a3d8-4281-af7b-7c962c379d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:15.661572 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00cfa81-a3d8-4281-af7b-7c962c379d04 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:15.661852 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00cfa81-a3d8-4281-af7b-7c962c379d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:15.662131 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00cfa81-a3d8-4281-af7b-7c962c379d04 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:15.662805 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00cfa81-a3d8-4281-af7b-7c962c379d04 None admin] RBAC: Adding query filter params (name=network) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:15.663174 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00cfa81-a3d8-4281-af7b-7c962c379d04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:15.664541 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00cfa81-a3d8-4281-af7b-7c962c379d04 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:15.669571 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 362/715] 10.222.0.79 () {56 vars in 1112 bytes} [Wed Aug 31 19:05:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:15.679639 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525be96-3345-4c2a-b5f8-23f63262e3ce None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:15.817293 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00cfa81-a3d8-4281-af7b-7c962c379d04 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:15.842358 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525be96-3345-4c2a-b5f8-23f63262e3ce None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:15.871890 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:15.890937 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ed3ef-4d23-493f-9b19-7cb186463d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:15.892319 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ed3ef-4d23-493f-9b19-7cb186463d0b None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:15.892861 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ed3ef-4d23-493f-9b19-7cb186463d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:15.893307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ed3ef-4d23-493f-9b19-7cb186463d0b None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:15.894217 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ed3ef-4d23-493f-9b19-7cb186463d0b None admin] RBAC: Adding query filter params (type=network) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:15.894711 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ed3ef-4d23-493f-9b19-7cb186463d0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:15.897309 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ed3ef-4d23-493f-9b19-7cb186463d0b None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:15.904674 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 354/716] 10.222.0.79 () {56 vars in 1112 bytes} [Wed Aug 31 19:05:15 2022] GET /identity/v3/services?type=network => generated 124 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:15.933077 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00cfa81-a3d8-4281-af7b-7c962c379d04 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:15.972547 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58f51c-2c4f-4831-b73a-6987ed122c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:15.973253 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58f51c-2c4f-4831-b73a-6987ed122c90 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:15.973528 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58f51c-2c4f-4831-b73a-6987ed122c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:15.973797 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58f51c-2c4f-4831-b73a-6987ed122c90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:15.985618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d58f51c-2c4f-4831-b73a-6987ed122c90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:15.987135 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d58f51c-2c4f-4831-b73a-6987ed122c90 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:16.003803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-3d58f51c-2c4f-4831-b73a-6987ed122c90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:16.003803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:16.003803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:16.003803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:16.003803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:16.003803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:16.003803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:16.003803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:16.003803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:16.003803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:16.003803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:16.003803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:16.003803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:16.003803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:16.003803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:16.003803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:16.005161 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:16.005161 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:16.005161 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:16.005161 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:16.005161 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:16.005161 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:16.005161 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:16.005161 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:16.005161 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:16.005161 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:16.005161 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:16.005161 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:16.005161 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:16.005161 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:16.005161 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:16.005161 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:16.005161 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:16.006601 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:16.006601 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:16.006601 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:16.006601 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 363/717] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:16.011411 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ed3ef-4d23-493f-9b19-7cb186463d0b None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:16.054203 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:16.160146 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ed3ef-4d23-493f-9b19-7cb186463d0b None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:16.195962 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb20cf-96db-4a5e-89ad-b7ea0b2fe01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:16.196574 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb20cf-96db-4a5e-89ad-b7ea0b2fe01c None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:16.196853 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb20cf-96db-4a5e-89ad-b7ea0b2fe01c None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:16.197125 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb20cf-96db-4a5e-89ad-b7ea0b2fe01c None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:16.197772 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb20cf-96db-4a5e-89ad-b7ea0b2fe01c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:16.198075 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb20cf-96db-4a5e-89ad-b7ea0b2fe01c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:16.199473 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb20cf-96db-4a5e-89ad-b7ea0b2fe01c None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:16.212118 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 355/718] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:16.217740 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58f51c-2c4f-4831-b73a-6987ed122c90 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:16.336380 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:16.340178 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58f51c-2c4f-4831-b73a-6987ed122c90 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:16.388423 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc17533-f0db-4e19-986d-b5996acacd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:16.389046 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc17533-f0db-4e19-986d-b5996acacd5b None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:16.389329 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc17533-f0db-4e19-986d-b5996acacd5b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:16.389599 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc17533-f0db-4e19-986d-b5996acacd5b None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:16.390268 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc17533-f0db-4e19-986d-b5996acacd5b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:16.392351 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc17533-f0db-4e19-986d-b5996acacd5b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:16.421699 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 364/719] 10.222.0.79 () {60 vars in 1132 bytes} [Wed Aug 31 19:05:16 2022] POST /identity/v3/users => generated 254 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:05:16.617759 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b4206-44bb-4dad-b440-17becd931c18 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:16.618093 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b4206-44bb-4dad-b440-17becd931c18 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:16.618321 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b4206-44bb-4dad-b440-17becd931c18 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:16.619700 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 356/720] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:05:16.625186 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6b6a2-5cd0-4475-8f8e-f391f362f559 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:16.625484 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6b6a2-5cd0-4475-8f8e-f391f362f559 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:16.625766 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6b6a2-5cd0-4475-8f8e-f391f362f559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:16.650805 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-5dd6b6a2-5cd0-4475-8f8e-f391f362f559 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:16.651997 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5dd6b6a2-5cd0-4475-8f8e-f391f362f559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:16.728426 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 365/721] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:05:16.953016 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231095d-25f2-4322-ba05-cc9bed2328cd None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:16.953300 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231095d-25f2-4322-ba05-cc9bed2328cd None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:16.953579 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231095d-25f2-4322-ba05-cc9bed2328cd None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:16.955919 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 357/722] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:05:16.961359 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472aea4-bbbc-4c25-99ad-b8421b04054c None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:16.961821 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472aea4-bbbc-4c25-99ad-b8421b04054c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:16.961899 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472aea4-bbbc-4c25-99ad-b8421b04054c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:16.985887 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-b472aea4-bbbc-4c25-99ad-b8421b04054c None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:16.987001 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b472aea4-bbbc-4c25-99ad-b8421b04054c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:17.020757 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231095d-25f2-4322-ba05-cc9bed2328cd None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:17.112007 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 366/723] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:05:17.146474 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:17.168020 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231095d-25f2-4322-ba05-cc9bed2328cd None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:17.205639 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb23e17-a85f-46f2-b35b-f6232309a780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:17.206273 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb23e17-a85f-46f2-b35b-f6232309a780 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:17.206639 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb23e17-a85f-46f2-b35b-f6232309a780 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:17.206912 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb23e17-a85f-46f2-b35b-f6232309a780 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:17.217794 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb23e17-a85f-46f2-b35b-f6232309a780 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:05:17.223350 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-ffb23e17-a85f-46f2-b35b-f6232309a780 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:05:17.223350 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:17.223350 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:17.223350 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:17.223350 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:17.223350 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:17.223350 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:17.223350 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:17.223350 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:17.223350 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:17.223350 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:17.223350 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:17.223350 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:05:17.223350 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:05:17.223350 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:05:17.223350 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:05:17.224546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:05:17.224546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:05:17.224546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:05:17.224546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:05:17.224546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:17.224546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:17.224546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:17.224546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:17.224546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:17.224546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:17.224546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:17.224546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:17.224546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:17.224546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:17.224546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:17.224546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:17.225759 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:17.225759 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:17.225759 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:17.225759 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:17.225759 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:05:17.225759 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:05:17.225759 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:05:17.225759 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:05:17.225759 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:05:17.225759 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:05:17.225759 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:05:17.225759 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:17.225759 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 358/724] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 19:05:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:17.230858 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472aea4-bbbc-4c25-99ad-b8421b04054c None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:17.249598 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:17.336610 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472aea4-bbbc-4c25-99ad-b8421b04054c None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:17.373004 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d87e91-5a1c-4904-bb7c-3ecea7441ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:17.373688 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d87e91-5a1c-4904-bb7c-3ecea7441ec1 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:17.373969 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d87e91-5a1c-4904-bb7c-3ecea7441ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:17.374239 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d87e91-5a1c-4904-bb7c-3ecea7441ec1 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:17.374991 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d87e91-5a1c-4904-bb7c-3ecea7441ec1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:17.375295 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d87e91-5a1c-4904-bb7c-3ecea7441ec1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:17.377237 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d87e91-5a1c-4904-bb7c-3ecea7441ec1 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:17.387094 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 367/725] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:05:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:17.392896 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb23e17-a85f-46f2-b35b-f6232309a780 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:17.462317 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d87e91-5a1c-4904-bb7c-3ecea7441ec1 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:17.538423 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb23e17-a85f-46f2-b35b-f6232309a780 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:17.558849 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:17.585035 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d87e91-5a1c-4904-bb7c-3ecea7441ec1 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:17.623804 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba0a20b-6675-4c4a-8526-dac1ee2c445d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:17.624157 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d462b-810e-4e8b-b87b-e28f0cf017c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:17.624434 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0a20b-6675-4c4a-8526-dac1ee2c445d None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:17.624690 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0a20b-6675-4c4a-8526-dac1ee2c445d None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:17.624794 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d462b-810e-4e8b-b87b-e28f0cf017c3 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:17.625004 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0a20b-6675-4c4a-8526-dac1ee2c445d None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:17.625115 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d462b-810e-4e8b-b87b-e28f0cf017c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:17.625293 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d462b-810e-4e8b-b87b-e28f0cf017c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:17.625674 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba0a20b-6675-4c4a-8526-dac1ee2c445d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:17.627590 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba0a20b-6675-4c4a-8526-dac1ee2c445d None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:17.640759 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:17.644381 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d462b-810e-4e8b-b87b-e28f0cf017c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:17.646227 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d462b-810e-4e8b-b87b-e28f0cf017c3 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:17.652590 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 368/726] 10.222.0.79 () {60 vars in 1141 bytes} [Wed Aug 31 19:05:17 2022] POST /identity/v3/services => generated 251 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:05:17.680276 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-5b9d462b-810e-4e8b-b87b-e28f0cf017c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:17.680276 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:17.680276 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:17.680276 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:17.680276 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:17.680276 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:17.680276 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:17.680276 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:17.680276 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:17.680276 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:17.680276 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:17.680276 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:17.680276 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:17.680276 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:17.680276 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:17.680276 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:17.681452 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:17.681452 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:17.681452 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:17.681452 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:17.681452 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:17.681452 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:17.681452 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:17.681452 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:17.681452 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:17.681452 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:17.681452 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:17.681452 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:17.681452 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:17.681452 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:17.681452 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:17.681452 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:17.681452 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:17.682545 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:17.682545 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:17.682545 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:17.682545 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 359/727] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:17.689654 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba0a20b-6675-4c4a-8526-dac1ee2c445d None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:17.847220 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba0a20b-6675-4c4a-8526-dac1ee2c445d None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:17.885503 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64cb547-ae28-42fe-8c18-afaa72f15ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:17.886446 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64cb547-ae28-42fe-8c18-afaa72f15ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:17.886926 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64cb547-ae28-42fe-8c18-afaa72f15ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:17.887344 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64cb547-ae28-42fe-8c18-afaa72f15ee2 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:17.888145 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64cb547-ae28-42fe-8c18-afaa72f15ee2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:17.888592 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64cb547-ae28-42fe-8c18-afaa72f15ee2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:17.890184 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64cb547-ae28-42fe-8c18-afaa72f15ee2 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:17.892197 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:17.907837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 369/728] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:17.913547 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d462b-810e-4e8b-b87b-e28f0cf017c3 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:18.029102 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d462b-810e-4e8b-b87b-e28f0cf017c3 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:18.069090 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c989e9-671b-4470-8497-24a89deba0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:18.070000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c989e9-671b-4470-8497-24a89deba0ab None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:18.070443 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c989e9-671b-4470-8497-24a89deba0ab None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:18.070971 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c989e9-671b-4470-8497-24a89deba0ab None admin] PATH_INFO: `/v3/users/swift` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:18.072536 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b44ed-45c2-47e6-8183-fcfef9e70f33 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:18.073354 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b44ed-45c2-47e6-8183-fcfef9e70f33 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:18.073852 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b44ed-45c2-47e6-8183-fcfef9e70f33 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:18.076737 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 370/729] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:05:18.085969 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c989e9-671b-4470-8497-24a89deba0ab None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:18.087194 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a87658-d19b-4c07-9429-739d682c8552 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:18.087466 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c989e9-671b-4470-8497-24a89deba0ab None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:18.087906 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a87658-d19b-4c07-9429-739d682c8552 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:18.088453 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a87658-d19b-4c07-9429-739d682c8552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:18.107724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-90c989e9-671b-4470-8497-24a89deba0ab None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 19:05:18.107724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:18.107724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:18.107724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:18.107724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:18.107724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:18.107724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:18.107724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:18.107724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:18.107724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:18.107724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:18.107724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:18.107724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:05:18.107724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:05:18.107724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:05:18.107724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:05:18.108725 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:18.108725 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:18.108725 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:05:18.108725 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:18.108725 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:05:18.108725 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:18.108725 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:18.108725 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:18.108725 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:18.108725 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:18.108725 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:18.108725 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:18.108725 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:18.108725 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:18.108725 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:18.108725 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:18.108725 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:18.108725 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:18.109659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:18.109659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:18.109659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:05:18.109659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:05:18.109659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:05:18.109659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:05:18.109659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:05:18.109659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:05:18.109659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 19:05:18.109659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:18.109659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 360/730] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 19:05:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:18.114657 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c989e9-671b-4470-8497-24a89deba0ab None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:18.123010 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-a9a87658-d19b-4c07-9429-739d682c8552 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:18.124521 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a9a87658-d19b-4c07-9429-739d682c8552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:18.226101 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:18.262599 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 371/731] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:18 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 31 19:05:18.310893 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c989e9-671b-4470-8497-24a89deba0ab None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:18.354375 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8889c-8678-4daf-8702-9321e044deb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:18.355394 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8889c-8678-4daf-8702-9321e044deb8 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:18.355952 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8889c-8678-4daf-8702-9321e044deb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:18.356412 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8889c-8678-4daf-8702-9321e044deb8 None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:18.357323 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd8889c-8678-4daf-8702-9321e044deb8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:18.357857 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd8889c-8678-4daf-8702-9321e044deb8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:18.359531 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd8889c-8678-4daf-8702-9321e044deb8 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:18.379049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 361/732] 10.222.0.79 () {56 vars in 1135 bytes} [Wed Aug 31 19:05:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:18.384194 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a87658-d19b-4c07-9429-739d682c8552 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:18.493909 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a87658-d19b-4c07-9429-739d682c8552 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:18.528880 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:18.543172 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362c764-8b53-40a9-a030-6d81814235cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:18.543999 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362c764-8b53-40a9-a030-6d81814235cf None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:18.544452 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362c764-8b53-40a9-a030-6d81814235cf None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:18.544900 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362c764-8b53-40a9-a030-6d81814235cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:18.615465 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdcf7e-be40-4afa-bb13-d67807bfebf9 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:18.616022 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdcf7e-be40-4afa-bb13-d67807bfebf9 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:18.616473 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdcf7e-be40-4afa-bb13-d67807bfebf9 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:18.618003 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 362/733] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:05:18.623274 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771eae5-7610-410d-8317-98b1b599a645 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:18.623550 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771eae5-7610-410d-8317-98b1b599a645 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:18.623837 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771eae5-7610-410d-8317-98b1b599a645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:18.638190 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9362c764-8b53-40a9-a030-6d81814235cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:18.643047 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9362c764-8b53-40a9-a030-6d81814235cf None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:18.662549 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-6771eae5-7610-410d-8317-98b1b599a645 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:18.663737 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-6771eae5-7610-410d-8317-98b1b599a645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:18.774824 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 363/734] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:18 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 19:05:18.775653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771eae5-7610-410d-8317-98b1b599a645 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:18.792328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 372/735] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:05:18 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 19:05:18.799926 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362c764-8b53-40a9-a030-6d81814235cf None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:18.826953 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:18.879033 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:18.904669 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362c764-8b53-40a9-a030-6d81814235cf None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:18.940255 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8214a3f-d85d-4987-905b-3b6138bf3542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:18.941123 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8214a3f-d85d-4987-905b-3b6138bf3542 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:18.941545 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8214a3f-d85d-4987-905b-3b6138bf3542 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:18.941985 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8214a3f-d85d-4987-905b-3b6138bf3542 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:18.952330 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8214a3f-d85d-4987-905b-3b6138bf3542 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:18.953968 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8214a3f-d85d-4987-905b-3b6138bf3542 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:18.976693 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-b8214a3f-d85d-4987-905b-3b6138bf3542 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:18.976693 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:18.976693 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:18.976693 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:18.976693 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:18.976693 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:18.976693 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:18.976693 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:18.976693 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:18.976693 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:18.976693 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:18.976693 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:18.976693 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:18.976693 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:18.976693 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:18.976693 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:18.977861 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:18.977861 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:18.977861 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:18.977861 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:18.977861 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:18.977861 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:18.977861 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:18.977861 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:18.977861 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:18.977861 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:18.977861 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:18.977861 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:18.977861 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:18.977861 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:18.977861 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:18.977861 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:18.977861 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:18.978941 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:18.978941 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:18.978941 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:18.987779 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 373/736] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:05:18.992537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8214a3f-d85d-4987-905b-3b6138bf3542 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:19.029206 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771eae5-7610-410d-8317-98b1b599a645 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:19.073308 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c514ce-e799-4dff-86e7-bb3280796746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:19.074213 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c514ce-e799-4dff-86e7-bb3280796746 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:19.074663 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c514ce-e799-4dff-86e7-bb3280796746 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:19.075108 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c514ce-e799-4dff-86e7-bb3280796746 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:19.087194 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c514ce-e799-4dff-86e7-bb3280796746 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:05:19.093118 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-e4c514ce-e799-4dff-86e7-bb3280796746 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:05:19.093118 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:19.093118 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:19.093118 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:19.093118 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:19.093118 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:19.093118 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:19.093118 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:19.093118 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:19.093118 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:19.093118 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:19.093118 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:19.093118 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:05:19.093118 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:05:19.093118 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:05:19.093118 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:05:19.094238 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:05:19.094238 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:05:19.094238 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:05:19.094238 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:05:19.094238 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:19.094238 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:19.094238 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:19.094238 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:19.094238 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:19.094238 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:19.094238 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:19.094238 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:19.094238 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:19.094238 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:19.094238 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:19.094238 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:19.095871 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:19.095871 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:19.095871 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:19.095871 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:19.095871 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:05:19.095871 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:05:19.095871 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:05:19.095871 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:05:19.095871 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:05:19.095871 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:05:19.095871 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:05:19.095871 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:19.098676 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 364/737] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 19:05:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:19.104478 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c514ce-e799-4dff-86e7-bb3280796746 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:19.143690 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:19.180028 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8214a3f-d85d-4987-905b-3b6138bf3542 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:19.224903 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12befec-b4ad-434d-842a-8ec17ba56e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:19.226496 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12befec-b4ad-434d-842a-8ec17ba56e35 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:19.226919 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12befec-b4ad-434d-842a-8ec17ba56e35 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:19.227331 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12befec-b4ad-434d-842a-8ec17ba56e35 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:19.228112 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12befec-b4ad-434d-842a-8ec17ba56e35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:19.228554 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12befec-b4ad-434d-842a-8ec17ba56e35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:19.230770 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12befec-b4ad-434d-842a-8ec17ba56e35 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:19.243409 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:19.247216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c514ce-e799-4dff-86e7-bb3280796746 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:19.249625 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 374/738] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:05:19.251513 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12befec-b4ad-434d-842a-8ec17ba56e35 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:19.290437 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5600b-bf16-4fe7-8e21-6701fec7fcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:19.291072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5600b-bf16-4fe7-8e21-6701fec7fcd8 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:19.291352 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5600b-bf16-4fe7-8e21-6701fec7fcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:19.291626 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5600b-bf16-4fe7-8e21-6701fec7fcd8 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:19.292295 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb5600b-bf16-4fe7-8e21-6701fec7fcd8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:19.292599 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb5600b-bf16-4fe7-8e21-6701fec7fcd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:19.293955 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb5600b-bf16-4fe7-8e21-6701fec7fcd8 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:19.302819 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 365/739] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:05:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:19.304051 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a2e25-289f-4102-90ab-9262c16d3392 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:19.304339 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a2e25-289f-4102-90ab-9262c16d3392 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:19.304613 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a2e25-289f-4102-90ab-9262c16d3392 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:19.305978 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 366/740] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:05:19.307225 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a2e25-289f-4102-90ab-9262c16d3392 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:19.359419 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12befec-b4ad-434d-842a-8ec17ba56e35 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:19.396023 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28b172-4fc1-4ee1-93c4-28e41579bbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:19.396023 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28b172-4fc1-4ee1-93c4-28e41579bbde None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:19.396311 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28b172-4fc1-4ee1-93c4-28e41579bbde None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:19.396401 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28b172-4fc1-4ee1-93c4-28e41579bbde None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:19.397043 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28b172-4fc1-4ee1-93c4-28e41579bbde None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:19.398419 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28b172-4fc1-4ee1-93c4-28e41579bbde None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:19.402703 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:19.417595 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 375/741] 10.222.0.79 () {60 vars in 1141 bytes} [Wed Aug 31 19:05:19 2022] POST /identity/v3/services => generated 240 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:05:19.418210 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28b172-4fc1-4ee1-93c4-28e41579bbde None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:19.447917 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a2e25-289f-4102-90ab-9262c16d3392 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:19.503089 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f024a59-5964-419b-a661-10da0a058359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:19.504387 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f024a59-5964-419b-a661-10da0a058359 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:19.505937 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f024a59-5964-419b-a661-10da0a058359 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:19.506450 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f024a59-5964-419b-a661-10da0a058359 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:19.516321 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f024a59-5964-419b-a661-10da0a058359 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:19.518978 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f024a59-5964-419b-a661-10da0a058359 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:19.534593 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-1f024a59-5964-419b-a661-10da0a058359 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:19.534593 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:19.534593 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:19.534593 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:19.534593 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:19.534593 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:19.534593 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:19.534593 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:19.534593 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:19.534593 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:19.534593 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:19.534593 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:19.534593 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:05:19.534593 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:05:19.534593 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:05:19.535545 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:05:19.535545 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:19.535545 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:19.535545 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:19.535545 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:19.535545 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:19.535545 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:19.535545 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:19.535545 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:19.535545 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:19.535545 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:19.535545 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:19.535545 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:19.535545 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:19.535545 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:19.535545 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:19.535545 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:19.536423 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:05:19.536423 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:05:19.536423 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:05:19.536423 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:05:19.536423 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:05:19.536423 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:05:19.536423 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:19.536423 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:19.542907 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 367/742] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:05:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:19.544527 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02410d-1c00-48c7-83f0-e4af4e7fbe21 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:19.545082 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02410d-1c00-48c7-83f0-e4af4e7fbe21 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:19.545355 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02410d-1c00-48c7-83f0-e4af4e7fbe21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:19.561833 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28b172-4fc1-4ee1-93c4-28e41579bbde None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:19.565105 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-7e02410d-1c00-48c7-83f0-e4af4e7fbe21 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:19.566369 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-7e02410d-1c00-48c7-83f0-e4af4e7fbe21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:19.583105 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:19.613005 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce29df3-dd31-4874-964f-f0117a95a5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:19.613645 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce29df3-dd31-4874-964f-f0117a95a5bd None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:19.613921 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce29df3-dd31-4874-964f-f0117a95a5bd None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:19.614190 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce29df3-dd31-4874-964f-f0117a95a5bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:19.628680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce29df3-dd31-4874-964f-f0117a95a5bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:19.630614 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce29df3-dd31-4874-964f-f0117a95a5bd None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:19.645649 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-dce29df3-dd31-4874-964f-f0117a95a5bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:19.645649 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:19.645649 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:19.645649 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:19.645649 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:19.645649 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:19.645649 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:19.645649 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:19.645649 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:19.645649 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:19.645649 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:19.645649 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:19.645649 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:19.645649 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:19.645649 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:19.645649 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:19.646989 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:19.646989 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:19.646989 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:19.646989 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:19.646989 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:19.646989 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:19.646989 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:19.646989 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:19.646989 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:19.646989 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:19.646989 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:19.646989 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:19.646989 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:19.646989 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:19.646989 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:19.646989 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:19.646989 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:19.648123 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:19.648123 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:19.648123 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:19.649041 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 376/743] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:19.650004 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce29df3-dd31-4874-964f-f0117a95a5bd None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:19.670641 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 368/744] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:05:19.671815 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e02410d-1c00-48c7-83f0-e4af4e7fbe21 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:19.711585 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:19.772575 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce29df3-dd31-4874-964f-f0117a95a5bd None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:19.811825 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75957d2-c28d-4f3e-8b5c-da5e26ada4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:19.812703 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75957d2-c28d-4f3e-8b5c-da5e26ada4f0 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:19.813122 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75957d2-c28d-4f3e-8b5c-da5e26ada4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:19.814330 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75957d2-c28d-4f3e-8b5c-da5e26ada4f0 None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:19.815766 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75957d2-c28d-4f3e-8b5c-da5e26ada4f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:19.816217 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75957d2-c28d-4f3e-8b5c-da5e26ada4f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:19.818082 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75957d2-c28d-4f3e-8b5c-da5e26ada4f0 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:19.832187 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 377/745] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 19:05:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:19.840856 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75957d2-c28d-4f3e-8b5c-da5e26ada4f0 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:19.888074 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e02410d-1c00-48c7-83f0-e4af4e7fbe21 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:19.941938 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d17daa-c221-4bad-8e21-d31d8f4f444f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:19.942490 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d17daa-c221-4bad-8e21-d31d8f4f444f None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:19.942780 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d17daa-c221-4bad-8e21-d31d8f4f444f None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:19.943050 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d17daa-c221-4bad-8e21-d31d8f4f444f None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:19.944006 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d17daa-c221-4bad-8e21-d31d8f4f444f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:19.944309 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d17daa-c221-4bad-8e21-d31d8f4f444f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:19.945685 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d17daa-c221-4bad-8e21-d31d8f4f444f None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:19.959158 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 369/746] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:19.967460 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d17daa-c221-4bad-8e21-d31d8f4f444f None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:19.988996 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:20.034304 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75957d2-c28d-4f3e-8b5c-da5e26ada4f0 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:20.044590 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:20.073328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4cbb06-fa8d-467c-8e7f-a6fe11697239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:20.073935 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cbb06-fa8d-467c-8e7f-a6fe11697239 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:20.074217 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cbb06-fa8d-467c-8e7f-a6fe11697239 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:20.074544 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cbb06-fa8d-467c-8e7f-a6fe11697239 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:20.075279 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4cbb06-fa8d-467c-8e7f-a6fe11697239 None admin] RBAC: Adding query filter params (role.id=edc551338adb4ae88bdafc591ad69582, scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507, user.id=3b289a0bef53460ca5173ad946394d72) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:20.075586 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4cbb06-fa8d-467c-8e7f-a6fe11697239 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:20.077012 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4cbb06-fa8d-467c-8e7f-a6fe11697239 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:20.084059 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 378/747] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:05:19 2022] GET /identity/v3/role_assignments?user.id=3b289a0bef53460ca5173ad946394d72&scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507&role.id=edc551338adb4ae88bdafc591ad69582 => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:20.084293 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f11f5-88b2-497e-835e-7255dd680df8 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:20.084535 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f11f5-88b2-497e-835e-7255dd680df8 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:20.084819 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f11f5-88b2-497e-835e-7255dd680df8 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:20.090329 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 379/748] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:05:20.091284 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f11f5-88b2-497e-835e-7255dd680df8 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:20.115002 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d17daa-c221-4bad-8e21-d31d8f4f444f None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:20.162756 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cef0d2-2888-4940-ab01-e191db197c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:20.163680 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cef0d2-2888-4940-ab01-e191db197c5c None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:20.164136 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cef0d2-2888-4940-ab01-e191db197c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:20.164568 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cef0d2-2888-4940-ab01-e191db197c5c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:20.173966 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cef0d2-2888-4940-ab01-e191db197c5c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:20.175752 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cef0d2-2888-4940-ab01-e191db197c5c None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:20.188664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-f3cef0d2-2888-4940-ab01-e191db197c5c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:05:20.188664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:20.188664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:20.188664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:20.188664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:20.188664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:20.188664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:20.188664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:20.188664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:20.188664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:20.188664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:20.188664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:20.188664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:05:20.188664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:05:20.188664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:05:20.188664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:05:20.189825 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:20.189825 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:20.189825 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:05:20.189825 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:20.189825 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:05:20.189825 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:20.189825 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:20.189825 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:20.189825 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:20.189825 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:20.189825 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:20.189825 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:20.189825 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:20.189825 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:20.189825 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:20.189825 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:20.189825 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:20.189825 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:20.190818 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:20.190818 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:20.190818 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:05:20.190818 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:05:20.190818 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:05:20.190818 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:05:20.190818 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:05:20.190818 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:05:20.190818 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:05:20.190818 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:20.193169 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 370/749] 10.222.0.79 () {56 vars in 1093 bytes} [Wed Aug 31 19:05:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:20.194611 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d27ca8-3cfb-4877-aaba-f4eb5574a99a None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:20.195066 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d27ca8-3cfb-4877-aaba-f4eb5574a99a None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:20.195481 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d27ca8-3cfb-4877-aaba-f4eb5574a99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:20.215550 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-70d27ca8-3cfb-4877-aaba-f4eb5574a99a None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:20.217050 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-70d27ca8-3cfb-4877-aaba-f4eb5574a99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:20.232283 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f11f5-88b2-497e-835e-7255dd680df8 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:20.280614 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc4319-6a5e-4471-a49f-9f8e4489cbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:20.281379 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc4319-6a5e-4471-a49f-9f8e4489cbcc None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:20.281943 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc4319-6a5e-4471-a49f-9f8e4489cbcc None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:20.282288 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc4319-6a5e-4471-a49f-9f8e4489cbcc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:20.293603 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:20.300612 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc4319-6a5e-4471-a49f-9f8e4489cbcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:05:20.308936 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 371/750] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:05:20.308936 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d27ca8-3cfb-4877-aaba-f4eb5574a99a None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:20.312442 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-b2cc4319-6a5e-4471-a49f-9f8e4489cbcc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:05:20.312442 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:20.312442 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:20.312442 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:20.312442 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:20.312442 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:20.312442 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:20.312442 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:20.312442 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:20.312442 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:20.312442 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:20.312442 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:20.312442 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:05:20.312442 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:05:20.312442 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:05:20.312442 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:05:20.313659 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:05:20.313659 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:05:20.313659 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:05:20.313659 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:05:20.313659 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:20.313659 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:20.313659 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:20.313659 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:20.313659 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:20.313659 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:20.313659 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:20.313659 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:20.313659 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:20.313659 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:20.313659 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:20.313659 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:20.314604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:20.314604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:20.314604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:20.314604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:20.314604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:05:20.314604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:05:20.314604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:05:20.314604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:05:20.314604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:05:20.314604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:05:20.314604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:05:20.314604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:20.316791 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 380/751] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 19:05:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:20.322676 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc4319-6a5e-4471-a49f-9f8e4489cbcc None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:20.392618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:20.482012 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc4319-6a5e-4471-a49f-9f8e4489cbcc None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:20.526187 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8213f2-94bc-4dcb-b482-11e21778eb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:20.526878 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8213f2-94bc-4dcb-b482-11e21778eb43 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:20.527166 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8213f2-94bc-4dcb-b482-11e21778eb43 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:20.527434 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8213f2-94bc-4dcb-b482-11e21778eb43 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:20.528106 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8213f2-94bc-4dcb-b482-11e21778eb43 None admin] RBAC: Adding query filter params (name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:20.528405 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8213f2-94bc-4dcb-b482-11e21778eb43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:20.529835 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8213f2-94bc-4dcb-b482-11e21778eb43 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:20.539725 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 381/752] 10.222.0.79 () {56 vars in 1103 bytes} [Wed Aug 31 19:05:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:20.551017 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8213f2-94bc-4dcb-b482-11e21778eb43 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:20.553310 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d27ca8-3cfb-4877-aaba-f4eb5574a99a None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:20.621207 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e5dcd-88ca-4eb6-bac5-64056cbfa14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:20.621951 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e5dcd-88ca-4eb6-bac5-64056cbfa14e None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:20.622228 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e5dcd-88ca-4eb6-bac5-64056cbfa14e None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:20.622581 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e5dcd-88ca-4eb6-bac5-64056cbfa14e None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:20.623337 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e5dcd-88ca-4eb6-bac5-64056cbfa14e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:20.623770 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e5dcd-88ca-4eb6-bac5-64056cbfa14e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:20.625922 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e5dcd-88ca-4eb6-bac5-64056cbfa14e None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:20.663229 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 372/753] 10.222.0.79 () {56 vars in 1133 bytes} [Wed Aug 31 19:05:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:20.667576 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e5dcd-88ca-4eb6-bac5-64056cbfa14e None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:20.690217 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:20.697165 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8213f2-94bc-4dcb-b482-11e21778eb43 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:20.732993 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923479be-b0d6-4d32-bd6c-e469143579ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:20.733598 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923479be-b0d6-4d32-bd6c-e469143579ec None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:20.733879 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923479be-b0d6-4d32-bd6c-e469143579ec None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:20.734164 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923479be-b0d6-4d32-bd6c-e469143579ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:20.734447 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:20.760156 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923479be-b0d6-4d32-bd6c-e469143579ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:20.763162 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923479be-b0d6-4d32-bd6c-e469143579ec None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:20.788680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-923479be-b0d6-4d32-bd6c-e469143579ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:20.788680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:20.788680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:20.788680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:20.788680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:20.788680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:20.788680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:20.788680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:20.788680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:20.788680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:20.788680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:20.788680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:20.788680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:20.788680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:20.788680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:20.788680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:20.790328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:20.790328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:20.790328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:20.790328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:20.790328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:20.790328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:20.790328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:20.790328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:20.790328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:20.790328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:20.790328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:20.790328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:20.790328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:20.790328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:20.790328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:20.790328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:20.790328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:20.791432 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:20.791432 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:20.791432 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:20.794551 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 382/754] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:20.796825 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923479be-b0d6-4d32-bd6c-e469143579ec None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:20.799731 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e5dcd-88ca-4eb6-bac5-64056cbfa14e None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:20.849604 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16359728-55d9-4c16-8210-ee8adce2da1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:20.850337 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16359728-55d9-4c16-8210-ee8adce2da1e None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:20.850715 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16359728-55d9-4c16-8210-ee8adce2da1e None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:20.851064 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16359728-55d9-4c16-8210-ee8adce2da1e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:20.852011 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16359728-55d9-4c16-8210-ee8adce2da1e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:20.853839 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16359728-55d9-4c16-8210-ee8adce2da1e None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:20.865066 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-16359728-55d9-4c16-8210-ee8adce2da1e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 19:05:20.865066 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:20.865066 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:05:20.865066 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:05:20.865066 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:05:20.865066 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:05:20.865066 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:05:20.865066 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:05:20.865066 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 19:05:20.865066 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:20.865066 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:05:20.865066 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:20.865066 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:20.865066 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:20.865066 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:20.865066 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:20.865066 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:20.866127 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:20.866127 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:20.866127 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:20.866127 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:20.866127 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:20.866127 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:20.866127 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:05:20.866127 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:05:20.866127 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:05:20.866127 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:05:20.866127 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:20.866127 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:20.866127 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:20.866127 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:20.866127 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:20.866127 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:20.872519 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:20.872519 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:20.872519 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:20.872519 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:20.872519 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:20.872519 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:20.872519 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:20.872519 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:20.872519 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:20.872519 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:20.872519 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:05:20.872519 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:05:20.872519 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 19:05:20.872519 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:20.872519 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 373/755] 10.222.0.79 () {56 vars in 1129 bytes} [Wed Aug 31 19:05:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:20.873337 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16359728-55d9-4c16-8210-ee8adce2da1e None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:20.942038 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923479be-b0d6-4d32-bd6c-e469143579ec None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:21.003085 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59dd82-000e-422d-b998-deadf6622df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:21.003640 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59dd82-000e-422d-b998-deadf6622df1 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:21.003917 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59dd82-000e-422d-b998-deadf6622df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:21.004188 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59dd82-000e-422d-b998-deadf6622df1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:21.011998 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16359728-55d9-4c16-8210-ee8adce2da1e None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:21.017044 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a59dd82-000e-422d-b998-deadf6622df1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:21.018551 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a59dd82-000e-422d-b998-deadf6622df1 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:21.025588 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:21.035016 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-8a59dd82-000e-422d-b998-deadf6622df1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:21.035016 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:21.035016 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:21.035016 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:21.035016 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:21.035016 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:21.035016 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:21.035016 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:21.035016 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:21.035016 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:21.035016 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:21.035016 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:21.035016 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:21.035016 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:21.035016 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:21.035016 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:21.036008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:21.036008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:21.036008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:21.036008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:21.036008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:21.036008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:21.036008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:21.036008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:21.036008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:21.036008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:21.036008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:21.036008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:21.036008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:21.036008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:21.036008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:21.036008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:21.036008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:21.036966 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:21.036966 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:21.036966 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:21.039210 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 383/756] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:21.040144 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59dd82-000e-422d-b998-deadf6622df1 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:21.043711 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:21.061694 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f343a-6dd3-408c-ae02-40f626795ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:21.062738 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f343a-6dd3-408c-ae02-40f626795ba9 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:21.063213 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f343a-6dd3-408c-ae02-40f626795ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:21.063719 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f343a-6dd3-408c-ae02-40f626795ba9 None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:21.064688 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727f343a-6dd3-408c-ae02-40f626795ba9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:21.065209 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727f343a-6dd3-408c-ae02-40f626795ba9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:21.066814 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727f343a-6dd3-408c-ae02-40f626795ba9 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:21.082337 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 374/757] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:21.083571 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f343a-6dd3-408c-ae02-40f626795ba9 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:21.154963 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59dd82-000e-422d-b998-deadf6622df1 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:21.192085 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394effd7-2736-43e9-adf4-f12e19f64e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:21.192553 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394effd7-2736-43e9-adf4-f12e19f64e1c None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:21.192882 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394effd7-2736-43e9-adf4-f12e19f64e1c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:21.193159 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394effd7-2736-43e9-adf4-f12e19f64e1c None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:21.193811 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394effd7-2736-43e9-adf4-f12e19f64e1c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:21.194094 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394effd7-2736-43e9-adf4-f12e19f64e1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:21.195518 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394effd7-2736-43e9-adf4-f12e19f64e1c None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:21.199926 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f343a-6dd3-408c-ae02-40f626795ba9 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:21.205816 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 384/758] 10.222.0.79 () {56 vars in 1124 bytes} [Wed Aug 31 19:05:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:21.205816 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394effd7-2736-43e9-adf4-f12e19f64e1c None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:21.264353 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c56a05-e812-492d-aa28-f8c37ea46ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:21.264890 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c56a05-e812-492d-aa28-f8c37ea46ed8 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:21.265261 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c56a05-e812-492d-aa28-f8c37ea46ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:21.265537 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c56a05-e812-492d-aa28-f8c37ea46ed8 None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:21.266199 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c56a05-e812-492d-aa28-f8c37ea46ed8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:21.267089 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c56a05-e812-492d-aa28-f8c37ea46ed8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:21.268531 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c56a05-e812-492d-aa28-f8c37ea46ed8 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:21.284829 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 375/759] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:21.285758 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c56a05-e812-492d-aa28-f8c37ea46ed8 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:21.299095 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:21.342123 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:21.364032 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394effd7-2736-43e9-adf4-f12e19f64e1c None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:21.412975 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199219d-30e9-4138-879a-e57441214d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:21.413184 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c56a05-e812-492d-aa28-f8c37ea46ed8 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:21.414129 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199219d-30e9-4138-879a-e57441214d04 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:21.414879 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199219d-30e9-4138-879a-e57441214d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:21.415391 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199219d-30e9-4138-879a-e57441214d04 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:21.427907 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199219d-30e9-4138-879a-e57441214d04 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:21.430523 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199219d-30e9-4138-879a-e57441214d04 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:21.447093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-b199219d-30e9-4138-879a-e57441214d04 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 19:05:21.447093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:21.447093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:21.447093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:21.447093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:21.447093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:21.447093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:21.447093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:21.447093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:21.447093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:21.447093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:21.447093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:21.447093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:05:21.447093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:05:21.447093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:05:21.447093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:05:21.448093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:21.448093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:21.448093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:05:21.448093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:21.448093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:05:21.448093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:21.448093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:21.448093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:21.448093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:21.448093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:21.448093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:21.448093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:21.448093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:21.448093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:21.448093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:21.448093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:21.448093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:21.448093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:21.449022 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:21.449022 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:21.449022 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:05:21.449022 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:05:21.449022 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:05:21.449022 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:05:21.449022 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:05:21.449022 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:05:21.449022 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 19:05:21.449022 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:21.451163 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 385/760] 10.222.0.79 () {56 vars in 1117 bytes} [Wed Aug 31 19:05:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:21.452262 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199219d-30e9-4138-879a-e57441214d04 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:21.462209 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a073345-2b01-4369-b011-095a4d913be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:21.463210 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a073345-2b01-4369-b011-095a4d913be2 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:21.463567 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a073345-2b01-4369-b011-095a4d913be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:21.464344 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a073345-2b01-4369-b011-095a4d913be2 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:21.464582 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a073345-2b01-4369-b011-095a4d913be2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:21.464889 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a073345-2b01-4369-b011-095a4d913be2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:21.466345 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a073345-2b01-4369-b011-095a4d913be2 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:21.477820 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 376/761] 10.222.0.79 () {56 vars in 1124 bytes} [Wed Aug 31 19:05:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:21.477820 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a073345-2b01-4369-b011-095a4d913be2 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:21.577499 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199219d-30e9-4138-879a-e57441214d04 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:21.593974 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a073345-2b01-4369-b011-095a4d913be2 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:21.597621 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:21.602050 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:21.617034 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21588215-4c15-47f7-bb96-efe2431813f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:21.617666 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21588215-4c15-47f7-bb96-efe2431813f2 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:21.617944 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21588215-4c15-47f7-bb96-efe2431813f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:21.618214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21588215-4c15-47f7-bb96-efe2431813f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:21.625483 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21588215-4c15-47f7-bb96-efe2431813f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:21.627030 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21588215-4c15-47f7-bb96-efe2431813f2 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:21.634195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b6497-3e00-4550-8d43-18f4ca74ca12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:21.635277 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b6497-3e00-4550-8d43-18f4ca74ca12 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:21.635765 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b6497-3e00-4550-8d43-18f4ca74ca12 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:21.636195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b6497-3e00-4550-8d43-18f4ca74ca12 None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:21.637284 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015b6497-3e00-4550-8d43-18f4ca74ca12 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:21.637591 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015b6497-3e00-4550-8d43-18f4ca74ca12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:21.638369 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-21588215-4c15-47f7-bb96-efe2431813f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:21.638369 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:21.638369 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:21.638369 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:21.638369 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:21.638369 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:21.638369 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:21.638369 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:21.638369 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:21.638369 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:21.638369 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:21.638369 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:21.638369 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:05:21.638369 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:05:21.638369 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:05:21.639328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:05:21.639328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:21.639328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:21.639328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:21.639328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:21.639328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:21.639328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:21.639328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:21.639328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:21.639328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:21.639328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:21.639328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:21.639328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:21.639328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:21.639328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:21.639328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:21.639328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:21.640203 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:05:21.640203 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:05:21.640203 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:05:21.640203 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:05:21.640203 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:05:21.640203 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:05:21.640203 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:21.640203 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:21.641439 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015b6497-3e00-4550-8d43-18f4ca74ca12 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:21.644259 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 386/762] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:05:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:21.644995 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21588215-4c15-47f7-bb96-efe2431813f2 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:21.658140 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 377/763] 10.222.0.79 () {56 vars in 1149 bytes} [Wed Aug 31 19:05:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:21.659200 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc92928-8c8b-4cbd-81db-15e196f3fde6 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:21.659482 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc92928-8c8b-4cbd-81db-15e196f3fde6 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:21.659750 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc92928-8c8b-4cbd-81db-15e196f3fde6 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:21.665709 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 378/764] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:05:21.665709 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc92928-8c8b-4cbd-81db-15e196f3fde6 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:21.759859 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21588215-4c15-47f7-bb96-efe2431813f2 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:21.779884 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc92928-8c8b-4cbd-81db-15e196f3fde6 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:21.797613 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987cff5-cbd6-4f62-87ba-0049b5064fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:21.798481 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987cff5-cbd6-4f62-87ba-0049b5064fd2 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:21.798790 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987cff5-cbd6-4f62-87ba-0049b5064fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:21.799066 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987cff5-cbd6-4f62-87ba-0049b5064fd2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:21.800044 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987cff5-cbd6-4f62-87ba-0049b5064fd2 None admin] RBAC: Adding query filter params (interface=public, service_id=e57cf342b3ca46d78e591549895920a5, region_id=RegionOne) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:21.800354 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987cff5-cbd6-4f62-87ba-0049b5064fd2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:21.802128 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987cff5-cbd6-4f62-87ba-0049b5064fd2 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:21.817368 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 387/765] 10.222.0.79 () {56 vars in 1251 bytes} [Wed Aug 31 19:05:21 2022] GET /identity/v3/endpoints?service_id=e57cf342b3ca46d78e591549895920a5&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:21.817368 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987cff5-cbd6-4f62-87ba-0049b5064fd2 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:21.821082 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07825572-d7da-4367-8e7b-47e6e01d3db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:21.821709 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07825572-d7da-4367-8e7b-47e6e01d3db6 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:21.821993 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07825572-d7da-4367-8e7b-47e6e01d3db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:21.822267 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07825572-d7da-4367-8e7b-47e6e01d3db6 None admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:21.823007 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07825572-d7da-4367-8e7b-47e6e01d3db6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:21.823315 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07825572-d7da-4367-8e7b-47e6e01d3db6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:21.824852 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07825572-d7da-4367-8e7b-47e6e01d3db6 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:21.838063 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 379/766] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 19:05:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:21.839377 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f583cd6-d21d-46cb-8f1d-f9e6fcb3be9f None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:21.839668 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f583cd6-d21d-46cb-8f1d-f9e6fcb3be9f None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:21.839947 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f583cd6-d21d-46cb-8f1d-f9e6fcb3be9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:21.859790 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-8f583cd6-d21d-46cb-8f1d-f9e6fcb3be9f None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:21.861040 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-8f583cd6-d21d-46cb-8f1d-f9e6fcb3be9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:21.870219 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:21.879232 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:21.931758 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987cff5-cbd6-4f62-87ba-0049b5064fd2 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:21.934495 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 380/767] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:05:21.935332 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f583cd6-d21d-46cb-8f1d-f9e6fcb3be9f None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:21.987210 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da75cb9-a618-43ea-a095-aa7f3a3bb7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:21.988212 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da75cb9-a618-43ea-a095-aa7f3a3bb7c8 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:21.988645 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da75cb9-a618-43ea-a095-aa7f3a3bb7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:21.989310 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da75cb9-a618-43ea-a095-aa7f3a3bb7c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:22.049399 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f583cd6-d21d-46cb-8f1d-f9e6fcb3be9f None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:22.074336 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da75cb9-a618-43ea-a095-aa7f3a3bb7c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:22.076036 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da75cb9-a618-43ea-a095-aa7f3a3bb7c8 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:22.097623 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d775f604-7817-4d12-bb0e-224732741353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:22.098523 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775f604-7817-4d12-bb0e-224732741353 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:22.099511 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775f604-7817-4d12-bb0e-224732741353 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:22.099938 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775f604-7817-4d12-bb0e-224732741353 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:22.101374 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d775f604-7817-4d12-bb0e-224732741353 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:22.103645 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d775f604-7817-4d12-bb0e-224732741353 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:22.111509 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 381/768] 10.222.0.79 () {56 vars in 1087 bytes} [Wed Aug 31 19:05:21 2022] GET /identity/v3/services => generated 772 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:22.112714 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d775f604-7817-4d12-bb0e-224732741353 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:22.128143 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:22.144239 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:22.199597 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 388/769] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:05:21 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:05:22.200939 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da75cb9-a618-43ea-a095-aa7f3a3bb7c8 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:22.261446 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d775f604-7817-4d12-bb0e-224732741353 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:22.300805 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a61b14f-b77a-4f71-befa-064bcecf7e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:22.301519 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61b14f-b77a-4f71-befa-064bcecf7e2f None admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:22.301874 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61b14f-b77a-4f71-befa-064bcecf7e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:22.302155 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61b14f-b77a-4f71-befa-064bcecf7e2f None admin] PATH_INFO: `/v3/projects/f9e550ea75dd4245bd9c2bcd6322c507/users/1fd6d45d1bc3479da72cb1a1990a6137/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:22.306326 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a61b14f-b77a-4f71-befa-064bcecf7e2f None admin] RBAC: Authorizing `identity:create_grant(project_id=f9e550ea75dd4245bd9c2bcd6322c507, user_id=1fd6d45d1bc3479da72cb1a1990a6137, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:22.307819 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a61b14f-b77a-4f71-befa-064bcecf7e2f None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:22.324208 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 382/770] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 19:05:22 2022] PUT /identity/v3/projects/f9e550ea75dd4245bd9c2bcd6322c507/users/1fd6d45d1bc3479da72cb1a1990a6137/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:05:22.325644 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc73e1-2143-4067-89bc-dfbc89313552 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:22.325935 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc73e1-2143-4067-89bc-dfbc89313552 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:22.326215 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc73e1-2143-4067-89bc-dfbc89313552 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:22.327521 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 383/771] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:05:22.328230 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc73e1-2143-4067-89bc-dfbc89313552 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:22.337000 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da75cb9-a618-43ea-a095-aa7f3a3bb7c8 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:22.379634 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f49a3f-f642-493f-b3b0-c7bb8e82df85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:22.380351 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f49a3f-f642-493f-b3b0-c7bb8e82df85 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:22.380636 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f49a3f-f642-493f-b3b0-c7bb8e82df85 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:22.381820 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f49a3f-f642-493f-b3b0-c7bb8e82df85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:22.393772 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f49a3f-f642-493f-b3b0-c7bb8e82df85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:22.395814 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f49a3f-f642-493f-b3b0-c7bb8e82df85 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:22.405007 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:22.416537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-b4f49a3f-f642-493f-b3b0-c7bb8e82df85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:22.416537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:22.416537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:22.416537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:22.416537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:22.416537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:22.416537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:22.416537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:22.416537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:22.416537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:22.416537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:22.416537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:22.416537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:22.416537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:22.416537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:22.416537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:22.417587 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:22.417587 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:22.417587 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:22.417587 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:22.417587 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:22.417587 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:22.417587 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:22.417587 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:22.417587 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:22.417587 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:22.417587 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:22.417587 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:22.417587 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:22.417587 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:22.417587 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:22.417587 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:22.417587 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:22.418527 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:22.418527 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:22.418527 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:22.418527 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 389/772] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:22.420668 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052db1c0-0fb5-4ce0-8df3-7338bc7c494d None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:22.420668 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052db1c0-0fb5-4ce0-8df3-7338bc7c494d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:22.420883 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052db1c0-0fb5-4ce0-8df3-7338bc7c494d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:22.444445 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-052db1c0-0fb5-4ce0-8df3-7338bc7c494d None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:22.445925 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-052db1c0-0fb5-4ce0-8df3-7338bc7c494d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:22.449700 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:22.494044 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc73e1-2143-4067-89bc-dfbc89313552 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:22.546485 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689096d3-3d7d-4c5a-9c39-d99ebb727a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:22.546485 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689096d3-3d7d-4c5a-9c39-d99ebb727a4a None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:22.546485 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689096d3-3d7d-4c5a-9c39-d99ebb727a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:22.546485 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689096d3-3d7d-4c5a-9c39-d99ebb727a4a None admin] PATH_INFO: `/v3/services/network` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:22.546912 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 390/773] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:05:22.546988 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689096d3-3d7d-4c5a-9c39-d99ebb727a4a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:22.547057 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052db1c0-0fb5-4ce0-8df3-7338bc7c494d None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:22.547140 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689096d3-3d7d-4c5a-9c39-d99ebb727a4a None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:22.561684 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-689096d3-3d7d-4c5a-9c39-d99ebb727a4a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 19:05:22.561684 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:22.561684 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:05:22.561684 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:05:22.561684 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:05:22.561684 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:05:22.561684 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:05:22.561684 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:05:22.561684 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 19:05:22.561684 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:22.561684 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:05:22.561684 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:22.561684 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:22.561684 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:22.561684 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:22.561684 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:22.561684 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:22.562741 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:22.562741 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:22.562741 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:22.562741 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:22.562741 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:22.562741 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:22.562741 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:05:22.562741 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:05:22.562741 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:05:22.562741 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:05:22.562741 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:22.562741 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:22.562741 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:22.562741 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:22.562741 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:22.562741 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:22.563654 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:22.563654 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:22.563654 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:22.563654 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:22.563654 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:22.563654 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:22.563654 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:22.563654 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:22.563654 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:22.563654 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:22.563654 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:05:22.563654 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:05:22.563654 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 19:05:22.563654 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:22.567848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 384/774] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:05:22 2022] GET /identity/v3/services/network => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:22.570243 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689096d3-3d7d-4c5a-9c39-d99ebb727a4a None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:22.721600 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689096d3-3d7d-4c5a-9c39-d99ebb727a4a None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:22.731483 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052db1c0-0fb5-4ce0-8df3-7338bc7c494d None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:22.758076 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f86e0-9322-4f2e-9e6f-e29b2d2c6d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:22.759095 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f86e0-9322-4f2e-9e6f-e29b2d2c6d54 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:22.759591 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f86e0-9322-4f2e-9e6f-e29b2d2c6d54 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:22.760071 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f86e0-9322-4f2e-9e6f-e29b2d2c6d54 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:22.760972 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f86e0-9322-4f2e-9e6f-e29b2d2c6d54 None admin] RBAC: Adding query filter params (name=network) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:22.761485 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f86e0-9322-4f2e-9e6f-e29b2d2c6d54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:22.763092 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f86e0-9322-4f2e-9e6f-e29b2d2c6d54 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:22.768845 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 385/775] 10.222.0.79 () {56 vars in 1112 bytes} [Wed Aug 31 19:05:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:22.775185 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f86e0-9322-4f2e-9e6f-e29b2d2c6d54 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:22.780812 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:22.798798 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:22.812172 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abbd2c-6e04-45a3-9b97-f8e41fad6aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:22.812720 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abbd2c-6e04-45a3-9b97-f8e41fad6aa9 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:22.813005 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abbd2c-6e04-45a3-9b97-f8e41fad6aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:22.813798 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abbd2c-6e04-45a3-9b97-f8e41fad6aa9 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:22.814479 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0abbd2c-6e04-45a3-9b97-f8e41fad6aa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:22.814802 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0abbd2c-6e04-45a3-9b97-f8e41fad6aa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:22.816191 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0abbd2c-6e04-45a3-9b97-f8e41fad6aa9 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:22.845404 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 391/776] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:22.851320 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abbd2c-6e04-45a3-9b97-f8e41fad6aa9 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:22.890984 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f86e0-9322-4f2e-9e6f-e29b2d2c6d54 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:22.926749 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d0da2-cee3-4703-9e7b-721dde742392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:22.927367 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d0da2-cee3-4703-9e7b-721dde742392 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:22.927739 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d0da2-cee3-4703-9e7b-721dde742392 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:22.928013 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d0da2-cee3-4703-9e7b-721dde742392 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:22.928652 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d0da2-cee3-4703-9e7b-721dde742392 None admin] RBAC: Adding query filter params (type=network) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:22.928955 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d0da2-cee3-4703-9e7b-721dde742392 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:22.930382 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d0da2-cee3-4703-9e7b-721dde742392 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:22.935857 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 386/777] 10.222.0.79 () {56 vars in 1112 bytes} [Wed Aug 31 19:05:22 2022] GET /identity/v3/services?type=network => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:22.936842 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d0da2-cee3-4703-9e7b-721dde742392 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:23.010397 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abbd2c-6e04-45a3-9b97-f8e41fad6aa9 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:23.030965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:23.059350 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c5e64-0469-4524-b744-d6def6811ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:23.060105 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d0da2-cee3-4703-9e7b-721dde742392 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:23.060250 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c5e64-0469-4524-b744-d6def6811ddf None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:23.060598 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c5e64-0469-4524-b744-d6def6811ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:23.060970 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c5e64-0469-4524-b744-d6def6811ddf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:23.070285 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804c5e64-0469-4524-b744-d6def6811ddf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:23.072313 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804c5e64-0469-4524-b744-d6def6811ddf None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:23.089177 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-804c5e64-0469-4524-b744-d6def6811ddf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:23.089177 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:23.089177 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:23.089177 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:23.089177 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:23.089177 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:23.089177 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:23.089177 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:23.089177 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:23.089177 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:23.089177 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:23.089177 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:23.089177 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:05:23.089177 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:05:23.089177 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:05:23.090189 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:05:23.090189 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:23.090189 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:23.090189 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:23.090189 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:23.090189 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:23.090189 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:23.090189 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:23.090189 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:23.090189 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:23.090189 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:23.090189 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:23.090189 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:23.090189 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:23.090189 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:23.090189 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:23.090189 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:23.091194 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:05:23.091194 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:05:23.091194 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:05:23.091194 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:05:23.091194 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:05:23.091194 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:05:23.091194 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:23.091194 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:23.091194 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 392/778] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:05:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:05:23.092604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c5e64-0469-4524-b744-d6def6811ddf None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:23.107773 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc1327-a721-4e69-87a2-389e7d46e1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:23.108425 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc1327-a721-4e69-87a2-389e7d46e1a0 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:23.108715 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc1327-a721-4e69-87a2-389e7d46e1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:23.108989 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc1327-a721-4e69-87a2-389e7d46e1a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:23.122659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc1327-a721-4e69-87a2-389e7d46e1a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:05:23.129608 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-c9dc1327-a721-4e69-87a2-389e7d46e1a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:05:23.129608 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:23.129608 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:23.129608 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:23.129608 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:23.129608 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:23.129608 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:23.129608 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:23.129608 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:23.129608 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:23.129608 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:23.129608 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:23.129608 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:05:23.129608 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:05:23.129608 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:05:23.129608 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:05:23.130672 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:05:23.130672 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:05:23.130672 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:05:23.130672 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:05:23.130672 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:23.130672 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:23.130672 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:23.130672 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:23.130672 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:23.130672 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:23.130672 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:23.130672 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:23.130672 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:23.130672 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:23.130672 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:23.130672 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:23.131527 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:23.131527 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:23.131527 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:23.131527 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:23.131527 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:05:23.131527 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:05:23.131527 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:05:23.131527 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:05:23.131527 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:05:23.131527 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:05:23.131527 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:05:23.131527 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:23.134529 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 387/779] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 19:05:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:23.135594 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc1327-a721-4e69-87a2-389e7d46e1a0 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:23.154612 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:23.215164 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c5e64-0469-4524-b744-d6def6811ddf None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:23.248849 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc1327-a721-4e69-87a2-389e7d46e1a0 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:23.254509 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f803169d-9b5b-490c-9e78-67c3105d0dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:23.255428 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803169d-9b5b-490c-9e78-67c3105d0dd2 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:23.256241 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803169d-9b5b-490c-9e78-67c3105d0dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:23.256943 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803169d-9b5b-490c-9e78-67c3105d0dd2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:23.258156 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f803169d-9b5b-490c-9e78-67c3105d0dd2 None admin] RBAC: Adding query filter params (interface=public, service_id=d7bd2aa8b06f462ebb22bb3043c28409, region_id=RegionOne) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:23.258826 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f803169d-9b5b-490c-9e78-67c3105d0dd2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:23.260719 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f803169d-9b5b-490c-9e78-67c3105d0dd2 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:23.267526 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 393/780] 10.222.0.79 () {56 vars in 1251 bytes} [Wed Aug 31 19:05:23 2022] GET /identity/v3/endpoints?service_id=d7bd2aa8b06f462ebb22bb3043c28409&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:23.268565 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f803169d-9b5b-490c-9e78-67c3105d0dd2 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:23.277943 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:23.288089 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5fe58-d24a-4648-8b23-ebefd4d8b0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:23.288920 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5fe58-d24a-4648-8b23-ebefd4d8b0ec None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:23.289347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5fe58-d24a-4648-8b23-ebefd4d8b0ec None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:23.289759 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5fe58-d24a-4648-8b23-ebefd4d8b0ec None admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:23.290635 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5fe58-d24a-4648-8b23-ebefd4d8b0ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:23.291111 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5fe58-d24a-4648-8b23-ebefd4d8b0ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:23.292704 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5fe58-d24a-4648-8b23-ebefd4d8b0ec None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:23.305720 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 388/781] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 19:05:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:23.306883 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5fe58-d24a-4648-8b23-ebefd4d8b0ec None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:23.389992 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f803169d-9b5b-490c-9e78-67c3105d0dd2 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:23.410188 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:23.415239 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5fe58-d24a-4648-8b23-ebefd4d8b0ec None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:23.436220 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdfaf69-5e7b-4b16-b5b2-17b02dca7890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:23.436896 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfaf69-5e7b-4b16-b5b2-17b02dca7890 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:23.437183 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfaf69-5e7b-4b16-b5b2-17b02dca7890 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:23.437458 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfaf69-5e7b-4b16-b5b2-17b02dca7890 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:23.438973 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdfaf69-5e7b-4b16-b5b2-17b02dca7890 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:23.439256 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdfaf69-5e7b-4b16-b5b2-17b02dca7890 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:23.440631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdfaf69-5e7b-4b16-b5b2-17b02dca7890 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:23.454490 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 394/782] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:05:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:23.454490 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdfaf69-5e7b-4b16-b5b2-17b02dca7890 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:23.464093 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b4880-cd58-4358-8e26-bbe97a66a6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:23.465019 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b4880-cd58-4358-8e26-bbe97a66a6bc None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:23.465504 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b4880-cd58-4358-8e26-bbe97a66a6bc None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:23.465973 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b4880-cd58-4358-8e26-bbe97a66a6bc None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:23.466878 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b4880-cd58-4358-8e26-bbe97a66a6bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:23.468674 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b4880-cd58-4358-8e26-bbe97a66a6bc None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:23.475537 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 389/783] 10.222.0.79 () {56 vars in 1087 bytes} [Wed Aug 31 19:05:23 2022] GET /identity/v3/services => generated 772 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:23.477100 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b4880-cd58-4358-8e26-bbe97a66a6bc None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:23.547127 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:23.605645 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b4880-cd58-4358-8e26-bbe97a66a6bc None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:23.644222 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6809250-f908-47aa-a1e1-727917d12e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:23.644790 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6809250-f908-47aa-a1e1-727917d12e0a None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:23.645063 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6809250-f908-47aa-a1e1-727917d12e0a None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:23.645334 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6809250-f908-47aa-a1e1-727917d12e0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:23.657669 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6809250-f908-47aa-a1e1-727917d12e0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:23.659294 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6809250-f908-47aa-a1e1-727917d12e0a None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:23.676204 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-a6809250-f908-47aa-a1e1-727917d12e0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:23.676204 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:23.676204 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:23.676204 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:23.676204 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:23.676204 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:23.676204 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:23.676204 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:23.676204 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:23.676204 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:23.676204 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:23.676204 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:23.676204 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:23.676204 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:23.676204 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:23.676204 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:23.677427 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:23.677427 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:23.677427 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:23.677427 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:23.677427 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:23.677427 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:23.677427 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:23.677427 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:23.677427 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:23.677427 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:23.677427 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:23.677427 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:23.677427 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:23.677427 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:23.677427 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:23.677427 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:23.677427 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:23.678311 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:23.678311 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:23.678311 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:23.678311 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 390/784] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:23.683830 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6809250-f908-47aa-a1e1-727917d12e0a None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:23.710182 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdfaf69-5e7b-4b16-b5b2-17b02dca7890 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:23.749446 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af1f6ab-e494-47f5-9310-68c8dd408079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:23.750430 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1f6ab-e494-47f5-9310-68c8dd408079 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:23.750968 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1f6ab-e494-47f5-9310-68c8dd408079 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:23.751552 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1f6ab-e494-47f5-9310-68c8dd408079 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:23.752584 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af1f6ab-e494-47f5-9310-68c8dd408079 None admin] RBAC: Adding query filter params (role.id=0230e2e79da94067a82374ceada29d3f, scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507, user.id=3e070c93f47045ecb5bf0a1622395091) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:23.753106 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af1f6ab-e494-47f5-9310-68c8dd408079 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:23.754890 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af1f6ab-e494-47f5-9310-68c8dd408079 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:23.761571 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 395/785] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:05:23 2022] GET /identity/v3/role_assignments?user.id=3e070c93f47045ecb5bf0a1622395091&scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507&role.id=0230e2e79da94067a82374ceada29d3f => generated 259 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:23.797925 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6809250-f908-47aa-a1e1-727917d12e0a None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:23.800634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:23.837450 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed63deb-faa3-44f7-96d9-36e9768a26b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:23.838071 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed63deb-faa3-44f7-96d9-36e9768a26b0 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:23.838350 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed63deb-faa3-44f7-96d9-36e9768a26b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:23.838655 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed63deb-faa3-44f7-96d9-36e9768a26b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:23.839312 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed63deb-faa3-44f7-96d9-36e9768a26b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:23.839615 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed63deb-faa3-44f7-96d9-36e9768a26b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:23.841109 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed63deb-faa3-44f7-96d9-36e9768a26b0 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:23.855287 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 391/786] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:23.861171 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af1f6ab-e494-47f5-9310-68c8dd408079 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:23.907722 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:23.975844 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af1f6ab-e494-47f5-9310-68c8dd408079 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:24.014167 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7e05f-3350-407c-b34b-d8d853c628c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:24.014842 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7e05f-3350-407c-b34b-d8d853c628c0 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:24.015122 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7e05f-3350-407c-b34b-d8d853c628c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:24.015395 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7e05f-3350-407c-b34b-d8d853c628c0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:24.023683 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7e05f-3350-407c-b34b-d8d853c628c0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:24.025130 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7e05f-3350-407c-b34b-d8d853c628c0 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:24.037247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-bac7e05f-3350-407c-b34b-d8d853c628c0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 19:05:24.037247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:24.037247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:24.037247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:24.037247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:24.037247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:24.037247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:24.037247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:24.037247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:24.037247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:24.037247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:24.037247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:24.037247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:05:24.037247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:05:24.037247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:05:24.037247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:05:24.038204 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:24.038204 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:24.038204 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:05:24.038204 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:24.038204 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:05:24.038204 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:24.038204 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:24.038204 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:24.038204 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:24.038204 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:24.038204 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:24.038204 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:24.038204 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:24.038204 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:24.038204 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:24.038204 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:24.038204 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:24.038204 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:24.039200 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:24.039200 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:24.039200 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:05:24.039200 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:05:24.039200 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:05:24.039200 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:05:24.039200 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:05:24.039200 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:05:24.039200 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 19:05:24.039200 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:24.039200 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 396/787] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 19:05:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:24.044782 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed63deb-faa3-44f7-96d9-36e9768a26b0 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:24.150730 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed63deb-faa3-44f7-96d9-36e9768a26b0 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:24.186975 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b311845-9fc6-41cf-8ad4-1a07c6e259f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:24.187501 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b311845-9fc6-41cf-8ad4-1a07c6e259f1 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:24.187780 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b311845-9fc6-41cf-8ad4-1a07c6e259f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:24.188051 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b311845-9fc6-41cf-8ad4-1a07c6e259f1 None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:24.189415 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b311845-9fc6-41cf-8ad4-1a07c6e259f1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:24.189719 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b311845-9fc6-41cf-8ad4-1a07c6e259f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:24.191215 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b311845-9fc6-41cf-8ad4-1a07c6e259f1 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:24.209337 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 392/788] 10.222.0.79 () {56 vars in 1135 bytes} [Wed Aug 31 19:05:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:05:24.214977 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7e05f-3350-407c-b34b-d8d853c628c0 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:24.335595 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:24.341307 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7e05f-3350-407c-b34b-d8d853c628c0 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:24.387118 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185b47f-3b83-4f76-8c42-4c8acec1b8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:24.388157 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185b47f-3b83-4f76-8c42-4c8acec1b8fc None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:24.388812 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185b47f-3b83-4f76-8c42-4c8acec1b8fc None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:24.389354 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185b47f-3b83-4f76-8c42-4c8acec1b8fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:24.404849 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5185b47f-3b83-4f76-8c42-4c8acec1b8fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:24.407643 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5185b47f-3b83-4f76-8c42-4c8acec1b8fc None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:24.413161 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08159a36-e0cb-4ff0-848e-4b8f86e5cf94 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:24.413624 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08159a36-e0cb-4ff0-848e-4b8f86e5cf94 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:24.413700 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08159a36-e0cb-4ff0-848e-4b8f86e5cf94 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:24.415314 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 393/789] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:05:24.427138 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052146d-f1a1-44a3-9026-157071e300db None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:24.427446 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052146d-f1a1-44a3-9026-157071e300db None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:24.427688 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052146d-f1a1-44a3-9026-157071e300db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:24.430784 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-5185b47f-3b83-4f76-8c42-4c8acec1b8fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:24.430784 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:24.430784 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:24.430784 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:24.430784 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:24.430784 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:24.430784 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:24.430784 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:24.430784 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:24.430784 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:24.430784 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:24.430784 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:24.430784 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:24.430784 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:24.430784 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:24.430784 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:24.431710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:24.431710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:24.431710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:24.431710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:24.431710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:24.431710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:24.431710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:24.431710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:24.431710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:24.431710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:24.431710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:24.431710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:24.431710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:24.431710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:24.431710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:24.431710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:24.431710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:24.432602 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:24.432602 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:24.432602 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:24.432602 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 397/790] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:24.443702 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185b47f-3b83-4f76-8c42-4c8acec1b8fc None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:24.450690 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-c052146d-f1a1-44a3-9026-157071e300db None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:24.451887 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-c052146d-f1a1-44a3-9026-157071e300db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:24.488546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:24.559771 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 394/791] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:05:24.561061 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc3288-2112-4cd3-8631-b675641568ed None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:24.561351 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc3288-2112-4cd3-8631-b675641568ed None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:24.561628 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc3288-2112-4cd3-8631-b675641568ed None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:24.567141 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 395/792] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:05:24.569333 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b56dd1-7640-4f7c-a61c-6c954a12ae64 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:24.569772 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b56dd1-7640-4f7c-a61c-6c954a12ae64 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:24.570192 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b56dd1-7640-4f7c-a61c-6c954a12ae64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:24.608263 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-87b56dd1-7640-4f7c-a61c-6c954a12ae64 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:24.610106 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-87b56dd1-7640-4f7c-a61c-6c954a12ae64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:24.642163 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185b47f-3b83-4f76-8c42-4c8acec1b8fc None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:24.693173 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d34702-ea9a-441f-9a52-d88b6f872562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:24.693844 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d34702-ea9a-441f-9a52-d88b6f872562 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:24.694062 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d34702-ea9a-441f-9a52-d88b6f872562 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:24.694349 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d34702-ea9a-441f-9a52-d88b6f872562 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:24.695005 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d34702-ea9a-441f-9a52-d88b6f872562 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:24.695306 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d34702-ea9a-441f-9a52-d88b6f872562 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:24.696672 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d34702-ea9a-441f-9a52-d88b6f872562 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:24.715197 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 398/793] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:05:24.716789 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d34702-ea9a-441f-9a52-d88b6f872562 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:24.731241 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:24.796813 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 396/794] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:05:24.825905 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d34702-ea9a-441f-9a52-d88b6f872562 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:24.862179 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11075d1f-efaa-4f00-a99d-2818045e9dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:24.863145 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11075d1f-efaa-4f00-a99d-2818045e9dc3 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:24.863568 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11075d1f-efaa-4f00-a99d-2818045e9dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:24.863981 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11075d1f-efaa-4f00-a99d-2818045e9dc3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:24.871310 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11075d1f-efaa-4f00-a99d-2818045e9dc3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:24.872983 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11075d1f-efaa-4f00-a99d-2818045e9dc3 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:24.885516 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-11075d1f-efaa-4f00-a99d-2818045e9dc3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:24.885516 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:24.885516 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:24.885516 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:24.885516 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:24.885516 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:24.885516 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:24.885516 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:24.885516 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:24.885516 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:24.885516 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:24.885516 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:24.885516 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:05:24.885516 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:05:24.885516 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:05:24.886635 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:05:24.886635 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:24.886635 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:24.886635 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:24.886635 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:24.886635 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:24.886635 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:24.886635 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:24.886635 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:24.886635 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:24.886635 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:24.886635 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:24.886635 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:24.886635 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:24.886635 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:24.886635 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:24.886635 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:24.887797 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:05:24.887797 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:05:24.887797 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:05:24.887797 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:05:24.887797 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:05:24.887797 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:05:24.887797 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:24.887797 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:24.889787 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 399/795] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:05:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:05:24.898022 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b56dd1-7640-4f7c-a61c-6c954a12ae64 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:24.963345 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11075d1f-efaa-4f00-a99d-2818045e9dc3 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:25.046840 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:25.072899 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:25.082950 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11075d1f-efaa-4f00-a99d-2818045e9dc3 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:25.120263 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0163d-7405-4d5e-8fe7-e0c39c86e6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:25.120896 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0163d-7405-4d5e-8fe7-e0c39c86e6c1 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:25.121177 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0163d-7405-4d5e-8fe7-e0c39c86e6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:25.121449 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0163d-7405-4d5e-8fe7-e0c39c86e6c1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:25.122094 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0163d-7405-4d5e-8fe7-e0c39c86e6c1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:25.123636 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0163d-7405-4d5e-8fe7-e0c39c86e6c1 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:25.134051 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-94c0163d-7405-4d5e-8fe7-e0c39c86e6c1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 19:05:25.134051 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:25.134051 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:05:25.134051 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:05:25.134051 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:05:25.134051 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:05:25.134051 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:05:25.134051 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:05:25.134051 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 19:05:25.134051 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:25.134051 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:05:25.134051 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:25.134051 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:25.134051 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:25.134051 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:25.134051 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:25.134051 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:25.135122 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:25.135122 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:25.135122 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:25.135122 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:25.135122 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:25.135122 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:25.135122 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:05:25.135122 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:05:25.135122 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:05:25.135122 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:05:25.135122 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:25.135122 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:25.135122 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:25.135122 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:25.135122 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:25.135122 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:25.135969 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:25.135969 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:25.135969 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:25.135969 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:25.135969 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:25.135969 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:25.135969 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:25.135969 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:25.135969 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:25.135969 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:25.135969 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:05:25.135969 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:05:25.135969 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 19:05:25.135969 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:25.135969 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 400/796] 10.222.0.79 () {56 vars in 1129 bytes} [Wed Aug 31 19:05:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:25.140395 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b56dd1-7640-4f7c-a61c-6c954a12ae64 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:25.142032 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0163d-7405-4d5e-8fe7-e0c39c86e6c1 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:25.253585 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5555554-5b62-41c2-81fe-aca3c191dd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:25.254120 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5555554-5b62-41c2-81fe-aca3c191dd79 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:25.254398 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5555554-5b62-41c2-81fe-aca3c191dd79 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:25.254704 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5555554-5b62-41c2-81fe-aca3c191dd79 None admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:25.255402 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5555554-5b62-41c2-81fe-aca3c191dd79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:25.255702 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5555554-5b62-41c2-81fe-aca3c191dd79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:25.256497 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0163d-7405-4d5e-8fe7-e0c39c86e6c1 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:25.257154 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5555554-5b62-41c2-81fe-aca3c191dd79 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:25.271268 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 397/797] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 19:05:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:25.274502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5555554-5b62-41c2-81fe-aca3c191dd79 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:25.303784 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a964a-5316-44c6-a91e-5a95e7328c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:25.304661 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a964a-5316-44c6-a91e-5a95e7328c8d None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:25.305180 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a964a-5316-44c6-a91e-5a95e7328c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:25.305593 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a964a-5316-44c6-a91e-5a95e7328c8d None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:25.306419 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55a964a-5316-44c6-a91e-5a95e7328c8d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:25.306880 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55a964a-5316-44c6-a91e-5a95e7328c8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:25.308605 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55a964a-5316-44c6-a91e-5a95e7328c8d None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:25.309830 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:25.320461 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 401/798] 10.222.0.79 () {56 vars in 1124 bytes} [Wed Aug 31 19:05:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:25.321594 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a964a-5316-44c6-a91e-5a95e7328c8d None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:25.400308 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5555554-5b62-41c2-81fe-aca3c191dd79 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:25.431408 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a964a-5316-44c6-a91e-5a95e7328c8d None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:25.448299 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f164c0e-e85b-4d2e-9b10-7fb82f942662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:25.448938 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f164c0e-e85b-4d2e-9b10-7fb82f942662 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:25.449219 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f164c0e-e85b-4d2e-9b10-7fb82f942662 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:25.449494 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f164c0e-e85b-4d2e-9b10-7fb82f942662 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:25.463827 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f164c0e-e85b-4d2e-9b10-7fb82f942662 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:05:25.469346 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349a313-90b0-4dd3-9dc5-4e8ee6dd7fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:25.470724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-5f164c0e-e85b-4d2e-9b10-7fb82f942662 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:05:25.470724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:25.470724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:25.470724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:25.470724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:25.470724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:25.470724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:25.470724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:25.470724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:25.470724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:25.470724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:25.470724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:25.470724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:05:25.470724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:05:25.470724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:05:25.470724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:05:25.471723 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:05:25.471723 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:05:25.471723 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:05:25.471723 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:05:25.471723 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:25.471723 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:25.471723 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:25.471723 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:25.471723 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:25.471723 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:25.471723 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:25.471723 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:25.471723 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:25.471723 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:25.471723 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:25.471723 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:25.472591 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:25.472591 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:25.472591 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:25.472591 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:25.472591 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:05:25.472591 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:05:25.472591 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:05:25.472591 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:05:25.472591 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:05:25.472591 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:05:25.472591 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:05:25.472591 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:25.473283 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349a313-90b0-4dd3-9dc5-4e8ee6dd7fe2 None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:25.473360 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 398/799] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 19:05:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:25.473360 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f164c0e-e85b-4d2e-9b10-7fb82f942662 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:25.475427 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:25.479029 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349a313-90b0-4dd3-9dc5-4e8ee6dd7fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:25.479219 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349a313-90b0-4dd3-9dc5-4e8ee6dd7fe2 None admin] PATH_INFO: `/v3/projects/f9e550ea75dd4245bd9c2bcd6322c507/users/3b289a0bef53460ca5173ad946394d72/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:25.481304 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349a313-90b0-4dd3-9dc5-4e8ee6dd7fe2 None admin] RBAC: Authorizing `identity:create_grant(project_id=f9e550ea75dd4245bd9c2bcd6322c507, user_id=3b289a0bef53460ca5173ad946394d72, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:25.482993 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349a313-90b0-4dd3-9dc5-4e8ee6dd7fe2 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:25.497899 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 402/800] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 19:05:25 2022] PUT /identity/v3/projects/f9e550ea75dd4245bd9c2bcd6322c507/users/3b289a0bef53460ca5173ad946394d72/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:05:25.506674 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349a313-90b0-4dd3-9dc5-4e8ee6dd7fe2 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:25.577512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:25.640408 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f164c0e-e85b-4d2e-9b10-7fb82f942662 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:25.641970 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349a313-90b0-4dd3-9dc5-4e8ee6dd7fe2 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:25.678921 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd43315-2f69-4172-93b7-b4e942689d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:25.679796 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd43315-2f69-4172-93b7-b4e942689d38 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:25.680223 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd43315-2f69-4172-93b7-b4e942689d38 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:25.680664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd43315-2f69-4172-93b7-b4e942689d38 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:25.681523 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd43315-2f69-4172-93b7-b4e942689d38 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:25.681977 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd43315-2f69-4172-93b7-b4e942689d38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:25.683666 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd43315-2f69-4172-93b7-b4e942689d38 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:25.690681 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 399/801] 10.222.0.79 () {56 vars in 1124 bytes} [Wed Aug 31 19:05:25 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:25.700222 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd43315-2f69-4172-93b7-b4e942689d38 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:25.717655 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b83631-8427-43bd-9eed-95268257d0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:25.718280 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b83631-8427-43bd-9eed-95268257d0e4 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:25.718578 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b83631-8427-43bd-9eed-95268257d0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:25.718849 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b83631-8427-43bd-9eed-95268257d0e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:25.719563 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b83631-8427-43bd-9eed-95268257d0e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:25.719860 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b83631-8427-43bd-9eed-95268257d0e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:25.721243 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b83631-8427-43bd-9eed-95268257d0e4 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:25.741846 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 403/802] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:05:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:25.742864 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b83631-8427-43bd-9eed-95268257d0e4 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:25.825220 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:25.873982 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd43315-2f69-4172-93b7-b4e942689d38 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:25.883436 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b83631-8427-43bd-9eed-95268257d0e4 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:25.908759 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:25.924733 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2ddae-b88e-4d3f-97c2-c903b02b24a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:25.925354 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2ddae-b88e-4d3f-97c2-c903b02b24a6 None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:25.925633 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2ddae-b88e-4d3f-97c2-c903b02b24a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:25.925904 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2ddae-b88e-4d3f-97c2-c903b02b24a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:25.926627 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d2ddae-b88e-4d3f-97c2-c903b02b24a6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:25.927994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d2ddae-b88e-4d3f-97c2-c903b02b24a6 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:25.931681 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17703ee7-8bbd-43e8-9a1d-0d4e95f4000a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:25.932560 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17703ee7-8bbd-43e8-9a1d-0d4e95f4000a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:25.932988 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17703ee7-8bbd-43e8-9a1d-0d4e95f4000a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:25.933397 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17703ee7-8bbd-43e8-9a1d-0d4e95f4000a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:25.949119 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17703ee7-8bbd-43e8-9a1d-0d4e95f4000a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:25.951064 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17703ee7-8bbd-43e8-9a1d-0d4e95f4000a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:25.959700 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 400/803] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:05:25 2022] POST /identity/v3/endpoints => generated 346 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:05:25.966536 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8198ec2-0855-48b2-9746-115e5359cb05 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:25.966536 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8198ec2-0855-48b2-9746-115e5359cb05 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:25.966536 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8198ec2-0855-48b2-9746-115e5359cb05 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:25.967333 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 401/804] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:05:25.969132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49c877-a9ba-485b-a7ac-c155ad842a5e None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:25.970022 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49c877-a9ba-485b-a7ac-c155ad842a5e None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:25.970370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49c877-a9ba-485b-a7ac-c155ad842a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:25.978169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-17703ee7-8bbd-43e8-9a1d-0d4e95f4000a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:25.978169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:25.978169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:25.978169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:25.978169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:25.978169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:25.978169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:25.978169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:25.978169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:25.978169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:25.978169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:25.978169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:25.978169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:25.978169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:25.978169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:25.978169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:25.979192 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:25.979192 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:25.979192 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:25.979192 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:25.979192 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:25.979192 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:25.979192 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:25.979192 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:25.979192 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:25.979192 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:25.979192 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:25.979192 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:25.979192 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:25.979192 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:25.979192 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:25.979192 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:25.979192 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:25.980067 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:25.980067 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:25.980067 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:25.980246 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 404/805] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:25.987444 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17703ee7-8bbd-43e8-9a1d-0d4e95f4000a None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:26.009838 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-ce49c877-a9ba-485b-a7ac-c155ad842a5e None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:26.015028 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-ce49c877-a9ba-485b-a7ac-c155ad842a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:26.161031 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 402/806] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:05:26.162532 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc8e0a-6a0c-4b84-adf5-d2f0a30fd7f5 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:26.162875 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc8e0a-6a0c-4b84-adf5-d2f0a30fd7f5 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:26.163189 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc8e0a-6a0c-4b84-adf5-d2f0a30fd7f5 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:26.165767 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 403/807] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:05:26.171854 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17703ee7-8bbd-43e8-9a1d-0d4e95f4000a None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:26.174123 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24237e-4abb-45bf-956c-98549dbd50e9 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:26.174631 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24237e-4abb-45bf-956c-98549dbd50e9 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:26.175079 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24237e-4abb-45bf-956c-98549dbd50e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:26.212272 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-0c24237e-4abb-45bf-956c-98549dbd50e9 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:26.213620 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-0c24237e-4abb-45bf-956c-98549dbd50e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:26.224496 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82215d66-76a4-4ec0-951c-d1b02e5fa46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:26.225353 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82215d66-76a4-4ec0-951c-d1b02e5fa46f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:26.225858 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82215d66-76a4-4ec0-951c-d1b02e5fa46f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:26.226586 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82215d66-76a4-4ec0-951c-d1b02e5fa46f None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:26.227809 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82215d66-76a4-4ec0-951c-d1b02e5fa46f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:26.228295 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82215d66-76a4-4ec0-951c-d1b02e5fa46f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:26.229843 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82215d66-76a4-4ec0-951c-d1b02e5fa46f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:26.245072 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 405/808] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:26.251106 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82215d66-76a4-4ec0-951c-d1b02e5fa46f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:26.274854 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:26.292675 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:26.302661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 404/809] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:05:26.375099 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82215d66-76a4-4ec0-951c-d1b02e5fa46f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:26.418965 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c74e13-6a6d-4d17-af2f-6073c4b5719f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:26.419534 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c74e13-6a6d-4d17-af2f-6073c4b5719f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:26.419811 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c74e13-6a6d-4d17-af2f-6073c4b5719f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:26.420089 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c74e13-6a6d-4d17-af2f-6073c4b5719f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:26.430304 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c74e13-6a6d-4d17-af2f-6073c4b5719f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:26.431817 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c74e13-6a6d-4d17-af2f-6073c4b5719f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:26.447782 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-a2c74e13-6a6d-4d17-af2f-6073c4b5719f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:05:26.447782 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:26.447782 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:26.447782 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:26.447782 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:26.447782 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:26.447782 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:26.447782 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:26.447782 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:26.447782 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:26.447782 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:26.447782 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:26.447782 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:05:26.447782 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:05:26.447782 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:05:26.447782 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:05:26.448767 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:26.448767 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:26.448767 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:05:26.448767 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:26.448767 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:05:26.448767 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:26.448767 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:26.448767 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:26.448767 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:26.448767 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:26.448767 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:26.448767 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:26.448767 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:26.448767 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:26.448767 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:26.448767 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:26.448767 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:26.448767 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:26.449686 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:26.449686 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:26.449686 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:05:26.449686 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:05:26.449686 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:05:26.449686 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:05:26.449686 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:05:26.449686 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:05:26.449686 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:05:26.449686 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:26.450207 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 406/810] 10.222.0.79 () {56 vars in 1093 bytes} [Wed Aug 31 19:05:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:26.455256 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24237e-4abb-45bf-956c-98549dbd50e9 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:26.467731 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c74e13-6a6d-4d17-af2f-6073c4b5719f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:26.629973 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24237e-4abb-45bf-956c-98549dbd50e9 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:26.635306 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:26.645948 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c74e13-6a6d-4d17-af2f-6073c4b5719f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:26.681039 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4583c4ee-b4d2-4278-93bc-647b14bc8bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:26.681556 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583c4ee-b4d2-4278-93bc-647b14bc8bdd None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:26.681835 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583c4ee-b4d2-4278-93bc-647b14bc8bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:26.682114 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583c4ee-b4d2-4278-93bc-647b14bc8bdd None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:26.682879 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4583c4ee-b4d2-4278-93bc-647b14bc8bdd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:26.683185 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4583c4ee-b4d2-4278-93bc-647b14bc8bdd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:26.683503 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8ff4c-7387-4fb6-bbc3-faaf2e898ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:26.684133 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8ff4c-7387-4fb6-bbc3-faaf2e898ffe None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:26.684416 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8ff4c-7387-4fb6-bbc3-faaf2e898ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:26.684668 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8ff4c-7387-4fb6-bbc3-faaf2e898ffe None admin] PATH_INFO: `/v3/services/network` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:26.684813 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4583c4ee-b4d2-4278-93bc-647b14bc8bdd None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:26.691068 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb8ff4c-7387-4fb6-bbc3-faaf2e898ffe None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:26.691068 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb8ff4c-7387-4fb6-bbc3-faaf2e898ffe None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:26.696182 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-1eb8ff4c-7387-4fb6-bbc3-faaf2e898ffe None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 19:05:26.696182 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:26.696182 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:05:26.696182 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:05:26.696182 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:05:26.696182 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:05:26.696182 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:05:26.696182 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:05:26.696182 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 19:05:26.696182 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:26.696182 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:05:26.696182 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:26.696182 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:26.696182 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:26.696182 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:26.696182 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:26.696182 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:26.697960 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:26.697960 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:26.697960 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:26.697960 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:26.697960 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:26.697960 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:26.697960 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:05:26.697960 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:05:26.697960 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:05:26.697960 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:05:26.697960 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:26.697960 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:26.697960 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:26.697960 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:26.697960 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:26.697960 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:26.699604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:26.699604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:26.699604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:26.699604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:26.699604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:26.699604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:26.699604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:26.699604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:26.699604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:26.699604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:26.699604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:05:26.699604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:05:26.699604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 19:05:26.699604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:26.699604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 407/811] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:05:26 2022] GET /identity/v3/services/network => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:05:26.701070 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8ff4c-7387-4fb6-bbc3-faaf2e898ffe None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:26.706723 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 405/812] 10.222.0.79 () {56 vars in 1133 bytes} [Wed Aug 31 19:05:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:26.711684 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4583c4ee-b4d2-4278-93bc-647b14bc8bdd None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:26.762821 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:26.828202 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8ff4c-7387-4fb6-bbc3-faaf2e898ffe None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:26.836446 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4583c4ee-b4d2-4278-93bc-647b14bc8bdd None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:26.867253 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a55729-b4ab-4972-bd67-74cc9b74da02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:26.868217 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a55729-b4ab-4972-bd67-74cc9b74da02 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:26.868722 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a55729-b4ab-4972-bd67-74cc9b74da02 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:26.869196 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a55729-b4ab-4972-bd67-74cc9b74da02 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:26.871780 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1a077-e7c2-4d79-b8fc-db18a5797ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:26.872520 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1a077-e7c2-4d79-b8fc-db18a5797ceb None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:26.873075 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1a077-e7c2-4d79-b8fc-db18a5797ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:26.873394 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1a077-e7c2-4d79-b8fc-db18a5797ceb None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:26.874030 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1a077-e7c2-4d79-b8fc-db18a5797ceb None admin] RBAC: Adding query filter params (name=network) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:26.874332 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1a077-e7c2-4d79-b8fc-db18a5797ceb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:26.876257 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1a077-e7c2-4d79-b8fc-db18a5797ceb None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:26.882150 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 406/813] 10.222.0.79 () {56 vars in 1112 bytes} [Wed Aug 31 19:05:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:26.883098 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1a077-e7c2-4d79-b8fc-db18a5797ceb None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:26.885085 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a55729-b4ab-4972-bd67-74cc9b74da02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:05:26.890946 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-73a55729-b4ab-4972-bd67-74cc9b74da02 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:05:26.890946 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:26.890946 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:26.890946 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:26.890946 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:26.890946 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:26.890946 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:26.890946 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:26.890946 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:26.890946 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:26.890946 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:26.890946 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:26.890946 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:05:26.890946 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:05:26.890946 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:05:26.890946 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:05:26.892414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:05:26.892414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:05:26.892414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:05:26.892414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:05:26.892414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:26.892414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:26.892414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:26.892414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:26.892414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:26.892414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:26.892414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:26.892414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:26.892414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:26.892414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:26.892414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:26.892414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:26.893346 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:26.893346 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:26.893346 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:26.893346 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:26.893346 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:05:26.893346 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:05:26.893346 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:05:26.893346 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:05:26.893346 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:05:26.893346 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:05:26.893346 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:05:26.893346 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:26.896090 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 408/814] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 19:05:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:26.902027 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a55729-b4ab-4972-bd67-74cc9b74da02 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:26.923886 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:26.987178 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:26.989770 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1a077-e7c2-4d79-b8fc-db18a5797ceb None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:27.022652 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a55729-b4ab-4972-bd67-74cc9b74da02 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:27.026139 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae81bf4e-3ef8-4b88-b4fd-83f203e95e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:27.026883 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81bf4e-3ef8-4b88-b4fd-83f203e95e11 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:27.027237 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81bf4e-3ef8-4b88-b4fd-83f203e95e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:27.027577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81bf4e-3ef8-4b88-b4fd-83f203e95e11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:27.063873 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5bfa2d-653d-429b-a278-c2230f72adcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:27.064905 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bfa2d-653d-429b-a278-c2230f72adcf None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:27.065368 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bfa2d-653d-429b-a278-c2230f72adcf None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:27.065898 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bfa2d-653d-429b-a278-c2230f72adcf None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:27.066832 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5bfa2d-653d-429b-a278-c2230f72adcf None admin] RBAC: Adding query filter params (type=network) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:27.067337 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5bfa2d-653d-429b-a278-c2230f72adcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:27.069262 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5bfa2d-653d-429b-a278-c2230f72adcf None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:27.075243 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 409/815] 10.222.0.79 () {56 vars in 1112 bytes} [Wed Aug 31 19:05:26 2022] GET /identity/v3/services?type=network => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:27.076354 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5bfa2d-653d-429b-a278-c2230f72adcf None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:27.101942 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae81bf4e-3ef8-4b88-b4fd-83f203e95e11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:27.103467 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae81bf4e-3ef8-4b88-b4fd-83f203e95e11 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:27.167906 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:27.192354 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5bfa2d-653d-429b-a278-c2230f72adcf None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:27.207256 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:27.216511 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 407/816] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:05:26 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:05:27.217899 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae81bf4e-3ef8-4b88-b4fd-83f203e95e11 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:27.243793 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07dfc3-0eaf-4158-928e-7104dd03ed6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:27.244333 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07dfc3-0eaf-4158-928e-7104dd03ed6b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:27.245144 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07dfc3-0eaf-4158-928e-7104dd03ed6b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:27.245428 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07dfc3-0eaf-4158-928e-7104dd03ed6b None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:27.246254 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07dfc3-0eaf-4158-928e-7104dd03ed6b None admin] RBAC: Adding query filter params (name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:27.246710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07dfc3-0eaf-4158-928e-7104dd03ed6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:27.248397 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07dfc3-0eaf-4158-928e-7104dd03ed6b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:27.259708 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 410/817] 10.222.0.79 () {56 vars in 1103 bytes} [Wed Aug 31 19:05:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:27.260880 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07dfc3-0eaf-4158-928e-7104dd03ed6b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:27.347044 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae81bf4e-3ef8-4b88-b4fd-83f203e95e11 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:27.380431 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07dfc3-0eaf-4158-928e-7104dd03ed6b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:27.424184 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88845203-e5ed-4404-9bbd-3014d4504efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:27.425016 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88845203-e5ed-4404-9bbd-3014d4504efa None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:27.425397 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88845203-e5ed-4404-9bbd-3014d4504efa None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:27.425777 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88845203-e5ed-4404-9bbd-3014d4504efa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:27.439123 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88845203-e5ed-4404-9bbd-3014d4504efa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:27.440797 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88845203-e5ed-4404-9bbd-3014d4504efa None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:27.443031 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:27.460232 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-88845203-e5ed-4404-9bbd-3014d4504efa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:27.460232 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:27.460232 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:27.460232 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:27.460232 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:27.460232 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:27.460232 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:27.460232 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:27.460232 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:27.460232 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:27.460232 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:27.460232 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:27.460232 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:27.460232 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:27.460232 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:27.460232 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:27.461287 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:27.461287 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:27.461287 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:27.461287 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:27.461287 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:27.461287 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:27.461287 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:27.461287 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:27.461287 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:27.461287 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:27.461287 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:27.461287 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:27.461287 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:27.461287 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:27.461287 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:27.461287 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:27.461287 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:27.462208 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:27.462208 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:27.462208 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:27.464427 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 411/818] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:27.465448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88845203-e5ed-4404-9bbd-3014d4504efa None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:27.508387 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac096149-d6e3-4473-ab27-f0f69ab96389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:27.508939 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac096149-d6e3-4473-ab27-f0f69ab96389 None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:27.509206 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac096149-d6e3-4473-ab27-f0f69ab96389 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:27.509442 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac096149-d6e3-4473-ab27-f0f69ab96389 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:27.510110 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac096149-d6e3-4473-ab27-f0f69ab96389 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:27.511510 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac096149-d6e3-4473-ab27-f0f69ab96389 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:27.550786 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 408/819] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:05:27 2022] POST /identity/v3/endpoints => generated 337 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:05:27.550786 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac096149-d6e3-4473-ab27-f0f69ab96389 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:27.652309 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88845203-e5ed-4404-9bbd-3014d4504efa None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:27.678450 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:27.717045 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca04e8-7f8f-419e-9a3e-6081a706cb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:27.718144 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca04e8-7f8f-419e-9a3e-6081a706cb10 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:27.718797 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca04e8-7f8f-419e-9a3e-6081a706cb10 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:27.721860 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca04e8-7f8f-419e-9a3e-6081a706cb10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:27.735076 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca04e8-7f8f-419e-9a3e-6081a706cb10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:27.736828 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca04e8-7f8f-419e-9a3e-6081a706cb10 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:27.752494 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-d2ca04e8-7f8f-419e-9a3e-6081a706cb10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:27.752494 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:27.752494 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:27.752494 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:27.752494 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:27.752494 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:27.752494 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:27.752494 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:27.752494 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:27.752494 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:27.752494 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:27.752494 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:27.752494 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:27.752494 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:27.752494 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:27.752494 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:27.753535 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:27.753535 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:27.753535 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:27.753535 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:27.753535 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:27.753535 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:27.753535 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:27.753535 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:27.753535 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:27.753535 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:27.753535 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:27.753535 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:27.753535 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:27.753535 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:27.753535 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:27.753535 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:27.753535 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:27.754440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:27.754440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:27.754440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:27.756639 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 412/820] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:27.759342 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac096149-d6e3-4473-ab27-f0f69ab96389 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:27.762734 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca04e8-7f8f-419e-9a3e-6081a706cb10 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:27.798050 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b8514-7e79-4c3f-9376-104fcec0651d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:27.798259 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b8514-7e79-4c3f-9376-104fcec0651d None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:27.798573 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b8514-7e79-4c3f-9376-104fcec0651d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:27.798849 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b8514-7e79-4c3f-9376-104fcec0651d None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:27.799502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b8514-7e79-4c3f-9376-104fcec0651d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:27.799803 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b8514-7e79-4c3f-9376-104fcec0651d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:27.801164 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b8514-7e79-4c3f-9376-104fcec0651d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:27.815902 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:27.816873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 409/821] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:27.822239 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b8514-7e79-4c3f-9376-104fcec0651d None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:27.896658 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca04e8-7f8f-419e-9a3e-6081a706cb10 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:27.948156 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564dcd0-c2d2-48c5-9e23-6db2b1e6d45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:27.949114 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564dcd0-c2d2-48c5-9e23-6db2b1e6d45c None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:27.949601 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564dcd0-c2d2-48c5-9e23-6db2b1e6d45c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:27.950078 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564dcd0-c2d2-48c5-9e23-6db2b1e6d45c None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:27.950957 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6564dcd0-c2d2-48c5-9e23-6db2b1e6d45c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:27.951435 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6564dcd0-c2d2-48c5-9e23-6db2b1e6d45c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:27.952969 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6564dcd0-c2d2-48c5-9e23-6db2b1e6d45c None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:27.959529 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b8514-7e79-4c3f-9376-104fcec0651d None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:27.966743 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 413/822] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:27.968290 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83bbcf3-df24-4775-a33f-04c2f41eedee None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:27.968756 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83bbcf3-df24-4775-a33f-04c2f41eedee None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:27.969171 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83bbcf3-df24-4775-a33f-04c2f41eedee None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:27.970803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 414/823] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:05:27.971857 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83bbcf3-df24-4775-a33f-04c2f41eedee None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:27.980738 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:28.000574 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91ee75-0649-4a3a-85c2-ae7d3ac167c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:28.001740 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91ee75-0649-4a3a-85c2-ae7d3ac167c1 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:28.002018 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91ee75-0649-4a3a-85c2-ae7d3ac167c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:28.002288 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91ee75-0649-4a3a-85c2-ae7d3ac167c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:28.010071 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da91ee75-0649-4a3a-85c2-ae7d3ac167c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:28.011466 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da91ee75-0649-4a3a-85c2-ae7d3ac167c1 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:28.023537 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-da91ee75-0649-4a3a-85c2-ae7d3ac167c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:28.023537 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:28.023537 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:28.023537 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:28.023537 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:28.023537 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:28.023537 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:28.023537 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:28.023537 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:28.023537 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:28.023537 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:28.023537 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:28.023537 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:05:28.023537 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:05:28.023537 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:05:28.024597 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:05:28.024597 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:28.024597 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:28.024597 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:28.024597 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:28.024597 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:28.024597 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:28.024597 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:28.024597 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:28.024597 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:28.024597 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:28.024597 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:28.024597 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:28.024597 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:28.024597 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:28.024597 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:28.024597 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:28.025488 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:05:28.025488 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:05:28.025488 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:05:28.025488 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:05:28.025488 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:05:28.025488 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:05:28.025488 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:28.025488 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:28.025488 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 410/824] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:05:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:28.025975 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de922ea-a8b3-4830-8c73-3546c9048509 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:28.026111 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de922ea-a8b3-4830-8c73-3546c9048509 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:28.026389 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de922ea-a8b3-4830-8c73-3546c9048509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:28.045746 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-3de922ea-a8b3-4830-8c73-3546c9048509 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:28.046976 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-3de922ea-a8b3-4830-8c73-3546c9048509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:28.087984 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83bbcf3-df24-4775-a33f-04c2f41eedee None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:28.090001 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:28.122500 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 411/825] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:28 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:05:28.122500 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de922ea-a8b3-4830-8c73-3546c9048509 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:28.138796 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea5ad71-dc7c-4d45-ae59-60676fc7bc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:28.139906 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5ad71-dc7c-4d45-ae59-60676fc7bc57 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:28.140284 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5ad71-dc7c-4d45-ae59-60676fc7bc57 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:28.140644 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5ad71-dc7c-4d45-ae59-60676fc7bc57 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:28.149554 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea5ad71-dc7c-4d45-ae59-60676fc7bc57 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:28.151324 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea5ad71-dc7c-4d45-ae59-60676fc7bc57 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:28.164645 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-eea5ad71-dc7c-4d45-ae59-60676fc7bc57 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 19:05:28.164645 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:28.164645 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:28.164645 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:28.164645 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:28.164645 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:28.164645 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:28.164645 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:28.164645 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:28.164645 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:28.164645 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:28.164645 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:28.164645 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:05:28.164645 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:05:28.164645 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:05:28.164645 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:05:28.165818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:28.165818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:28.165818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:05:28.165818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:28.165818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:05:28.165818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:28.165818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:28.165818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:28.165818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:28.165818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:28.165818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:28.165818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:28.165818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:28.165818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:28.165818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:28.165818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:28.165818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:28.165818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:28.167020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:28.167020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:28.167020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:05:28.167020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:05:28.167020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:05:28.167020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:05:28.167020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:05:28.167020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:05:28.167020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 19:05:28.167020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:28.168712 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 415/826] 10.222.0.79 () {56 vars in 1117 bytes} [Wed Aug 31 19:05:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:05:28.173928 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea5ad71-dc7c-4d45-ae59-60676fc7bc57 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:28.259282 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de922ea-a8b3-4830-8c73-3546c9048509 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:28.271093 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:28.283468 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea5ad71-dc7c-4d45-ae59-60676fc7bc57 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:28.309954 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac543156-fc0b-4c8d-bf87-b79b793e4c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:28.311225 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac543156-fc0b-4c8d-bf87-b79b793e4c1f None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:28.312113 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac543156-fc0b-4c8d-bf87-b79b793e4c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:28.312762 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac543156-fc0b-4c8d-bf87-b79b793e4c1f None admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:28.314287 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac543156-fc0b-4c8d-bf87-b79b793e4c1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:28.315037 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac543156-fc0b-4c8d-bf87-b79b793e4c1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:28.317422 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac543156-fc0b-4c8d-bf87-b79b793e4c1f None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:28.320922 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30072e-cee3-4432-a0cf-f160466dde6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:28.321539 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30072e-cee3-4432-a0cf-f160466dde6e None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:28.321819 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30072e-cee3-4432-a0cf-f160466dde6e None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:28.322090 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30072e-cee3-4432-a0cf-f160466dde6e None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:28.322872 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a30072e-cee3-4432-a0cf-f160466dde6e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:28.323184 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a30072e-cee3-4432-a0cf-f160466dde6e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:28.324719 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a30072e-cee3-4432-a0cf-f160466dde6e None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:28.331079 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 412/827] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 19:05:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:28.332898 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987841e7-5779-4f7f-83a9-04830116aa5f None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:28.333497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987841e7-5779-4f7f-83a9-04830116aa5f None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:28.333935 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987841e7-5779-4f7f-83a9-04830116aa5f None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:28.336437 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 413/828] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:05:28.337335 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987841e7-5779-4f7f-83a9-04830116aa5f None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:28.345803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 416/829] 10.222.0.79 () {56 vars in 1149 bytes} [Wed Aug 31 19:05:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:28.347187 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85d238-2098-48c8-ab94-48dd524ad353 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:28.347535 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85d238-2098-48c8-ab94-48dd524ad353 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:28.347882 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85d238-2098-48c8-ab94-48dd524ad353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:28.368762 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-6b85d238-2098-48c8-ab94-48dd524ad353 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:28.376307 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6b85d238-2098-48c8-ab94-48dd524ad353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:28.390551 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:28.446006 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 417/830] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:28 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:05:28.446982 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85d238-2098-48c8-ab94-48dd524ad353 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:28.451278 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987841e7-5779-4f7f-83a9-04830116aa5f None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:28.489316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e004847-1c75-4fc8-8fb9-c793bfa1195a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:28.490130 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e004847-1c75-4fc8-8fb9-c793bfa1195a None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:28.490277 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e004847-1c75-4fc8-8fb9-c793bfa1195a None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:28.490482 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e004847-1c75-4fc8-8fb9-c793bfa1195a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:28.491202 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e004847-1c75-4fc8-8fb9-c793bfa1195a None admin] RBAC: Adding query filter params (role.id=edc551338adb4ae88bdafc591ad69582, scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507, user.id=1fd6d45d1bc3479da72cb1a1990a6137) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:28.491503 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e004847-1c75-4fc8-8fb9-c793bfa1195a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:28.492915 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e004847-1c75-4fc8-8fb9-c793bfa1195a None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:28.498992 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 414/831] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:05:28 2022] GET /identity/v3/role_assignments?user.id=1fd6d45d1bc3479da72cb1a1990a6137&scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507&role.id=edc551338adb4ae88bdafc591ad69582 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:28.503415 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e004847-1c75-4fc8-8fb9-c793bfa1195a None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:28.549538 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:28.582191 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85d238-2098-48c8-ab94-48dd524ad353 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:28.631091 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aedc6a-5060-4afa-9717-1f9a907c5f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:28.631695 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aedc6a-5060-4afa-9717-1f9a907c5f7f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:28.631967 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aedc6a-5060-4afa-9717-1f9a907c5f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:28.632241 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aedc6a-5060-4afa-9717-1f9a907c5f7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:28.641957 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e004847-1c75-4fc8-8fb9-c793bfa1195a None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:28.644891 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aedc6a-5060-4afa-9717-1f9a907c5f7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:28.647405 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aedc6a-5060-4afa-9717-1f9a907c5f7f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:28.664823 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-89aedc6a-5060-4afa-9717-1f9a907c5f7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:28.664823 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:28.664823 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:28.664823 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:28.664823 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:28.664823 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:28.664823 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:28.664823 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:28.664823 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:28.664823 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:28.664823 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:28.664823 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:28.664823 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:28.664823 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:28.664823 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:28.664823 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:28.665981 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:28.665981 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:28.665981 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:28.665981 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:28.665981 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:28.665981 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:28.665981 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:28.665981 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:28.665981 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:28.665981 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:28.665981 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:28.665981 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:28.665981 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:28.665981 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:28.665981 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:28.665981 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:28.665981 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:28.667095 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:28.667095 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:28.667095 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:28.667741 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 418/832] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:28.673471 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aedc6a-5060-4afa-9717-1f9a907c5f7f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:28.677428 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:28.688832 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9c8a1-296a-448f-9014-e6da6dd345d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:28.689725 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9c8a1-296a-448f-9014-e6da6dd345d1 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:28.690003 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9c8a1-296a-448f-9014-e6da6dd345d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:28.690273 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9c8a1-296a-448f-9014-e6da6dd345d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:28.703189 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9c8a1-296a-448f-9014-e6da6dd345d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:05:28.709507 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-31f9c8a1-296a-448f-9014-e6da6dd345d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:05:28.709507 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:28.709507 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:28.709507 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:28.709507 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:28.709507 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:28.709507 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:28.709507 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:28.709507 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:28.709507 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:28.709507 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:28.709507 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:28.709507 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:05:28.709507 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:05:28.709507 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:05:28.709507 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:05:28.710659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:05:28.710659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:05:28.710659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:05:28.710659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:05:28.710659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:28.710659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:28.710659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:28.710659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:28.710659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:28.710659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:28.710659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:28.710659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:28.710659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:28.710659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:28.710659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:28.710659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:28.711696 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:28.711696 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:28.711696 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:28.711696 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:28.711696 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:05:28.711696 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:05:28.711696 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:05:28.711696 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:05:28.711696 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:05:28.711696 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:05:28.711696 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:05:28.711696 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:28.712456 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 415/833] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 19:05:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:28.717582 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9c8a1-296a-448f-9014-e6da6dd345d1 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:28.786512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aedc6a-5060-4afa-9717-1f9a907c5f7f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:28.818788 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:28.825342 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc9674-6194-4826-90a8-52faba1865ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:28.826027 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc9674-6194-4826-90a8-52faba1865ea None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:28.826371 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc9674-6194-4826-90a8-52faba1865ea None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:28.826941 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc9674-6194-4826-90a8-52faba1865ea None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:28.827373 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc9674-6194-4826-90a8-52faba1865ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:28.827669 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc9674-6194-4826-90a8-52faba1865ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:28.829118 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc9674-6194-4826-90a8-52faba1865ea None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:28.830016 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9c8a1-296a-448f-9014-e6da6dd345d1 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:28.846833 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 419/834] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:05:28.846833 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc9674-6194-4826-90a8-52faba1865ea None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:28.872152 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aace7e-1366-4b82-ba6f-a7dc9672273b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:28.872864 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aace7e-1366-4b82-ba6f-a7dc9672273b None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:28.873219 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aace7e-1366-4b82-ba6f-a7dc9672273b None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:28.873572 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aace7e-1366-4b82-ba6f-a7dc9672273b None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:28.874348 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aace7e-1366-4b82-ba6f-a7dc9672273b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:28.874753 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aace7e-1366-4b82-ba6f-a7dc9672273b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:28.876225 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aace7e-1366-4b82-ba6f-a7dc9672273b None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:28.891419 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 416/835] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:05:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:28.891419 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aace7e-1366-4b82-ba6f-a7dc9672273b None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:28.915615 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:28.963033 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc9674-6194-4826-90a8-52faba1865ea None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:29.002366 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead6376-9b85-49c4-8c40-f4957dfab396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:29.003141 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead6376-9b85-49c4-8c40-f4957dfab396 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:29.003499 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead6376-9b85-49c4-8c40-f4957dfab396 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:29.003593 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aace7e-1366-4b82-ba6f-a7dc9672273b None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:29.004271 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead6376-9b85-49c4-8c40-f4957dfab396 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:29.004675 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead6376-9b85-49c4-8c40-f4957dfab396 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:29.006366 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead6376-9b85-49c4-8c40-f4957dfab396 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:29.015930 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-6ead6376-9b85-49c4-8c40-f4957dfab396 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 19:05:29.015930 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:29.015930 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:05:29.015930 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:05:29.015930 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:05:29.015930 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:05:29.015930 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:05:29.015930 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:05:29.015930 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 19:05:29.015930 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:29.015930 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:05:29.015930 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:29.015930 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:29.015930 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:29.015930 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:29.015930 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:29.015930 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:29.017130 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:29.017130 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:29.017130 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:29.017130 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:29.017130 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:29.017130 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:29.017130 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:05:29.017130 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:05:29.017130 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:05:29.017130 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:05:29.017130 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:29.017130 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:29.017130 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:29.017130 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:29.017130 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:29.017130 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:29.018152 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:29.018152 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:29.018152 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:29.018152 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:29.018152 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:29.018152 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:29.018152 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:29.018152 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:29.018152 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:29.018152 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:29.018152 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:05:29.018152 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:05:29.018152 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 19:05:29.018152 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:29.022738 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 420/836] 10.222.0.79 () {56 vars in 1114 bytes} [Wed Aug 31 19:05:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:29.022738 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead6376-9b85-49c4-8c40-f4957dfab396 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:29.050671 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5dd28-d133-4e7b-a07b-c23982e94353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:29.051296 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5dd28-d133-4e7b-a07b-c23982e94353 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:29.051570 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5dd28-d133-4e7b-a07b-c23982e94353 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:29.051842 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5dd28-d133-4e7b-a07b-c23982e94353 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:29.058814 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5dd28-d133-4e7b-a07b-c23982e94353 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:29.060229 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5dd28-d133-4e7b-a07b-c23982e94353 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:29.072203 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-07e5dd28-d133-4e7b-a07b-c23982e94353 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:29.072203 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:29.072203 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:29.072203 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:29.072203 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:29.072203 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:29.072203 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:29.072203 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:29.072203 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:29.072203 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:29.072203 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:29.072203 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:29.072203 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:05:29.072203 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:05:29.072203 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:05:29.073104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:05:29.073104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:29.073104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:29.073104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:29.073104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:29.073104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:29.073104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:29.073104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:29.073104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:29.073104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:29.073104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:29.073104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:29.073104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:29.073104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:29.073104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:29.073104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:29.073104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:29.073997 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:05:29.073997 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:05:29.073997 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:05:29.073997 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:05:29.073997 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:05:29.073997 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:05:29.073997 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:29.073997 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:29.073997 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 417/837] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:05:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:29.073997 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5dd28-d133-4e7b-a07b-c23982e94353 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:29.089808 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:29.138615 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead6376-9b85-49c4-8c40-f4957dfab396 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:29.165536 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:29.176084 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a2f3b-ad00-44fc-8193-3665c7b3d579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:29.176718 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a2f3b-ad00-44fc-8193-3665c7b3d579 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:29.177000 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a2f3b-ad00-44fc-8193-3665c7b3d579 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:29.177273 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a2f3b-ad00-44fc-8193-3665c7b3d579 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:29.181425 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5dd28-d133-4e7b-a07b-c23982e94353 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:29.188870 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a2f3b-ad00-44fc-8193-3665c7b3d579 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:29.190317 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a2f3b-ad00-44fc-8193-3665c7b3d579 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:29.206092 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-512a2f3b-ad00-44fc-8193-3665c7b3d579 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:29.206092 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:29.206092 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:29.206092 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:29.206092 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:29.206092 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:29.206092 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:29.206092 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:29.206092 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:29.206092 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:29.206092 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:29.206092 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:29.206092 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:29.206092 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:29.206092 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:29.206092 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:29.207241 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:29.207241 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:29.207241 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:29.207241 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:29.207241 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:29.207241 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:29.207241 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:29.207241 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:29.207241 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:29.207241 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:29.207241 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:29.207241 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:29.207241 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:29.207241 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:29.207241 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:29.207241 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:29.207241 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:29.208173 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:29.208173 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:29.208173 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:29.208173 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 421/838] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:29.208416 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a2f3b-ad00-44fc-8193-3665c7b3d579 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:29.223154 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae13914-2838-4349-86ea-5d9f69f604cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:29.223857 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae13914-2838-4349-86ea-5d9f69f604cf None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:29.224138 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae13914-2838-4349-86ea-5d9f69f604cf None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:29.224412 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae13914-2838-4349-86ea-5d9f69f604cf None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:29.225055 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae13914-2838-4349-86ea-5d9f69f604cf None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:29.225698 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae13914-2838-4349-86ea-5d9f69f604cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:29.227019 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae13914-2838-4349-86ea-5d9f69f604cf None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:29.234333 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 418/839] 10.222.0.79 () {56 vars in 1114 bytes} [Wed Aug 31 19:05:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:29.235506 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae13914-2838-4349-86ea-5d9f69f604cf None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:29.322091 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:29.327283 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a2f3b-ad00-44fc-8193-3665c7b3d579 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:29.349607 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae13914-2838-4349-86ea-5d9f69f604cf None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:29.363561 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4e128-2bc1-44d2-ba73-d09f8523806d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:29.364173 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4e128-2bc1-44d2-ba73-d09f8523806d None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:29.364445 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4e128-2bc1-44d2-ba73-d09f8523806d None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:29.364713 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4e128-2bc1-44d2-ba73-d09f8523806d None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:29.365409 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4e128-2bc1-44d2-ba73-d09f8523806d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:29.365709 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4e128-2bc1-44d2-ba73-d09f8523806d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:29.367160 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4e128-2bc1-44d2-ba73-d09f8523806d None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:29.380162 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 422/840] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 19:05:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:29.380760 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4e128-2bc1-44d2-ba73-d09f8523806d None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:29.392079 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b2f9a-ca5e-4174-8733-d37baedfa06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:29.393392 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b2f9a-ca5e-4174-8733-d37baedfa06c None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:29.394203 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b2f9a-ca5e-4174-8733-d37baedfa06c None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:29.394745 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b2f9a-ca5e-4174-8733-d37baedfa06c None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:29.395769 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b2f9a-ca5e-4174-8733-d37baedfa06c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:29.396637 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b2f9a-ca5e-4174-8733-d37baedfa06c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:29.398687 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b2f9a-ca5e-4174-8733-d37baedfa06c None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:29.418624 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 419/841] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:29.418624 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b2f9a-ca5e-4174-8733-d37baedfa06c None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:29.426511 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:29.490872 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4e128-2bc1-44d2-ba73-d09f8523806d None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:29.525024 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4bd00-298f-4f07-81df-ad185c9e3834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:29.525629 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4bd00-298f-4f07-81df-ad185c9e3834 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:29.525906 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4bd00-298f-4f07-81df-ad185c9e3834 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:29.526175 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4bd00-298f-4f07-81df-ad185c9e3834 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:29.526834 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c4bd00-298f-4f07-81df-ad185c9e3834 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:29.527139 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c4bd00-298f-4f07-81df-ad185c9e3834 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:29.528526 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c4bd00-298f-4f07-81df-ad185c9e3834 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:29.534248 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b2f9a-ca5e-4174-8733-d37baedfa06c None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:29.542530 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 423/842] 10.222.0.79 () {56 vars in 1114 bytes} [Wed Aug 31 19:05:29 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:29.542530 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4bd00-298f-4f07-81df-ad185c9e3834 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:29.592648 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b8975-d7cc-4118-881f-fd3b397f7186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:29.596065 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b8975-d7cc-4118-881f-fd3b397f7186 None admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:29.597106 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b8975-d7cc-4118-881f-fd3b397f7186 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:29.597577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b8975-d7cc-4118-881f-fd3b397f7186 None admin] PATH_INFO: `/v3/projects/f9e550ea75dd4245bd9c2bcd6322c507/users/3e070c93f47045ecb5bf0a1622395091/roles/0230e2e79da94067a82374ceada29d3f` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:29.602773 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:29.622996 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b8975-d7cc-4118-881f-fd3b397f7186 None admin] RBAC: Authorizing `identity:create_grant(project_id=f9e550ea75dd4245bd9c2bcd6322c507, user_id=3e070c93f47045ecb5bf0a1622395091, role_id=0230e2e79da94067a82374ceada29d3f)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:29.625154 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b8975-d7cc-4118-881f-fd3b397f7186 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:29.645598 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 420/843] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 19:05:29 2022] PUT /identity/v3/projects/f9e550ea75dd4245bd9c2bcd6322c507/users/3e070c93f47045ecb5bf0a1622395091/roles/0230e2e79da94067a82374ceada29d3f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:05:29.673621 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4bd00-298f-4f07-81df-ad185c9e3834 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:29.676001 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:29.716495 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14687c8a-b29c-4d35-8f5d-55a07655bd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:29.717179 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14687c8a-b29c-4d35-8f5d-55a07655bd2f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:29.717461 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14687c8a-b29c-4d35-8f5d-55a07655bd2f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:29.717735 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14687c8a-b29c-4d35-8f5d-55a07655bd2f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:29.729900 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14687c8a-b29c-4d35-8f5d-55a07655bd2f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:29.732052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14687c8a-b29c-4d35-8f5d-55a07655bd2f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:29.746827 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-14687c8a-b29c-4d35-8f5d-55a07655bd2f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 19:05:29.746827 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:29.746827 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:29.746827 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:29.746827 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:29.746827 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:29.746827 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:29.746827 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:29.746827 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:29.746827 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:29.746827 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:29.746827 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:29.746827 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:05:29.746827 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:05:29.746827 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:05:29.746827 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:05:29.747860 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:29.747860 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:29.747860 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:05:29.747860 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:29.747860 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:05:29.747860 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:29.747860 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:29.747860 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:29.747860 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:29.747860 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:29.747860 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:29.747860 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:29.747860 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:29.747860 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:29.747860 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:29.747860 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:29.747860 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:29.747860 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:29.748834 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:29.748834 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:29.748834 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:05:29.748834 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:05:29.748834 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:05:29.748834 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:05:29.748834 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:05:29.748834 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:05:29.748834 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 19:05:29.748834 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:29.748834 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 424/844] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 19:05:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:29.754071 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b8975-d7cc-4118-881f-fd3b397f7186 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:29.873160 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b8975-d7cc-4118-881f-fd3b397f7186 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:29.912035 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827c9ef-633e-4821-9678-175be1b84c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:29.912641 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827c9ef-633e-4821-9678-175be1b84c86 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:29.912915 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827c9ef-633e-4821-9678-175be1b84c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:29.913180 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827c9ef-633e-4821-9678-175be1b84c86 None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:29.913906 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827c9ef-633e-4821-9678-175be1b84c86 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:29.914204 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827c9ef-633e-4821-9678-175be1b84c86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:29.915648 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827c9ef-633e-4821-9678-175be1b84c86 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:29.934020 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 421/845] 10.222.0.79 () {56 vars in 1135 bytes} [Wed Aug 31 19:05:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:05:29.940117 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14687c8a-b29c-4d35-8f5d-55a07655bd2f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:30.050340 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14687c8a-b29c-4d35-8f5d-55a07655bd2f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:30.087450 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85619024-0a80-4523-b9aa-decf05947526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:30.088426 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85619024-0a80-4523-b9aa-decf05947526 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:30.088910 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85619024-0a80-4523-b9aa-decf05947526 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:30.089383 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85619024-0a80-4523-b9aa-decf05947526 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:30.121643 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:30.162189 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85619024-0a80-4523-b9aa-decf05947526 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:30.163604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85619024-0a80-4523-b9aa-decf05947526 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:30.268099 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 425/846] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:05:29 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:05:30.273559 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827c9ef-633e-4821-9678-175be1b84c86 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:30.330448 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:30.393877 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827c9ef-633e-4821-9678-175be1b84c86 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:30.434389 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432422a-8d3e-4402-a9c0-7ead781e521a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:30.434973 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432422a-8d3e-4402-a9c0-7ead781e521a None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:30.435254 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432422a-8d3e-4402-a9c0-7ead781e521a None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:30.435527 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432422a-8d3e-4402-a9c0-7ead781e521a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:30.446231 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f432422a-8d3e-4402-a9c0-7ead781e521a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:30.447706 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f432422a-8d3e-4402-a9c0-7ead781e521a None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:30.462661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-f432422a-8d3e-4402-a9c0-7ead781e521a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:30.462661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:30.462661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:30.462661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:30.462661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:30.462661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:30.462661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:30.462661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:30.462661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:30.462661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:30.462661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:30.462661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:30.462661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:30.462661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:30.462661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:30.462661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:30.464389 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:30.464389 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:30.464389 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:30.464389 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:30.464389 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:30.464389 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:30.464389 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:30.464389 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:30.464389 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:30.464389 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:30.464389 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:30.464389 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:30.464389 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:30.464389 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:30.464389 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:30.464389 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:30.464389 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:30.466066 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:30.466066 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:30.466066 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:30.466066 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 422/847] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:30.470181 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85619024-0a80-4523-b9aa-decf05947526 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:30.542845 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:30.574304 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85619024-0a80-4523-b9aa-decf05947526 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:30.598692 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d8216-4888-4aa9-95ac-a2e7c89e03ac None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:30.598692 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d8216-4888-4aa9-95ac-a2e7c89e03ac None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:30.599267 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d8216-4888-4aa9-95ac-a2e7c89e03ac None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:30.600587 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 423/848] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:05:30.607713 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22904fbc-9acd-4036-b54e-cc248ad0f262 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:30.607993 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22904fbc-9acd-4036-b54e-cc248ad0f262 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:30.608264 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22904fbc-9acd-4036-b54e-cc248ad0f262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:30.613501 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b213d3b-75c7-4b72-aa8b-683e28c1d712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:30.614375 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b213d3b-75c7-4b72-aa8b-683e28c1d712 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:30.614919 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b213d3b-75c7-4b72-aa8b-683e28c1d712 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:30.615417 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b213d3b-75c7-4b72-aa8b-683e28c1d712 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:30.616076 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b213d3b-75c7-4b72-aa8b-683e28c1d712 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:30.616383 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b213d3b-75c7-4b72-aa8b-683e28c1d712 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:30.617860 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b213d3b-75c7-4b72-aa8b-683e28c1d712 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:30.629028 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-22904fbc-9acd-4036-b54e-cc248ad0f262 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:30.630555 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-22904fbc-9acd-4036-b54e-cc248ad0f262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:30.632373 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 426/849] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:30.641759 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b213d3b-75c7-4b72-aa8b-683e28c1d712 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:30.717602 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 424/850] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:30 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:05:30.759614 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b213d3b-75c7-4b72-aa8b-683e28c1d712 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:30.783709 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:30.796068 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae234d-afcf-4f06-994d-2256def62f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:30.796698 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae234d-afcf-4f06-994d-2256def62f8a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:30.796976 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae234d-afcf-4f06-994d-2256def62f8a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:30.797752 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae234d-afcf-4f06-994d-2256def62f8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:30.804869 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae234d-afcf-4f06-994d-2256def62f8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:30.806363 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae234d-afcf-4f06-994d-2256def62f8a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:30.818224 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-efae234d-afcf-4f06-994d-2256def62f8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:30.818224 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:30.818224 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:30.818224 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:30.818224 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:30.818224 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:30.818224 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:30.818224 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:30.818224 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:30.818224 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:30.818224 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:30.818224 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:30.818224 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:05:30.818224 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:05:30.818224 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:05:30.819129 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:05:30.819129 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:30.819129 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:30.819129 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:30.819129 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:30.819129 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:30.819129 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:30.819129 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:30.819129 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:30.819129 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:30.819129 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:30.819129 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:30.819129 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:30.819129 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:30.819129 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:30.819129 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:30.819129 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:30.820006 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:05:30.820006 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:05:30.820006 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:05:30.820006 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:05:30.820006 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:05:30.820006 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:05:30.820006 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:30.820006 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:30.824243 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 427/851] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:05:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:30.825585 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22904fbc-9acd-4036-b54e-cc248ad0f262 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:30.853448 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:30.939061 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22904fbc-9acd-4036-b54e-cc248ad0f262 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:30.973602 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692e19a-fe56-44ff-ac06-05edfa91c4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:30.974129 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692e19a-fe56-44ff-ac06-05edfa91c4b5 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:30.974401 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692e19a-fe56-44ff-ac06-05edfa91c4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:30.974700 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692e19a-fe56-44ff-ac06-05edfa91c4b5 None admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:30.975497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692e19a-fe56-44ff-ac06-05edfa91c4b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:30.975803 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692e19a-fe56-44ff-ac06-05edfa91c4b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:30.977477 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692e19a-fe56-44ff-ac06-05edfa91c4b5 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:30.989977 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 425/852] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 19:05:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:30.991043 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae234d-afcf-4f06-994d-2256def62f8a None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:30.997402 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692e19a-fe56-44ff-ac06-05edfa91c4b5 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:31.101290 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae234d-afcf-4f06-994d-2256def62f8a None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:31.110877 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:31.127735 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692e19a-fe56-44ff-ac06-05edfa91c4b5 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:31.152202 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca93105-66f6-451d-a163-a67cca32f03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:31.153294 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca93105-66f6-451d-a163-a67cca32f03d None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:31.153873 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca93105-66f6-451d-a163-a67cca32f03d None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:31.154393 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca93105-66f6-451d-a163-a67cca32f03d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:31.155207 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca93105-66f6-451d-a163-a67cca32f03d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:31.157495 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca93105-66f6-451d-a163-a67cca32f03d None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:31.167495 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-fca93105-66f6-451d-a163-a67cca32f03d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 19:05:31.167495 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:31.167495 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:05:31.167495 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:05:31.167495 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:05:31.167495 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:05:31.167495 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:05:31.167495 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:05:31.167495 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 19:05:31.167495 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:31.167495 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:05:31.167495 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:31.167495 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:31.167495 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:31.167495 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:31.167495 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:31.168448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:31.168448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:31.168448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:31.168448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:31.168448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:31.168448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:31.168448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:31.168448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:05:31.168448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:05:31.168448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:05:31.168448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:05:31.168448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:31.168448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:31.168448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:31.168448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:31.168448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:31.168448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:31.169321 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:31.169321 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:31.169321 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:31.169321 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:31.169321 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:31.169321 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:31.169321 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:31.169321 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:31.169321 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:31.169321 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:31.169321 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:05:31.169321 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:05:31.169321 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 19:05:31.169321 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:31.171787 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 428/853] 10.222.0.79 () {56 vars in 1132 bytes} [Wed Aug 31 19:05:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:31.177176 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b50fb7-bc65-4e90-b0fd-0741551f4cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:31.178205 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca93105-66f6-451d-a163-a67cca32f03d None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:31.179191 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b50fb7-bc65-4e90-b0fd-0741551f4cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:31.179740 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b50fb7-bc65-4e90-b0fd-0741551f4cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:31.180219 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b50fb7-bc65-4e90-b0fd-0741551f4cd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:31.181164 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b50fb7-bc65-4e90-b0fd-0741551f4cd7 None admin] RBAC: Adding query filter params (role.id=edc551338adb4ae88bdafc591ad69582, scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507, user.id=3b289a0bef53460ca5173ad946394d72) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:31.181739 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b50fb7-bc65-4e90-b0fd-0741551f4cd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:31.183537 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b50fb7-bc65-4e90-b0fd-0741551f4cd7 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:31.190736 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 426/854] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:05:30 2022] GET /identity/v3/role_assignments?user.id=3b289a0bef53460ca5173ad946394d72&scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507&role.id=edc551338adb4ae88bdafc591ad69582 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:05:31.241756 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:31.301740 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca93105-66f6-451d-a163-a67cca32f03d None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:31.340469 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d820559-b3e6-4798-b660-1e43f0357d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:31.341099 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d820559-b3e6-4798-b660-1e43f0357d0f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:31.341426 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d820559-b3e6-4798-b660-1e43f0357d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:31.341704 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d820559-b3e6-4798-b660-1e43f0357d0f None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:31.342350 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d820559-b3e6-4798-b660-1e43f0357d0f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:31.342690 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d820559-b3e6-4798-b660-1e43f0357d0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:31.344063 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d820559-b3e6-4798-b660-1e43f0357d0f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:31.349538 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 429/855] 10.222.0.79 () {56 vars in 1126 bytes} [Wed Aug 31 19:05:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:31.356117 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b50fb7-bc65-4e90-b0fd-0741551f4cd7 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:31.469120 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b50fb7-bc65-4e90-b0fd-0741551f4cd7 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:31.506020 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0f0c8-a75d-4a7e-a8d2-0fc5569b7c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:31.506588 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0f0c8-a75d-4a7e-a8d2-0fc5569b7c64 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:31.506876 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0f0c8-a75d-4a7e-a8d2-0fc5569b7c64 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:31.507146 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0f0c8-a75d-4a7e-a8d2-0fc5569b7c64 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:31.507849 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c0f0c8-a75d-4a7e-a8d2-0fc5569b7c64 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:31.508156 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c0f0c8-a75d-4a7e-a8d2-0fc5569b7c64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:31.509511 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c0f0c8-a75d-4a7e-a8d2-0fc5569b7c64 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:31.514916 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 427/856] 10.222.0.79 () {56 vars in 1126 bytes} [Wed Aug 31 19:05:31 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:31.681682 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a9797-9543-46cc-a6ba-bd97fb90975a None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:31.682188 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a9797-9543-46cc-a6ba-bd97fb90975a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:31.682442 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a9797-9543-46cc-a6ba-bd97fb90975a None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:31.684415 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 430/857] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:05:31.690227 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228bd37-9eb4-4af7-9e74-f310ac5aa950 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:31.690691 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228bd37-9eb4-4af7-9e74-f310ac5aa950 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:31.690876 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228bd37-9eb4-4af7-9e74-f310ac5aa950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:31.709715 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-5228bd37-9eb4-4af7-9e74-f310ac5aa950 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:31.710951 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-5228bd37-9eb4-4af7-9e74-f310ac5aa950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:31.721106 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:31.734033 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355db332-aca8-4073-9649-56f534722984 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:31.734357 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355db332-aca8-4073-9649-56f534722984 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:31.734606 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355db332-aca8-4073-9649-56f534722984 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:31.736688 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 431/858] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:05:31.741538 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2cea1-56a6-44e8-abec-656a8c73e6c1 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:31.741820 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2cea1-56a6-44e8-abec-656a8c73e6c1 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:31.742092 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2cea1-56a6-44e8-abec-656a8c73e6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:31.764903 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-c8a2cea1-56a6-44e8-abec-656a8c73e6c1 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:31.766158 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c8a2cea1-56a6-44e8-abec-656a8c73e6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:31.789235 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 428/859] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:31 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:05:31.841686 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 432/860] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:31 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:05:32.058451 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5228bd37-9eb4-4af7-9e74-f310ac5aa950 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:32.122191 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2cea1-56a6-44e8-abec-656a8c73e6c1 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:32.164615 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5228bd37-9eb4-4af7-9e74-f310ac5aa950 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:32.166804 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:32.200144 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e833a-6fd7-41e3-9520-e8e2accf1f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:32.200765 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e833a-6fd7-41e3-9520-e8e2accf1f08 None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:32.201046 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e833a-6fd7-41e3-9520-e8e2accf1f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:32.201324 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e833a-6fd7-41e3-9520-e8e2accf1f08 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:32.201995 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e833a-6fd7-41e3-9520-e8e2accf1f08 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:32.203398 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e833a-6fd7-41e3-9520-e8e2accf1f08 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:32.222264 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 429/861] 10.222.0.79 () {60 vars in 1141 bytes} [Wed Aug 31 19:05:32 2022] POST /identity/v3/services => generated 251 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:05:32.240822 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2cea1-56a6-44e8-abec-656a8c73e6c1 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:32.292966 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2377f0-2ee4-4209-8aff-42198e733013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:32.294073 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2377f0-2ee4-4209-8aff-42198e733013 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:32.294571 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2377f0-2ee4-4209-8aff-42198e733013 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:32.295050 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2377f0-2ee4-4209-8aff-42198e733013 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:32.309444 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2377f0-2ee4-4209-8aff-42198e733013 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:05:32.315475 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-7c2377f0-2ee4-4209-8aff-42198e733013 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:05:32.315475 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:32.315475 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:32.315475 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:32.315475 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:32.315475 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:32.315475 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:32.315475 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:32.315475 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:32.315475 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:32.315475 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:32.315475 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:32.315475 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:05:32.315475 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:05:32.315475 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:05:32.315475 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:05:32.316726 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:05:32.316726 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:05:32.316726 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:05:32.316726 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:05:32.316726 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:32.316726 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:32.316726 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:32.316726 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:32.316726 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:32.316726 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:32.316726 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:32.316726 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:32.316726 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:32.316726 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:32.316726 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:32.316726 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:32.317824 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:32.317824 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:32.317824 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:32.317824 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:32.317824 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:05:32.317824 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:05:32.317824 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:05:32.317824 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:05:32.317824 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:05:32.317824 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:05:32.317824 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:05:32.317824 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:32.320450 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 433/862] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 19:05:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:05:32.326757 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e833a-6fd7-41e3-9520-e8e2accf1f08 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:32.331634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:32.451894 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e833a-6fd7-41e3-9520-e8e2accf1f08 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:32.488107 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936f496-a343-4343-9367-46b705d8f53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:32.488722 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936f496-a343-4343-9367-46b705d8f53f None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:32.489001 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936f496-a343-4343-9367-46b705d8f53f None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:32.489275 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936f496-a343-4343-9367-46b705d8f53f None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:32.489940 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0936f496-a343-4343-9367-46b705d8f53f None admin] RBAC: Adding query filter params (name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:32.490242 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0936f496-a343-4343-9367-46b705d8f53f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:32.491641 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0936f496-a343-4343-9367-46b705d8f53f None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:32.500707 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 430/863] 10.222.0.79 () {56 vars in 1103 bytes} [Wed Aug 31 19:05:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:32.505983 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2377f0-2ee4-4209-8aff-42198e733013 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:32.610633 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:32.618509 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2377f0-2ee4-4209-8aff-42198e733013 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:32.658563 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5669522-c72d-47e9-ac6e-51a640945909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:32.659207 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5669522-c72d-47e9-ac6e-51a640945909 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:32.659511 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5669522-c72d-47e9-ac6e-51a640945909 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:32.659785 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5669522-c72d-47e9-ac6e-51a640945909 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:32.670888 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5669522-c72d-47e9-ac6e-51a640945909 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:32.672446 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5669522-c72d-47e9-ac6e-51a640945909 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:32.688631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-e5669522-c72d-47e9-ac6e-51a640945909 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:32.688631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:32.688631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:32.688631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:32.688631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:32.688631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:32.688631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:32.688631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:32.688631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:32.688631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:32.688631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:32.688631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:32.688631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:32.688631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:32.688631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:32.688631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:32.690157 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:32.690157 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:32.690157 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:32.690157 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:32.690157 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:32.690157 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:32.690157 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:32.690157 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:32.690157 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:32.690157 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:32.690157 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:32.690157 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:32.690157 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:32.690157 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:32.690157 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:32.690157 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:32.690157 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:32.691075 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:32.691075 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:32.691075 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:32.691075 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 434/864] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:32.696183 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936f496-a343-4343-9367-46b705d8f53f None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:32.769080 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:32.807825 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936f496-a343-4343-9367-46b705d8f53f None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:32.843916 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae279385-9361-49c0-8ee0-c4dce1081485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:32.845446 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae279385-9361-49c0-8ee0-c4dce1081485 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:32.845924 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae279385-9361-49c0-8ee0-c4dce1081485 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:32.846398 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae279385-9361-49c0-8ee0-c4dce1081485 None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:32.847263 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae279385-9361-49c0-8ee0-c4dce1081485 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:32.847772 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae279385-9361-49c0-8ee0-c4dce1081485 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:32.849344 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae279385-9361-49c0-8ee0-c4dce1081485 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:32.863892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 431/865] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:32.872025 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5669522-c72d-47e9-ac6e-51a640945909 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:32.987428 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5669522-c72d-47e9-ac6e-51a640945909 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:33.023983 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec09cb8-6bfe-4d01-b683-ac8ba16edae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:33.024615 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec09cb8-6bfe-4d01-b683-ac8ba16edae9 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:33.024896 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec09cb8-6bfe-4d01-b683-ac8ba16edae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:33.025164 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec09cb8-6bfe-4d01-b683-ac8ba16edae9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:33.033288 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec09cb8-6bfe-4d01-b683-ac8ba16edae9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:33.034756 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec09cb8-6bfe-4d01-b683-ac8ba16edae9 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:33.046283 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-8ec09cb8-6bfe-4d01-b683-ac8ba16edae9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 19:05:33.046283 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:33.046283 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:33.046283 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:33.046283 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:33.046283 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:33.046283 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:33.046283 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:33.046283 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:33.046283 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:33.046283 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:33.046283 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:33.046283 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:05:33.046283 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:05:33.046283 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:05:33.046283 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:05:33.047787 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:33.047787 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:33.047787 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:05:33.047787 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:33.047787 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:05:33.047787 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:33.047787 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:33.047787 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:33.047787 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:33.047787 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:33.047787 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:33.047787 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:33.047787 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:33.047787 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:33.047787 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:33.047787 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:33.047787 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:33.047787 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:33.048735 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:33.048735 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:33.048735 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:05:33.048735 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:05:33.048735 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:05:33.048735 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:05:33.048735 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:05:33.048735 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:05:33.048735 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 19:05:33.048735 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:33.048735 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 435/866] 10.222.0.79 () {56 vars in 1117 bytes} [Wed Aug 31 19:05:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:33.054119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae279385-9361-49c0-8ee0-c4dce1081485 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:33.161217 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae279385-9361-49c0-8ee0-c4dce1081485 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:33.190674 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:33.202215 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de0881c-f3f5-4250-8612-f7c72d2407b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:33.202851 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0881c-f3f5-4250-8612-f7c72d2407b1 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:33.203127 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0881c-f3f5-4250-8612-f7c72d2407b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:33.203425 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0881c-f3f5-4250-8612-f7c72d2407b1 None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:33.204408 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de0881c-f3f5-4250-8612-f7c72d2407b1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:33.204874 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de0881c-f3f5-4250-8612-f7c72d2407b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:33.206387 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de0881c-f3f5-4250-8612-f7c72d2407b1 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:33.227436 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 432/867] 10.222.0.79 () {56 vars in 1149 bytes} [Wed Aug 31 19:05:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:33.232723 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec09cb8-6bfe-4d01-b683-ac8ba16edae9 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:33.255813 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:33.268452 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa955b9b-7529-467e-852e-0e64484d5e43 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:33.268743 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa955b9b-7529-467e-852e-0e64484d5e43 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:33.269069 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa955b9b-7529-467e-852e-0e64484d5e43 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:33.270561 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 433/868] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:05:33.275484 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9052f-d9cd-4c16-a5bc-8acdd6fd8067 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:33.275779 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9052f-d9cd-4c16-a5bc-8acdd6fd8067 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:33.276074 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9052f-d9cd-4c16-a5bc-8acdd6fd8067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:33.295636 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-7ff9052f-d9cd-4c16-a5bc-8acdd6fd8067 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:33.296930 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-7ff9052f-d9cd-4c16-a5bc-8acdd6fd8067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:33.374364 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec09cb8-6bfe-4d01-b683-ac8ba16edae9 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:33.394651 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 434/869] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:33 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:05:33.421687 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be0ce7-c1e9-4738-b754-2df65421a20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:33.422576 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be0ce7-c1e9-4738-b754-2df65421a20a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:33.423002 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be0ce7-c1e9-4738-b754-2df65421a20a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:33.423420 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be0ce7-c1e9-4738-b754-2df65421a20a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:33.488405 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a57886-6e03-4664-9771-162719e21b3b None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:33.488756 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a57886-6e03-4664-9771-162719e21b3b None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:33.488960 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a57886-6e03-4664-9771-162719e21b3b None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:33.490569 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 435/870] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:05:33.495688 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad1793-c9e9-467e-8c6f-8a497b4a11f2 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:33.495982 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad1793-c9e9-467e-8c6f-8a497b4a11f2 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:33.496262 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad1793-c9e9-467e-8c6f-8a497b4a11f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:33.505349 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be0ce7-c1e9-4738-b754-2df65421a20a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:33.506920 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be0ce7-c1e9-4738-b754-2df65421a20a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:33.518768 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-2aad1793-c9e9-467e-8c6f-8a497b4a11f2 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:33.520379 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-2aad1793-c9e9-467e-8c6f-8a497b4a11f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:33.520954 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:33.622596 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 436/871] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:33 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:05:33.631907 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 436/872] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:05:33 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:05:33.638062 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad1793-c9e9-467e-8c6f-8a497b4a11f2 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:33.688499 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:33.693104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be0ce7-c1e9-4738-b754-2df65421a20a None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:33.756174 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad1793-c9e9-467e-8c6f-8a497b4a11f2 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:33.800095 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c328dd-9bf6-44ca-8274-6c58a5f31083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:33.801097 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c328dd-9bf6-44ca-8274-6c58a5f31083 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:33.801575 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c328dd-9bf6-44ca-8274-6c58a5f31083 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:33.802070 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c328dd-9bf6-44ca-8274-6c58a5f31083 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:33.819265 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be0ce7-c1e9-4738-b754-2df65421a20a None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:33.822285 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c328dd-9bf6-44ca-8274-6c58a5f31083 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:33.824049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c328dd-9bf6-44ca-8274-6c58a5f31083 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:33.835313 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:33.844179 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-53c328dd-9bf6-44ca-8274-6c58a5f31083 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:33.844179 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:33.844179 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:33.844179 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:33.844179 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:33.844179 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:33.844179 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:33.844179 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:33.844179 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:33.844179 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:33.844179 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:33.844179 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:33.844179 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:33.844179 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:33.844179 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:33.844179 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:33.846004 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:33.846004 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:33.846004 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:33.846004 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:33.846004 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:33.846004 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:33.846004 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:33.846004 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:33.846004 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:33.846004 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:33.846004 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:33.846004 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:33.846004 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:33.846004 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:33.846004 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:33.846004 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:33.846004 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:33.847416 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:33.847416 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:33.847416 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:33.850217 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 437/873] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:33.855494 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c328dd-9bf6-44ca-8274-6c58a5f31083 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:33.870336 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8177980d-680e-446b-a5bd-a4bcfc6f2fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:33.871414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177980d-680e-446b-a5bd-a4bcfc6f2fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:33.871948 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177980d-680e-446b-a5bd-a4bcfc6f2fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:33.872425 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177980d-680e-446b-a5bd-a4bcfc6f2fe1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:33.873222 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8177980d-680e-446b-a5bd-a4bcfc6f2fe1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:33.874815 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8177980d-680e-446b-a5bd-a4bcfc6f2fe1 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:33.885365 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-8177980d-680e-446b-a5bd-a4bcfc6f2fe1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:05:33.885365 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:33.885365 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:05:33.885365 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:05:33.885365 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:05:33.885365 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:05:33.885365 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:05:33.885365 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:05:33.885365 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:05:33.885365 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:33.885365 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:05:33.885365 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:33.885365 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:33.885365 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:33.885365 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:33.885365 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:33.885365 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:33.886582 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:33.886582 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:33.886582 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:33.886582 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:33.886582 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:33.886582 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:33.886582 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:05:33.886582 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:05:33.886582 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:05:33.886582 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:05:33.886582 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:33.886582 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:33.886582 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:33.886582 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:33.886582 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:33.886582 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:33.887437 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:33.887437 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:33.887437 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:33.887437 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:33.887437 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:33.887437 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:33.887437 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:33.887437 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:33.887437 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:33.887437 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:33.887437 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:05:33.887437 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:05:33.887437 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:05:33.887437 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:33.893900 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 437/874] 10.222.0.79 () {56 vars in 1126 bytes} [Wed Aug 31 19:05:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:33.895463 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8177980d-680e-446b-a5bd-a4bcfc6f2fe1 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:33.968909 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:33.975198 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c328dd-9bf6-44ca-8274-6c58a5f31083 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:34.011390 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac251301-8fcd-4078-9178-5f8403af34f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:34.012265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac251301-8fcd-4078-9178-5f8403af34f4 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:34.012790 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac251301-8fcd-4078-9178-5f8403af34f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:34.013248 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac251301-8fcd-4078-9178-5f8403af34f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:34.013957 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac251301-8fcd-4078-9178-5f8403af34f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:34.014340 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac251301-8fcd-4078-9178-5f8403af34f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:34.016075 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac251301-8fcd-4078-9178-5f8403af34f4 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:34.020088 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8177980d-680e-446b-a5bd-a4bcfc6f2fe1 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:34.029937 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 438/875] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:05:34.029937 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac251301-8fcd-4078-9178-5f8403af34f4 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:34.068307 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01e781-8698-4930-8f5d-ec04716bc027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:34.069015 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01e781-8698-4930-8f5d-ec04716bc027 None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:34.069278 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01e781-8698-4930-8f5d-ec04716bc027 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:34.069553 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01e781-8698-4930-8f5d-ec04716bc027 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:34.070233 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c01e781-8698-4930-8f5d-ec04716bc027 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:34.071613 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c01e781-8698-4930-8f5d-ec04716bc027 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:34.095686 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 438/876] 10.222.0.79 () {60 vars in 1141 bytes} [Wed Aug 31 19:05:33 2022] POST /identity/v3/services => generated 269 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:05:34.097137 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01e781-8698-4930-8f5d-ec04716bc027 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:34.147047 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:34.186190 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac251301-8fcd-4078-9178-5f8403af34f4 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:34.248806 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01e781-8698-4930-8f5d-ec04716bc027 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:34.249508 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25c1b0-f9dd-486e-9698-482cb85dc7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:34.250882 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25c1b0-f9dd-486e-9698-482cb85dc7c2 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:34.251262 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25c1b0-f9dd-486e-9698-482cb85dc7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:34.251663 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25c1b0-f9dd-486e-9698-482cb85dc7c2 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:34.252719 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a25c1b0-f9dd-486e-9698-482cb85dc7c2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:34.253215 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a25c1b0-f9dd-486e-9698-482cb85dc7c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:34.256943 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a25c1b0-f9dd-486e-9698-482cb85dc7c2 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:34.268811 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 439/877] 10.222.0.79 () {56 vars in 1122 bytes} [Wed Aug 31 19:05:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:34.270517 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25c1b0-f9dd-486e-9698-482cb85dc7c2 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:34.288661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:34.292985 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a209ff7-0c5a-41a9-ae19-c68a931e121c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:34.294750 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a209ff7-0c5a-41a9-ae19-c68a931e121c None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:34.295228 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a209ff7-0c5a-41a9-ae19-c68a931e121c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:34.295510 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a209ff7-0c5a-41a9-ae19-c68a931e121c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:34.306750 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a209ff7-0c5a-41a9-ae19-c68a931e121c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:34.308199 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a209ff7-0c5a-41a9-ae19-c68a931e121c None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:34.322248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-7a209ff7-0c5a-41a9-ae19-c68a931e121c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:34.322248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:34.322248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:34.322248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:34.322248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:34.322248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:34.322248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:34.322248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:34.322248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:34.322248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:34.322248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:34.322248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:34.322248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:05:34.322248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:05:34.322248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:05:34.323366 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:05:34.323366 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:34.323366 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:34.323366 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:34.323366 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:34.323366 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:34.323366 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:34.323366 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:34.323366 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:34.323366 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:34.323366 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:34.323366 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:34.323366 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:34.323366 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:34.323366 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:34.323366 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:34.323366 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:34.324412 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:05:34.324412 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:05:34.324412 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:05:34.324412 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:05:34.324412 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:05:34.324412 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:05:34.324412 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:34.324412 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:34.326133 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 439/878] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:05:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:34.333303 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a209ff7-0c5a-41a9-ae19-c68a931e121c None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:34.419489 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25c1b0-f9dd-486e-9698-482cb85dc7c2 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:34.442924 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:34.458315 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a209ff7-0c5a-41a9-ae19-c68a931e121c None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:34.470537 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f64ce-ef9d-484e-88b1-26ec038e90cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:34.471158 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f64ce-ef9d-484e-88b1-26ec038e90cf None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:34.471439 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f64ce-ef9d-484e-88b1-26ec038e90cf None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:34.471712 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f64ce-ef9d-484e-88b1-26ec038e90cf None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:34.472352 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f64ce-ef9d-484e-88b1-26ec038e90cf None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:34.472655 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f64ce-ef9d-484e-88b1-26ec038e90cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:34.474016 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f64ce-ef9d-484e-88b1-26ec038e90cf None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:34.478944 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 440/879] 10.222.0.79 () {56 vars in 1122 bytes} [Wed Aug 31 19:05:34 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:34.480132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bb91c-3840-427f-a18a-465196cc37d4 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:34.480414 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bb91c-3840-427f-a18a-465196cc37d4 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:34.480690 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bb91c-3840-427f-a18a-465196cc37d4 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:34.482496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 441/880] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:05:34.488361 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb457db-7d7b-4687-8e54-a1e22ef33d6f None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:34.488967 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb457db-7d7b-4687-8e54-a1e22ef33d6f None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:34.489424 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb457db-7d7b-4687-8e54-a1e22ef33d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:34.507872 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6e579-31e8-4581-87d7-4cb790943880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:34.508520 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6e579-31e8-4581-87d7-4cb790943880 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:34.508867 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6e579-31e8-4581-87d7-4cb790943880 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:34.509208 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6e579-31e8-4581-87d7-4cb790943880 None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:34.510118 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6e579-31e8-4581-87d7-4cb790943880 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:34.510524 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6e579-31e8-4581-87d7-4cb790943880 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:34.512095 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6e579-31e8-4581-87d7-4cb790943880 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:34.514313 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-3fb457db-7d7b-4687-8e54-a1e22ef33d6f None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:34.515941 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-3fb457db-7d7b-4687-8e54-a1e22ef33d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:34.529748 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 440/881] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 19:05:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:34.533124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6e579-31e8-4581-87d7-4cb790943880 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:34.625505 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 442/882] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:34 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:05:34.656401 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6e579-31e8-4581-87d7-4cb790943880 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:34.693152 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca8fe7-9f32-410c-abd8-72f349589e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:34.693788 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca8fe7-9f32-410c-abd8-72f349589e03 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:34.694040 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca8fe7-9f32-410c-abd8-72f349589e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:34.694301 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca8fe7-9f32-410c-abd8-72f349589e03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:34.695150 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca8fe7-9f32-410c-abd8-72f349589e03 None admin] RBAC: Adding query filter params (role.id=0230e2e79da94067a82374ceada29d3f, scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507, user.id=3e070c93f47045ecb5bf0a1622395091) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:34.695459 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca8fe7-9f32-410c-abd8-72f349589e03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:34.696887 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca8fe7-9f32-410c-abd8-72f349589e03 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:34.712985 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 441/883] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:05:34 2022] GET /identity/v3/role_assignments?user.id=3e070c93f47045ecb5bf0a1622395091&scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507&role.id=0230e2e79da94067a82374ceada29d3f => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:34.899173 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb457db-7d7b-4687-8e54-a1e22ef33d6f None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:34.912214 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:35.016539 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb457db-7d7b-4687-8e54-a1e22ef33d6f None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:35.059001 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a9d39f-d292-4ac9-9fc5-90463d328ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:35.059998 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9d39f-d292-4ac9-9fc5-90463d328ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:35.060503 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9d39f-d292-4ac9-9fc5-90463d328ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:35.060971 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9d39f-d292-4ac9-9fc5-90463d328ea0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:35.061750 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a9d39f-d292-4ac9-9fc5-90463d328ea0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:35.063883 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a9d39f-d292-4ac9-9fc5-90463d328ea0 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:35.073592 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-b9a9d39f-d292-4ac9-9fc5-90463d328ea0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 19:05:35.073592 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:35.073592 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:05:35.073592 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:05:35.073592 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:05:35.073592 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:05:35.073592 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:05:35.073592 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:05:35.073592 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 19:05:35.073592 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:35.073592 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:05:35.073592 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:35.073592 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:35.073592 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:35.073592 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:35.073592 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:35.073592 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:35.074635 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:35.074635 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:35.074635 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:35.074635 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:35.074635 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:35.074635 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:35.074635 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:05:35.074635 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:05:35.074635 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:05:35.074635 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:05:35.074635 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:35.074635 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:35.074635 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:35.074635 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:35.074635 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:35.074635 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:35.075497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:35.075497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:35.075497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:35.075497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:35.075497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:35.075497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:35.075497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:35.075497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:35.075497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:35.075497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:35.075497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:05:35.075497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:05:35.075497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 19:05:35.075497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:35.078346 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 443/884] 10.222.0.79 () {56 vars in 1114 bytes} [Wed Aug 31 19:05:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:35.085324 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca8fe7-9f32-410c-abd8-72f349589e03 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:35.107299 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:35.219835 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca8fe7-9f32-410c-abd8-72f349589e03 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:35.256831 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20357ff5-7e29-488a-8d9e-1d42a8847406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:35.257447 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20357ff5-7e29-488a-8d9e-1d42a8847406 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:35.257730 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20357ff5-7e29-488a-8d9e-1d42a8847406 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:35.258004 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20357ff5-7e29-488a-8d9e-1d42a8847406 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:35.258671 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20357ff5-7e29-488a-8d9e-1d42a8847406 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:35.258977 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20357ff5-7e29-488a-8d9e-1d42a8847406 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:35.260346 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20357ff5-7e29-488a-8d9e-1d42a8847406 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:35.266339 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 442/885] 10.222.0.79 () {56 vars in 1114 bytes} [Wed Aug 31 19:05:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:35.274784 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a9d39f-d292-4ac9-9fc5-90463d328ea0 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:35.377032 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:35.404047 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a9d39f-d292-4ac9-9fc5-90463d328ea0 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:35.439173 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d49b00-0c3c-4c27-82b3-738ee49006b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:35.440079 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d49b00-0c3c-4c27-82b3-738ee49006b6 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:35.440551 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d49b00-0c3c-4c27-82b3-738ee49006b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:35.441041 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d49b00-0c3c-4c27-82b3-738ee49006b6 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:35.441960 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d49b00-0c3c-4c27-82b3-738ee49006b6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:35.442527 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d49b00-0c3c-4c27-82b3-738ee49006b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:35.444060 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d49b00-0c3c-4c27-82b3-738ee49006b6 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:35.449529 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 444/886] 10.222.0.79 () {56 vars in 1114 bytes} [Wed Aug 31 19:05:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:35.455218 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20357ff5-7e29-488a-8d9e-1d42a8847406 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:35.545362 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:35.561407 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20357ff5-7e29-488a-8d9e-1d42a8847406 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:35.595975 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff5744-5e53-4e9b-be12-1d95c633cb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:35.596582 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff5744-5e53-4e9b-be12-1d95c633cb4e None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:35.596860 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff5744-5e53-4e9b-be12-1d95c633cb4e None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:35.597127 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff5744-5e53-4e9b-be12-1d95c633cb4e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:35.598167 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff5744-5e53-4e9b-be12-1d95c633cb4e None admin] RBAC: Adding query filter params (interface=public, service_id=79bccd00bda3440e8ff8c64130dbb1fd, region_id=RegionOne) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:35.598547 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff5744-5e53-4e9b-be12-1d95c633cb4e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:35.599919 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff5744-5e53-4e9b-be12-1d95c633cb4e None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:35.605778 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 443/887] 10.222.0.79 () {56 vars in 1251 bytes} [Wed Aug 31 19:05:35 2022] GET /identity/v3/endpoints?service_id=79bccd00bda3440e8ff8c64130dbb1fd&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:35.611529 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d49b00-0c3c-4c27-82b3-738ee49006b6 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:35.727518 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d49b00-0c3c-4c27-82b3-738ee49006b6 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:35.764315 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8c9de-e6fd-4d1e-a73b-708562b63b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:35.765284 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8c9de-e6fd-4d1e-a73b-708562b63b75 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:35.765812 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8c9de-e6fd-4d1e-a73b-708562b63b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:35.766284 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8c9de-e6fd-4d1e-a73b-708562b63b75 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:35.767103 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8c9de-e6fd-4d1e-a73b-708562b63b75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:35.768661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8c9de-e6fd-4d1e-a73b-708562b63b75 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:35.775103 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 445/888] 10.222.0.79 () {56 vars in 1087 bytes} [Wed Aug 31 19:05:35 2022] GET /identity/v3/services => generated 1268 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:05:36.188762 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240dda0-7ce5-4332-b6aa-db37d6452643 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:36.189284 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240dda0-7ce5-4332-b6aa-db37d6452643 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:36.189284 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240dda0-7ce5-4332-b6aa-db37d6452643 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:36.190911 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 444/889] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:05:36.196711 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb85ac0-76bf-4ba1-9063-10a92cad174b None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:36.197206 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb85ac0-76bf-4ba1-9063-10a92cad174b None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:36.197288 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb85ac0-76bf-4ba1-9063-10a92cad174b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:36.204921 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:36.219759 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-1cb85ac0-76bf-4ba1-9063-10a92cad174b None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:36.221259 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1cb85ac0-76bf-4ba1-9063-10a92cad174b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:36.298157 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 446/890] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:36 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:05:36.579852 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240dda0-7ce5-4332-b6aa-db37d6452643 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:36.674890 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac290fd5-1c7e-4f7a-84bd-bbcad51f0679 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:36.675546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac290fd5-1c7e-4f7a-84bd-bbcad51f0679 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:36.676019 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac290fd5-1c7e-4f7a-84bd-bbcad51f0679 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:36.677841 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 447/891] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:05:36.683145 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5804251-0417-4d8a-ac78-de858ab9a0d1 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:36.683655 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5804251-0417-4d8a-ac78-de858ab9a0d1 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:36.684128 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5804251-0417-4d8a-ac78-de858ab9a0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:36.688336 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240dda0-7ce5-4332-b6aa-db37d6452643 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:36.702721 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-a5804251-0417-4d8a-ac78-de858ab9a0d1 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:36.704730 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-a5804251-0417-4d8a-ac78-de858ab9a0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:36.723837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3db9b8-3b34-48e3-898a-bced39c9d5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:36.724470 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3db9b8-3b34-48e3-898a-bced39c9d5d1 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:36.724752 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3db9b8-3b34-48e3-898a-bced39c9d5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:36.725023 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3db9b8-3b34-48e3-898a-bced39c9d5d1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:36.725605 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3db9b8-3b34-48e3-898a-bced39c9d5d1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:36.727235 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3db9b8-3b34-48e3-898a-bced39c9d5d1 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:36.736526 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-ca3db9b8-3b34-48e3-898a-bced39c9d5d1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 19:05:36.736526 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:36.736526 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:05:36.736526 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:05:36.736526 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:05:36.736526 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:05:36.736526 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:05:36.736526 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:05:36.736526 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 19:05:36.736526 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:36.736526 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:05:36.736526 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:36.736526 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:36.736526 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:36.736526 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:36.736526 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:36.737481 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:36.737481 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:36.737481 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:36.737481 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:36.737481 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:36.737481 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:36.737481 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:36.737481 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:05:36.737481 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:05:36.737481 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:05:36.737481 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:05:36.737481 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:36.737481 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:36.737481 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:36.737481 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:36.737481 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:36.737481 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:36.738363 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:36.738363 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:36.738363 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:36.738363 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:36.738363 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:36.738363 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:36.738363 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:36.738363 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:36.738363 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:36.738363 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:36.738363 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:05:36.738363 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:05:36.738363 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 19:05:36.738363 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:36.738363 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 445/892] 10.222.0.79 () {56 vars in 1132 bytes} [Wed Aug 31 19:05:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:36.743815 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3db9b8-3b34-48e3-898a-bced39c9d5d1 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:36.753359 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:36.797443 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 448/893] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:36 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:05:36.814271 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69a505-ddac-4bb6-840d-e1ff5658edc9 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:36.814597 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69a505-ddac-4bb6-840d-e1ff5658edc9 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:36.815098 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69a505-ddac-4bb6-840d-e1ff5658edc9 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:36.816790 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 449/894] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:05:36.821881 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9957a87-1a5f-448b-b781-a53304dfee65 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:36.822165 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9957a87-1a5f-448b-b781-a53304dfee65 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:36.822443 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9957a87-1a5f-448b-b781-a53304dfee65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:36.845126 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-d9957a87-1a5f-448b-b781-a53304dfee65 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:36.846323 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d9957a87-1a5f-448b-b781-a53304dfee65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:36.873823 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3db9b8-3b34-48e3-898a-bced39c9d5d1 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:36.913007 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3c4e3-2e69-44bc-af5d-e56bac4d19f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:36.914046 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3c4e3-2e69-44bc-af5d-e56bac4d19f5 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:36.914552 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3c4e3-2e69-44bc-af5d-e56bac4d19f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:36.915024 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3c4e3-2e69-44bc-af5d-e56bac4d19f5 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:36.915918 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce3c4e3-2e69-44bc-af5d-e56bac4d19f5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:36.916449 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce3c4e3-2e69-44bc-af5d-e56bac4d19f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:36.917967 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce3c4e3-2e69-44bc-af5d-e56bac4d19f5 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:36.927989 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 446/895] 10.222.0.79 () {56 vars in 1126 bytes} [Wed Aug 31 19:05:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:05:36.930044 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3c4e3-2e69-44bc-af5d-e56bac4d19f5 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:36.931405 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:36.955673 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 450/896] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:36 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:05:37.011352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:37.049169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3c4e3-2e69-44bc-af5d-e56bac4d19f5 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:37.080464 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9957a87-1a5f-448b-b781-a53304dfee65 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:37.101514 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49bb6c-da59-4ca8-a2fd-0c68e7e6dae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:37.102129 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49bb6c-da59-4ca8-a2fd-0c68e7e6dae3 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:37.102403 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49bb6c-da59-4ca8-a2fd-0c68e7e6dae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:37.102745 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49bb6c-da59-4ca8-a2fd-0c68e7e6dae3 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:37.103337 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e49bb6c-da59-4ca8-a2fd-0c68e7e6dae3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:37.103636 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e49bb6c-da59-4ca8-a2fd-0c68e7e6dae3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:37.104994 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e49bb6c-da59-4ca8-a2fd-0c68e7e6dae3 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:37.111179 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 447/897] 10.222.0.79 () {56 vars in 1126 bytes} [Wed Aug 31 19:05:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:37.122320 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49bb6c-da59-4ca8-a2fd-0c68e7e6dae3 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:37.221349 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9957a87-1a5f-448b-b781-a53304dfee65 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:37.268470 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb4a41-a8fa-4786-988b-30d1945e9fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:37.269076 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb4a41-a8fa-4786-988b-30d1945e9fb4 None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:37.269364 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb4a41-a8fa-4786-988b-30d1945e9fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:37.269619 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb4a41-a8fa-4786-988b-30d1945e9fb4 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:37.270285 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb4a41-a8fa-4786-988b-30d1945e9fb4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:37.271692 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb4a41-a8fa-4786-988b-30d1945e9fb4 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:37.278536 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49bb6c-da59-4ca8-a2fd-0c68e7e6dae3 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:37.288699 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 451/898] 10.222.0.79 () {60 vars in 1141 bytes} [Wed Aug 31 19:05:37 2022] POST /identity/v3/services => generated 241 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:05:37.291917 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb4a41-a8fa-4786-988b-30d1945e9fb4 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:37.319987 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:37.333837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3a32c-ae1c-47e4-bf0d-fc828bf546dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:37.334608 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3a32c-ae1c-47e4-bf0d-fc828bf546dd None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:37.334891 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3a32c-ae1c-47e4-bf0d-fc828bf546dd None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:37.335162 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3a32c-ae1c-47e4-bf0d-fc828bf546dd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:37.335942 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b3a32c-ae1c-47e4-bf0d-fc828bf546dd None admin] RBAC: Adding query filter params (interface=public, service_id=2fe100051b3a44be985fd5393ab8accf, region_id=RegionOne) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:37.336257 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b3a32c-ae1c-47e4-bf0d-fc828bf546dd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:37.338197 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b3a32c-ae1c-47e4-bf0d-fc828bf546dd None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:37.349572 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 448/899] 10.222.0.79 () {56 vars in 1251 bytes} [Wed Aug 31 19:05:37 2022] GET /identity/v3/endpoints?service_id=2fe100051b3a44be985fd5393ab8accf&interface=public®ion_id=RegionOne => generated 194 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:37.351414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3a32c-ae1c-47e4-bf0d-fc828bf546dd None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:37.400799 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:37.474377 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb4a41-a8fa-4786-988b-30d1945e9fb4 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:37.490409 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3a32c-ae1c-47e4-bf0d-fc828bf546dd None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:37.521784 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee18a95-7f4b-4302-992a-324cb399b354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:37.522425 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee18a95-7f4b-4302-992a-324cb399b354 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:37.522730 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee18a95-7f4b-4302-992a-324cb399b354 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:37.522999 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee18a95-7f4b-4302-992a-324cb399b354 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:37.543792 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee18a95-7f4b-4302-992a-324cb399b354 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:05:37.548757 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63549f4-f084-4f0d-8fb5-e064860c861b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:37.549166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-7ee18a95-7f4b-4302-992a-324cb399b354 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 19:05:37.549166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:37.549166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:37.549166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:37.549166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:37.549166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:37.549166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:37.549166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:37.549166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:37.549166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:37.549166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:37.549166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:37.549166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:05:37.549166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:05:37.549166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:05:37.549166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:05:37.550072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:05:37.550072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:05:37.550072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:05:37.550072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:05:37.550072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:37.550072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:37.550072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:37.550072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:37.550072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:37.550072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:37.550072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:37.550072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:37.550072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:37.550072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:37.550072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:37.550072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:37.550952 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:37.550952 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:37.550952 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:37.550952 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:37.550952 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:05:37.550952 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:05:37.550952 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:05:37.550952 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:05:37.550952 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:05:37.550952 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:05:37.550952 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 19:05:37.550952 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:37.550952 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 452/900] 10.222.0.79 () {56 vars in 1120 bytes} [Wed Aug 31 19:05:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:37.552703 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63549f4-f084-4f0d-8fb5-e064860c861b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:37.552988 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63549f4-f084-4f0d-8fb5-e064860c861b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:37.553260 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63549f4-f084-4f0d-8fb5-e064860c861b None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:37.553889 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63549f4-f084-4f0d-8fb5-e064860c861b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:37.562482 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63549f4-f084-4f0d-8fb5-e064860c861b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:37.562656 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee18a95-7f4b-4302-992a-324cb399b354 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:37.566772 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 449/901] 10.222.0.79 () {56 vars in 1087 bytes} [Wed Aug 31 19:05:37 2022] GET /identity/v3/services => generated 1497 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:05:37.690724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee18a95-7f4b-4302-992a-324cb399b354 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:37.705960 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:37.729740 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a28bf1-b21f-47d8-b3d0-a62ee974cce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:37.730623 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a28bf1-b21f-47d8-b3d0-a62ee974cce3 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:37.731157 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a28bf1-b21f-47d8-b3d0-a62ee974cce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:37.731575 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a28bf1-b21f-47d8-b3d0-a62ee974cce3 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:37.732389 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a28bf1-b21f-47d8-b3d0-a62ee974cce3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:37.732835 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a28bf1-b21f-47d8-b3d0-a62ee974cce3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:37.734345 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a28bf1-b21f-47d8-b3d0-a62ee974cce3 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:37.743672 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 453/902] 10.222.0.79 () {56 vars in 1115 bytes} [Wed Aug 31 19:05:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:37.749645 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63549f4-f084-4f0d-8fb5-e064860c861b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:37.814638 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:37.861662 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63549f4-f084-4f0d-8fb5-e064860c861b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:37.898432 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172061e-66ba-4875-a755-388ba567259d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:37.898668 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a316f-4eae-4df9-b6d5-a4e564c5a6ae None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:37.898919 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a316f-4eae-4df9-b6d5-a4e564c5a6ae None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:37.899117 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a316f-4eae-4df9-b6d5-a4e564c5a6ae None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:37.899930 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172061e-66ba-4875-a755-388ba567259d None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:37.900428 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172061e-66ba-4875-a755-388ba567259d None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:37.900671 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 454/903] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:05:37.901151 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172061e-66ba-4875-a755-388ba567259d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:37.905802 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831317bf-bcd5-4719-9e7d-9a802a83f36f None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:37.906085 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831317bf-bcd5-4719-9e7d-9a802a83f36f None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:37.906898 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831317bf-bcd5-4719-9e7d-9a802a83f36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:37.919311 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9172061e-66ba-4875-a755-388ba567259d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:37.921987 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9172061e-66ba-4875-a755-388ba567259d None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:37.926045 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-831317bf-bcd5-4719-9e7d-9a802a83f36f None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:37.927265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-831317bf-bcd5-4719-9e7d-9a802a83f36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:37.943067 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-9172061e-66ba-4875-a755-388ba567259d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:37.943067 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:37.943067 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:37.943067 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:37.943067 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:37.943067 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:37.943067 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:37.943067 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:37.943067 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:37.943067 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:37.943067 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:37.943067 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:37.943067 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:37.943067 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:37.943067 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:37.943067 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:37.944032 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:37.944032 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:37.944032 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:37.944032 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:37.944032 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:37.944032 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:37.944032 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:37.944032 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:37.944032 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:37.944032 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:37.944032 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:37.944032 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:37.944032 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:37.944032 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:37.944032 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:37.944032 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:37.944032 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:37.944900 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:37.944900 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:37.944900 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:37.951651 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 450/904] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:37.954409 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172061e-66ba-4875-a755-388ba567259d None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:38.014781 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 455/905] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:05:38.064386 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172061e-66ba-4875-a755-388ba567259d None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:38.079017 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:38.103842 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09b758-9d24-4872-bc3d-6507a600c8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:38.104782 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09b758-9d24-4872-bc3d-6507a600c8ec None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:38.105266 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09b758-9d24-4872-bc3d-6507a600c8ec None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:38.105745 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09b758-9d24-4872-bc3d-6507a600c8ec None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:38.106624 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09b758-9d24-4872-bc3d-6507a600c8ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:38.107160 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09b758-9d24-4872-bc3d-6507a600c8ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:38.108731 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09b758-9d24-4872-bc3d-6507a600c8ec None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:38.127544 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 451/906] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:38.129220 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831317bf-bcd5-4719-9e7d-9a802a83f36f None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:38.240449 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831317bf-bcd5-4719-9e7d-9a802a83f36f None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:38.243106 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:38.277587 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd660677-80a9-4bbd-b5b4-1975feb11117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:38.278226 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd660677-80a9-4bbd-b5b4-1975feb11117 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:38.278522 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd660677-80a9-4bbd-b5b4-1975feb11117 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:38.278795 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd660677-80a9-4bbd-b5b4-1975feb11117 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:38.287147 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd660677-80a9-4bbd-b5b4-1975feb11117 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:38.288600 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd660677-80a9-4bbd-b5b4-1975feb11117 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:38.301752 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-bd660677-80a9-4bbd-b5b4-1975feb11117 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 19:05:38.301752 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:38.301752 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:38.301752 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:38.301752 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:38.301752 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:38.301752 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:38.301752 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:38.301752 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:38.301752 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:38.301752 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:38.301752 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:38.301752 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:05:38.301752 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:05:38.301752 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:05:38.301752 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:05:38.302788 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:38.302788 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:38.302788 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:05:38.302788 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:38.302788 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:05:38.302788 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:38.302788 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:38.302788 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:38.302788 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:38.302788 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:38.302788 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:38.302788 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:38.302788 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:38.302788 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:38.302788 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:38.302788 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:38.302788 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:38.302788 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:38.303945 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:38.303945 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:38.303945 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:05:38.303945 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:05:38.303945 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:05:38.303945 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:05:38.303945 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:05:38.303945 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:05:38.303945 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 19:05:38.303945 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:38.303945 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 456/907] 10.222.0.79 () {56 vars in 1117 bytes} [Wed Aug 31 19:05:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:38.310840 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09b758-9d24-4872-bc3d-6507a600c8ec None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:38.322812 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd660677-80a9-4bbd-b5b4-1975feb11117 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:38.424661 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09b758-9d24-4872-bc3d-6507a600c8ec None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:38.429666 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd660677-80a9-4bbd-b5b4-1975feb11117 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:38.464615 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ffc0f-c436-44b6-bf33-f33396cab771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:38.465454 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107cd3f-6853-4691-b482-3c66bc00c859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:38.465581 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ffc0f-c436-44b6-bf33-f33396cab771 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:38.465947 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ffc0f-c436-44b6-bf33-f33396cab771 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:38.466259 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ffc0f-c436-44b6-bf33-f33396cab771 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:38.466851 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107cd3f-6853-4691-b482-3c66bc00c859 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:38.466974 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ffc0f-c436-44b6-bf33-f33396cab771 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:38.467441 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107cd3f-6853-4691-b482-3c66bc00c859 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:38.467920 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107cd3f-6853-4691-b482-3c66bc00c859 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:38.468523 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ffc0f-c436-44b6-bf33-f33396cab771 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:38.469341 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107cd3f-6853-4691-b482-3c66bc00c859 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:38.469861 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107cd3f-6853-4691-b482-3c66bc00c859 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:38.471711 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107cd3f-6853-4691-b482-3c66bc00c859 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:38.479062 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-6c2ffc0f-c436-44b6-bf33-f33396cab771 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 19:05:38.479062 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:38.479062 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:05:38.479062 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:05:38.479062 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:05:38.479062 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:05:38.479062 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:05:38.479062 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:05:38.479062 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 19:05:38.479062 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:38.479062 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:05:38.479062 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:38.479062 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:38.479062 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:38.479062 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:38.479062 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:38.479062 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:38.480078 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:38.480078 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:38.480078 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:38.480078 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:38.480078 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:38.480078 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:38.480078 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:05:38.480078 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:05:38.480078 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:05:38.480078 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:05:38.480078 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:38.480078 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:38.480078 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:38.480078 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:38.480078 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:38.480078 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:38.480897 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:38.480897 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:38.480897 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:38.480897 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:38.480897 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:38.480897 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:38.480897 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:38.480897 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:38.480897 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:38.480897 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:38.480897 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:05:38.480897 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:05:38.480897 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 19:05:38.480897 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:38.485445 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 457/908] 10.222.0.79 () {56 vars in 1114 bytes} [Wed Aug 31 19:05:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:05:38.486999 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ffc0f-c436-44b6-bf33-f33396cab771 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:38.501908 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 452/909] 10.222.0.79 () {56 vars in 1149 bytes} [Wed Aug 31 19:05:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:38.503718 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107cd3f-6853-4691-b482-3c66bc00c859 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:38.528000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:38.538988 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:38.605770 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ffc0f-c436-44b6-bf33-f33396cab771 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:38.642844 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd5a61-2e3f-4ca1-91b4-4cc4bbd84016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:38.643456 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd5a61-2e3f-4ca1-91b4-4cc4bbd84016 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:38.643740 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107cd3f-6853-4691-b482-3c66bc00c859 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:38.643878 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd5a61-2e3f-4ca1-91b4-4cc4bbd84016 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:38.644108 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd5a61-2e3f-4ca1-91b4-4cc4bbd84016 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:38.644780 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd5a61-2e3f-4ca1-91b4-4cc4bbd84016 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:38.645086 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd5a61-2e3f-4ca1-91b4-4cc4bbd84016 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:38.646526 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd5a61-2e3f-4ca1-91b4-4cc4bbd84016 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:38.656284 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 458/910] 10.222.0.79 () {56 vars in 1114 bytes} [Wed Aug 31 19:05:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:38.657206 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd5a61-2e3f-4ca1-91b4-4cc4bbd84016 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:38.683311 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4300d0a-552b-4cbd-990b-be6e93445e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:38.684368 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4300d0a-552b-4cbd-990b-be6e93445e56 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:38.684853 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4300d0a-552b-4cbd-990b-be6e93445e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:38.685353 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4300d0a-552b-4cbd-990b-be6e93445e56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:38.770004 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4300d0a-552b-4cbd-990b-be6e93445e56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:38.771626 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4300d0a-552b-4cbd-990b-be6e93445e56 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:38.776603 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:38.790257 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd5a61-2e3f-4ca1-91b4-4cc4bbd84016 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:38.801390 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:38.842216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c747f-b42f-40c3-adf9-f07b2bd5f097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:38.843477 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c747f-b42f-40c3-adf9-f07b2bd5f097 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:38.844906 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c747f-b42f-40c3-adf9-f07b2bd5f097 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:38.845656 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c747f-b42f-40c3-adf9-f07b2bd5f097 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:38.846561 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c747f-b42f-40c3-adf9-f07b2bd5f097 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:38.847072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c747f-b42f-40c3-adf9-f07b2bd5f097 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:38.849503 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c747f-b42f-40c3-adf9-f07b2bd5f097 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:38.857185 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 459/911] 10.222.0.79 () {56 vars in 1114 bytes} [Wed Aug 31 19:05:38 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:38.865020 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c747f-b42f-40c3-adf9-f07b2bd5f097 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:38.901276 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 453/912] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:05:38 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 19:05:38.908327 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4300d0a-552b-4cbd-990b-be6e93445e56 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:38.992502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c747f-b42f-40c3-adf9-f07b2bd5f097 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:39.034703 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925d5b2-928e-487b-a51d-6363137fe617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:39.035706 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925d5b2-928e-487b-a51d-6363137fe617 None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:39.036371 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925d5b2-928e-487b-a51d-6363137fe617 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:39.037015 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925d5b2-928e-487b-a51d-6363137fe617 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:39.037962 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d925d5b2-928e-487b-a51d-6363137fe617 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:39.039743 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d925d5b2-928e-487b-a51d-6363137fe617 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:39.039946 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4300d0a-552b-4cbd-990b-be6e93445e56 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:39.070494 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 460/913] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:05:38 2022] POST /identity/v3/endpoints => generated 346 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:05:39.081176 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:39.101016 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a449f08-e7f1-472b-8aca-8af69b281f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:39.102048 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a449f08-e7f1-472b-8aca-8af69b281f41 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:39.102589 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a449f08-e7f1-472b-8aca-8af69b281f41 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:39.103071 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a449f08-e7f1-472b-8aca-8af69b281f41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:39.115646 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a449f08-e7f1-472b-8aca-8af69b281f41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:39.118101 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a449f08-e7f1-472b-8aca-8af69b281f41 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:39.136571 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-1a449f08-e7f1-472b-8aca-8af69b281f41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:39.136571 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:39.136571 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:39.136571 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:39.136571 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:39.136571 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:39.136571 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:39.136571 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:39.136571 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:39.136571 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:39.136571 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:39.136571 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:39.136571 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:39.136571 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:39.136571 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:39.136571 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:39.137660 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:39.137660 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:39.137660 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:39.137660 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:39.137660 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:39.137660 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:39.137660 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:39.137660 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:39.137660 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:39.137660 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:39.137660 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:39.137660 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:39.137660 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:39.137660 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:39.137660 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:39.137660 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:39.137660 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:39.138563 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:39.138563 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:39.138563 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:39.145409 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 454/914] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:39.148166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925d5b2-928e-487b-a51d-6363137fe617 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:39.179837 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:39.270543 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925d5b2-928e-487b-a51d-6363137fe617 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:39.310079 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a80bd-afc5-43b6-ac1d-b25ac684385c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:39.310780 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a80bd-afc5-43b6-ac1d-b25ac684385c None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:39.311212 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a80bd-afc5-43b6-ac1d-b25ac684385c None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:39.311542 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a80bd-afc5-43b6-ac1d-b25ac684385c None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:39.312302 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13a80bd-afc5-43b6-ac1d-b25ac684385c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:39.313278 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13a80bd-afc5-43b6-ac1d-b25ac684385c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:39.314771 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13a80bd-afc5-43b6-ac1d-b25ac684385c None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:39.330588 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 461/915] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:39.334375 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a449f08-e7f1-472b-8aca-8af69b281f41 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:39.371156 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50183a32-ef25-418a-9582-2bf7feaadddf None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:39.371598 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50183a32-ef25-418a-9582-2bf7feaadddf None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:39.372330 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50183a32-ef25-418a-9582-2bf7feaadddf None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:39.374419 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 462/916] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:05:39.379897 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e40a46-0bfb-46b1-8afe-04ffed825ab4 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:39.380298 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e40a46-0bfb-46b1-8afe-04ffed825ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:39.380651 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e40a46-0bfb-46b1-8afe-04ffed825ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:39.401971 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-b0e40a46-0bfb-46b1-8afe-04ffed825ab4 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:39.403984 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-b0e40a46-0bfb-46b1-8afe-04ffed825ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:39.453118 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a449f08-e7f1-472b-8aca-8af69b281f41 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:39.496011 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc88a1-b998-4db1-a13e-106a1061b75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:39.497363 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc88a1-b998-4db1-a13e-106a1061b75e None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:39.497827 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc88a1-b998-4db1-a13e-106a1061b75e None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:39.498176 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc88a1-b998-4db1-a13e-106a1061b75e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:39.506164 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc88a1-b998-4db1-a13e-106a1061b75e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:39.507797 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc88a1-b998-4db1-a13e-106a1061b75e None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:39.518567 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 463/917] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:05:39.525209 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-a6bc88a1-b998-4db1-a13e-106a1061b75e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:39.525209 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:39.525209 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:39.525209 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:39.525209 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:39.525209 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:39.525209 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:39.525209 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:39.525209 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:39.525209 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:39.525209 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:39.525209 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:39.525209 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:05:39.525209 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:05:39.525209 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:05:39.526389 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:05:39.526389 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:39.526389 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:39.526389 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:39.526389 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:39.526389 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:39.526389 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:39.526389 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:39.526389 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:39.526389 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:39.526389 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:39.526389 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:39.526389 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:39.526389 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:39.526389 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:39.526389 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:39.526389 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:39.528207 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:05:39.528207 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:05:39.528207 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:05:39.528207 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:05:39.528207 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:05:39.528207 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:05:39.528207 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:39.528207 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:39.529166 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 455/918] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:05:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:39.538487 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e40a46-0bfb-46b1-8afe-04ffed825ab4 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:39.561029 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:39.631191 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc77932-560e-4a41-8268-59cfb989049b None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:39.631481 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc77932-560e-4a41-8268-59cfb989049b None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:39.631764 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc77932-560e-4a41-8268-59cfb989049b None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:39.633618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 456/919] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:05:39.638754 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d713d1a-2f8e-4bf3-b75f-245a2755c2d2 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:39.639037 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d713d1a-2f8e-4bf3-b75f-245a2755c2d2 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:39.639311 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d713d1a-2f8e-4bf3-b75f-245a2755c2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:39.650516 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e40a46-0bfb-46b1-8afe-04ffed825ab4 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:39.668121 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-6d713d1a-2f8e-4bf3-b75f-245a2755c2d2 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:39.670234 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6d713d1a-2f8e-4bf3-b75f-245a2755c2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:39.688198 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefe3e9-ea33-4d4f-b1d3-4cf02e210b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:39.688811 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefe3e9-ea33-4d4f-b1d3-4cf02e210b0f None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:39.689086 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefe3e9-ea33-4d4f-b1d3-4cf02e210b0f None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:39.689351 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefe3e9-ea33-4d4f-b1d3-4cf02e210b0f None admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:39.690046 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adefe3e9-ea33-4d4f-b1d3-4cf02e210b0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:39.690351 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adefe3e9-ea33-4d4f-b1d3-4cf02e210b0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:39.691910 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adefe3e9-ea33-4d4f-b1d3-4cf02e210b0f None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:39.704628 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 464/920] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 19:05:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:39.706667 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:39.710882 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefe3e9-ea33-4d4f-b1d3-4cf02e210b0f None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:39.770501 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 457/921] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:05:39.791955 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:39.799340 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d713d1a-2f8e-4bf3-b75f-245a2755c2d2 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:39.845935 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefe3e9-ea33-4d4f-b1d3-4cf02e210b0f None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:39.895124 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff486a-c2ad-4b7d-aad1-3748016e7b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:39.895746 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff486a-c2ad-4b7d-aad1-3748016e7b97 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:39.896027 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff486a-c2ad-4b7d-aad1-3748016e7b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:39.896301 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff486a-c2ad-4b7d-aad1-3748016e7b97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:39.897041 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff486a-c2ad-4b7d-aad1-3748016e7b97 None admin] RBAC: Adding query filter params (role.id=adbf346347dc40afa78c773cfc32c750, scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507, user.id=3e070c93f47045ecb5bf0a1622395091) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:39.897348 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff486a-c2ad-4b7d-aad1-3748016e7b97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:39.898814 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff486a-c2ad-4b7d-aad1-3748016e7b97 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:39.914847 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 465/922] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:05:39 2022] GET /identity/v3/role_assignments?user.id=3e070c93f47045ecb5bf0a1622395091&scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507&role.id=adbf346347dc40afa78c773cfc32c750 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:05:39.928179 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d713d1a-2f8e-4bf3-b75f-245a2755c2d2 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:39.970100 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9e066-7771-4f30-ae89-ff1d9a703438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:39.971597 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9e066-7771-4f30-ae89-ff1d9a703438 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:39.972328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9e066-7771-4f30-ae89-ff1d9a703438 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:39.973029 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9e066-7771-4f30-ae89-ff1d9a703438 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:39.974238 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a9e066-7771-4f30-ae89-ff1d9a703438 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:39.976172 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a9e066-7771-4f30-ae89-ff1d9a703438 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:39.988564 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-d5a9e066-7771-4f30-ae89-ff1d9a703438 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:05:39.988564 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:39.988564 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:05:39.988564 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:05:39.988564 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:05:39.988564 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:05:39.988564 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:05:39.988564 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:05:39.988564 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:05:39.988564 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:39.988564 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:05:39.988564 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:39.988564 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:39.988564 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:39.988564 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:39.988564 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:39.988564 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:39.990258 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:39.990258 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:39.990258 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:39.990258 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:39.990258 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:39.990258 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:39.990258 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:05:39.990258 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:05:39.990258 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:05:39.990258 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:05:39.990258 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:39.990258 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:39.990258 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:39.990258 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:39.990258 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:39.990258 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:39.991711 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:39.991711 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:39.991711 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:39.991711 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:39.991711 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:39.991711 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:39.991711 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:39.991711 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:39.991711 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:39.991711 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:39.991711 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:05:39.991711 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:05:39.991711 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:05:39.991711 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:39.995686 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 458/923] 10.222.0.79 () {56 vars in 1126 bytes} [Wed Aug 31 19:05:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:05:40.002663 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff486a-c2ad-4b7d-aad1-3748016e7b97 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:40.043614 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9e066-7771-4f30-ae89-ff1d9a703438 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:40.083650 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:40.126483 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff486a-c2ad-4b7d-aad1-3748016e7b97 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:40.157815 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:40.171968 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f541c-a10c-438d-b9ac-fccc9a6f4fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:40.171968 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f541c-a10c-438d-b9ac-fccc9a6f4fd6 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:40.171968 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f541c-a10c-438d-b9ac-fccc9a6f4fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:40.171968 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f541c-a10c-438d-b9ac-fccc9a6f4fd6 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:40.172582 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f541c-a10c-438d-b9ac-fccc9a6f4fd6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:40.172582 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f541c-a10c-438d-b9ac-fccc9a6f4fd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:40.173511 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f541c-a10c-438d-b9ac-fccc9a6f4fd6 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:40.176507 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9e066-7771-4f30-ae89-ff1d9a703438 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:40.183994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 466/924] 10.222.0.79 () {56 vars in 1122 bytes} [Wed Aug 31 19:05:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:40.185052 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f541c-a10c-438d-b9ac-fccc9a6f4fd6 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:40.228769 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d37a92-49fd-46aa-9b05-e4ba564b017d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:40.229770 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d37a92-49fd-46aa-9b05-e4ba564b017d None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:40.230895 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d37a92-49fd-46aa-9b05-e4ba564b017d None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:40.231381 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d37a92-49fd-46aa-9b05-e4ba564b017d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:40.232192 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d37a92-49fd-46aa-9b05-e4ba564b017d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:40.234752 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d37a92-49fd-46aa-9b05-e4ba564b017d None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:40.247133 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-c7d37a92-49fd-46aa-9b05-e4ba564b017d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 19:05:40.247133 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:40.247133 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:05:40.247133 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:05:40.247133 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:05:40.247133 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:05:40.247133 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:05:40.247133 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:05:40.247133 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 19:05:40.247133 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:40.247133 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:05:40.247133 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:40.247133 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:40.247133 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:40.247133 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:40.247133 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:40.248191 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:40.248191 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:40.248191 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:40.248191 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:40.248191 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:40.248191 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:40.248191 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:40.248191 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:05:40.248191 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:05:40.248191 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:05:40.248191 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:05:40.248191 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:40.248191 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:40.248191 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:40.248191 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:40.248191 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:40.248191 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:40.249095 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:40.249095 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:40.249095 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:40.249095 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:40.249095 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:40.249095 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:40.249095 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:40.249095 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:40.249095 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:40.249095 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:40.249095 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:05:40.249095 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:05:40.249095 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 19:05:40.249095 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:40.256814 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 459/925] 10.222.0.79 () {56 vars in 1132 bytes} [Wed Aug 31 19:05:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:05:40.259282 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d37a92-49fd-46aa-9b05-e4ba564b017d None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:40.309066 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f541c-a10c-438d-b9ac-fccc9a6f4fd6 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:40.347282 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ce128-d7ec-460e-9f13-e99a514ff29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:40.347902 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ce128-d7ec-460e-9f13-e99a514ff29e None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:40.348197 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ce128-d7ec-460e-9f13-e99a514ff29e None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:40.348455 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ce128-d7ec-460e-9f13-e99a514ff29e None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:40.349091 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ce128-d7ec-460e-9f13-e99a514ff29e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:40.349407 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ce128-d7ec-460e-9f13-e99a514ff29e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:40.351481 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ce128-d7ec-460e-9f13-e99a514ff29e None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:40.362428 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 467/926] 10.222.0.79 () {56 vars in 1122 bytes} [Wed Aug 31 19:05:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:05:40.363547 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ce128-d7ec-460e-9f13-e99a514ff29e None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:40.382338 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:40.395006 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d37a92-49fd-46aa-9b05-e4ba564b017d None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:40.435411 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b8e60-f123-4b9b-a241-6b4ef720d972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:40.436118 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b8e60-f123-4b9b-a241-6b4ef720d972 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:40.436504 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b8e60-f123-4b9b-a241-6b4ef720d972 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:40.436992 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b8e60-f123-4b9b-a241-6b4ef720d972 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:40.437562 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b8e60-f123-4b9b-a241-6b4ef720d972 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:40.437976 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b8e60-f123-4b9b-a241-6b4ef720d972 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:40.439568 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b8e60-f123-4b9b-a241-6b4ef720d972 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:40.447922 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:40.450181 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 460/927] 10.222.0.79 () {56 vars in 1126 bytes} [Wed Aug 31 19:05:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:40.451781 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b8e60-f123-4b9b-a241-6b4ef720d972 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:40.516569 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ce128-d7ec-460e-9f13-e99a514ff29e None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:40.561568 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11cc95-338b-498e-853b-2f4f30b066cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:40.562352 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11cc95-338b-498e-853b-2f4f30b066cd None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:40.563376 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11cc95-338b-498e-853b-2f4f30b066cd None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:40.563748 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11cc95-338b-498e-853b-2f4f30b066cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:40.564757 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11cc95-338b-498e-853b-2f4f30b066cd None admin] RBAC: Adding query filter params (interface=public, service_id=cceb3127a3854671928e1d966e1c606e, region_id=RegionOne) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:40.564954 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11cc95-338b-498e-853b-2f4f30b066cd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:40.566572 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11cc95-338b-498e-853b-2f4f30b066cd None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:40.579799 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 468/928] 10.222.0.79 () {56 vars in 1251 bytes} [Wed Aug 31 19:05:40 2022] GET /identity/v3/endpoints?service_id=cceb3127a3854671928e1d966e1c606e&interface=public®ion_id=RegionOne => generated 194 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:40.580917 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11cc95-338b-498e-853b-2f4f30b066cd None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:40.597442 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b8e60-f123-4b9b-a241-6b4ef720d972 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:40.638702 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ccad33-626f-4d17-9281-d30524a8a7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:40.639433 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccad33-626f-4d17-9281-d30524a8a7f2 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:40.639810 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccad33-626f-4d17-9281-d30524a8a7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:40.640222 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccad33-626f-4d17-9281-d30524a8a7f2 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:40.640988 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ccad33-626f-4d17-9281-d30524a8a7f2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:40.641389 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ccad33-626f-4d17-9281-d30524a8a7f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:40.642889 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ccad33-626f-4d17-9281-d30524a8a7f2 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:40.653185 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 461/929] 10.222.0.79 () {56 vars in 1126 bytes} [Wed Aug 31 19:05:40 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:40.654245 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ccad33-626f-4d17-9281-d30524a8a7f2 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:40.686049 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:40.710993 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11cc95-338b-498e-853b-2f4f30b066cd None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:40.741580 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:40.761851 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a73c5-7280-42fe-bac1-175596593564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:40.762334 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a73c5-7280-42fe-bac1-175596593564 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:40.762777 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a73c5-7280-42fe-bac1-175596593564 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:40.763149 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a73c5-7280-42fe-bac1-175596593564 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:40.763857 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a73c5-7280-42fe-bac1-175596593564 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:40.765426 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a73c5-7280-42fe-bac1-175596593564 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:40.778486 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 469/930] 10.222.0.79 () {56 vars in 1087 bytes} [Wed Aug 31 19:05:40 2022] GET /identity/v3/services => generated 1497 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:05:40.797765 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ccad33-626f-4d17-9281-d30524a8a7f2 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:40.838373 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b2659-e621-4b46-abff-803952ab700e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:40.839113 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b2659-e621-4b46-abff-803952ab700e None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:40.839396 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b2659-e621-4b46-abff-803952ab700e None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:40.839666 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b2659-e621-4b46-abff-803952ab700e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:40.840463 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b2659-e621-4b46-abff-803952ab700e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:40.841888 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b2659-e621-4b46-abff-803952ab700e None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:40.869022 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 462/931] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:05:40 2022] POST /identity/v3/endpoints => generated 347 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:05:41.182715 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831c533-3e25-4bf1-b07d-0bc1e0603791 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:41.183114 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831c533-3e25-4bf1-b07d-0bc1e0603791 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:41.183305 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831c533-3e25-4bf1-b07d-0bc1e0603791 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:41.184857 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 470/932] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:05:41.190086 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ca732-e796-4794-a58d-fb0e3b798318 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:41.190376 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ca732-e796-4794-a58d-fb0e3b798318 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:41.190674 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ca732-e796-4794-a58d-fb0e3b798318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:41.211562 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-265ca732-e796-4794-a58d-fb0e3b798318 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:41.212946 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-265ca732-e796-4794-a58d-fb0e3b798318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:41.292065 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 463/933] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:05:41.568173 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8831c533-3e25-4bf1-b07d-0bc1e0603791 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:41.687018 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8831c533-3e25-4bf1-b07d-0bc1e0603791 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:41.730841 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a6cc3-8a0a-4662-8244-0fae10cbe853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:41.731456 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a6cc3-8a0a-4662-8244-0fae10cbe853 None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:41.731744 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a6cc3-8a0a-4662-8244-0fae10cbe853 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:41.732026 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a6cc3-8a0a-4662-8244-0fae10cbe853 None admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:41.732680 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a6cc3-8a0a-4662-8244-0fae10cbe853 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:41.734177 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a6cc3-8a0a-4662-8244-0fae10cbe853 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:41.736867 dv-cinder-852210-6-smb devstack@keystone.service[81682]: WARNING keystone.server.flask.common [None req-2a1a6cc3-8a0a-4662-8244-0fae10cbe853 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 31 19:05:41.757487 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.sql.core [None req-2a1a6cc3-8a0a-4662-8244-0fae10cbe853 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 19:05:41.757487 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 19:05:41.757487 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [parameters: {'id': '13f57bd19df547219191ba83465e2752', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 19:05:41.757487 dv-cinder-852210-6-smb devstack@keystone.service[81682]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81682) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 19:05:41.775748 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-2a1a6cc3-8a0a-4662-8244-0fae10cbe853 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 13f57bd19df547219191ba83465e2752.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 13f57bd19df547219191ba83465e2752. Aug 31 19:05:41.775748 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:41.775748 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 19:05:41.775748 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 19:05:41.775748 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 19:05:41.775748 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 19:05:41.775748 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 19:05:41.775748 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 19:05:41.775748 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 19:05:41.775748 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application conn.query(q) Aug 31 19:05:41.775748 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 19:05:41.775748 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 19:05:41.775748 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 19:05:41.776629 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application result.read() Aug 31 19:05:41.776629 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 19:05:41.776629 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 19:05:41.776629 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 19:05:41.776629 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 19:05:41.776629 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 19:05:41.776629 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 19:05:41.776629 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 19:05:41.776629 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 19:05:41.776629 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 19:05:41.776629 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:41.776629 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 19:05:41.776629 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:41.776629 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:41.776629 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 19:05:41.776629 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 19:05:41.776629 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 31 19:05:41.776629 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 31 19:05:41.777556 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 19:05:41.777556 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application next(self.gen) Aug 31 19:05:41.777556 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 19:05:41.777556 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application yield resource Aug 31 19:05:41.777556 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 19:05:41.777556 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application next(self.gen) Aug 31 19:05:41.777556 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 19:05:41.777556 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 19:05:41.777556 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 19:05:41.777556 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 19:05:41.777556 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 19:05:41.777556 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise self.value Aug 31 19:05:41.777556 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 19:05:41.777556 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 19:05:41.777556 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 19:05:41.777556 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application session.commit() Aug 31 19:05:41.777556 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 19:05:41.778442 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 19:05:41.778442 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 19:05:41.778442 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 19:05:41.778442 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 19:05:41.778442 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self.session.flush() Aug 31 19:05:41.778442 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 19:05:41.778442 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 19:05:41.778442 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 19:05:41.778442 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 19:05:41.778442 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 19:05:41.778442 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application compat.raise_( Aug 31 19:05:41.778442 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 19:05:41.778442 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception Aug 31 19:05:41.778442 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 19:05:41.778442 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 19:05:41.778442 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 19:05:41.778442 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 19:05:41.779514 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 19:05:41.779514 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 19:05:41.779514 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 19:05:41.779514 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 19:05:41.779514 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 31 19:05:41.779514 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 31 19:05:41.779514 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 19:05:41.779514 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 19:05:41.779514 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 19:05:41.779514 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 19:05:41.779514 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 19:05:41.779514 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 19:05:41.779514 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 19:05:41.779514 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 19:05:41.779514 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 19:05:41.780385 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 19:05:41.780385 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 19:05:41.780385 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception Aug 31 19:05:41.780385 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 19:05:41.780385 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 19:05:41.780385 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 19:05:41.780385 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 19:05:41.780385 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 19:05:41.780385 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 19:05:41.780385 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 19:05:41.780385 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application conn.query(q) Aug 31 19:05:41.780385 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 19:05:41.780385 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 19:05:41.780385 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 19:05:41.780385 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application result.read() Aug 31 19:05:41.780385 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 19:05:41.780385 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 19:05:41.781273 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 19:05:41.781273 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 19:05:41.781273 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 19:05:41.781273 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 19:05:41.781273 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 19:05:41.781273 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 19:05:41.781273 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 19:05:41.781273 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 19:05:41.781273 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [parameters: {'id': '13f57bd19df547219191ba83465e2752', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 19:05:41.781273 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 19:05:41.781273 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:41.781273 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:05:41.781273 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:41.781273 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:41.781273 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 31 19:05:41.782052 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 31 19:05:41.782052 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 19:05:41.782052 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 19:05:41.782052 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 31 19:05:41.782052 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:41.782052 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:05:41.782052 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:41.782052 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:41.782052 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:41.782052 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:41.782052 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:41.782052 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:41.782052 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:41.782052 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:41.782052 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:41.782052 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:41.782052 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:41.788935 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:41.788935 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 31 19:05:41.788935 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 31 19:05:41.788935 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:41.788935 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:41.788935 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 31 19:05:41.788935 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 31 19:05:41.788935 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 13f57bd19df547219191ba83465e2752. Aug 31 19:05:41.788935 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:41.788935 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 471/934] 10.222.0.79 () {60 vars in 1140 bytes} [Wed Aug 31 19:05:41 2022] POST /identity/v3/projects => generated 262 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:41.792160 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ca732-e796-4794-a58d-fb0e3b798318 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:41.794309 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:41.916485 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ca732-e796-4794-a58d-fb0e3b798318 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:41.932003 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cb141-233b-4c33-8ef4-1d16b0cda952 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:41.932316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cb141-233b-4c33-8ef4-1d16b0cda952 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:41.932558 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cb141-233b-4c33-8ef4-1d16b0cda952 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:41.937123 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 472/935] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:05:41.943975 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc24c8-e0dd-492b-8a04-6a7493513425 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:41.944316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc24c8-e0dd-492b-8a04-6a7493513425 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:41.944534 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc24c8-e0dd-492b-8a04-6a7493513425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:41.971365 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-d5bc24c8-e0dd-492b-8a04-6a7493513425 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:41.971723 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a162a-ddcc-44b7-96f3-877cb65086b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:41.972531 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a162a-ddcc-44b7-96f3-877cb65086b9 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:41.972856 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a162a-ddcc-44b7-96f3-877cb65086b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:41.973126 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d5bc24c8-e0dd-492b-8a04-6a7493513425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:41.973304 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a162a-ddcc-44b7-96f3-877cb65086b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:41.982008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a162a-ddcc-44b7-96f3-877cb65086b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:41.983845 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a162a-ddcc-44b7-96f3-877cb65086b9 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:42.003837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-dc4a162a-ddcc-44b7-96f3-877cb65086b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:42.003837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:42.003837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:42.003837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:42.003837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:42.003837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:42.003837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:42.003837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:42.003837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:42.003837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:42.003837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:42.003837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:42.003837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:05:42.003837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:05:42.003837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:05:42.004792 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:05:42.004792 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:42.004792 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:42.004792 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:42.004792 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:42.004792 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:42.004792 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:42.004792 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:42.004792 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:42.004792 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:42.004792 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:42.004792 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:42.004792 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:42.004792 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:42.004792 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:42.004792 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:42.004792 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:42.005679 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:05:42.005679 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:05:42.005679 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:05:42.005679 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:05:42.005679 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:05:42.005679 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:05:42.005679 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:42.005679 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:42.006584 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 464/936] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:05:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:42.010981 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:42.013681 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a162a-ddcc-44b7-96f3-877cb65086b9 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:42.056464 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 473/937] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:05:42.093280 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:42.136224 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a162a-ddcc-44b7-96f3-877cb65086b9 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:42.177131 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed35b3e-aa05-4e8e-ab14-d02550c79c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:42.177738 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed35b3e-aa05-4e8e-ab14-d02550c79c3c None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:42.178014 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed35b3e-aa05-4e8e-ab14-d02550c79c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:42.178283 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed35b3e-aa05-4e8e-ab14-d02550c79c3c None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:42.178979 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed35b3e-aa05-4e8e-ab14-d02550c79c3c None admin] RBAC: Adding query filter params (name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:42.179282 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed35b3e-aa05-4e8e-ab14-d02550c79c3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:42.180709 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed35b3e-aa05-4e8e-ab14-d02550c79c3c None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:42.198129 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 465/938] 10.222.0.79 () {56 vars in 1112 bytes} [Wed Aug 31 19:05:42 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:42.340073 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc24c8-e0dd-492b-8a04-6a7493513425 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:42.459074 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc24c8-e0dd-492b-8a04-6a7493513425 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:42.500655 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d861a-60a9-44cd-96b4-437d4830e705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:42.501831 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d861a-60a9-44cd-96b4-437d4830e705 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:42.502341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d861a-60a9-44cd-96b4-437d4830e705 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:42.502842 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d861a-60a9-44cd-96b4-437d4830e705 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:42.515271 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d861a-60a9-44cd-96b4-437d4830e705 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:05:42.521347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-393d861a-60a9-44cd-96b4-437d4830e705 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 19:05:42.521347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:42.521347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:42.521347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:42.521347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:42.521347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:42.521347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:42.521347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:42.521347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:42.521347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:42.521347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:42.521347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:42.521347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:05:42.521347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:05:42.521347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:05:42.521347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:05:42.522347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:05:42.522347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:05:42.522347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:05:42.522347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:05:42.522347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:42.522347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:42.522347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:42.522347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:42.522347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:42.522347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:42.522347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:42.522347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:42.522347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:42.522347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:42.522347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:42.522347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:42.523237 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:42.523237 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:42.523237 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:42.523237 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:42.523237 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:05:42.523237 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:05:42.523237 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:05:42.523237 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:05:42.523237 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:05:42.523237 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:05:42.523237 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 19:05:42.523237 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:42.526049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 474/939] 10.222.0.79 () {56 vars in 1120 bytes} [Wed Aug 31 19:05:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:42.535530 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed35b3e-aa05-4e8e-ab14-d02550c79c3c None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:42.659106 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed35b3e-aa05-4e8e-ab14-d02550c79c3c None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:42.688973 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:42.701814 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a495b-055b-40ad-a977-f8673202a029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:42.702427 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a495b-055b-40ad-a977-f8673202a029 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:42.702728 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a495b-055b-40ad-a977-f8673202a029 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:42.702995 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a495b-055b-40ad-a977-f8673202a029 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:42.704299 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a495b-055b-40ad-a977-f8673202a029 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:42.704596 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a495b-055b-40ad-a977-f8673202a029 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:42.705955 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a495b-055b-40ad-a977-f8673202a029 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:42.715439 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 466/940] 10.222.0.79 () {56 vars in 1115 bytes} [Wed Aug 31 19:05:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:42.720904 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d861a-60a9-44cd-96b4-437d4830e705 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:42.755237 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:42.845454 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d861a-60a9-44cd-96b4-437d4830e705 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:42.884562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822dc7f-7929-448d-acf3-caedf667661d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:42.885278 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822dc7f-7929-448d-acf3-caedf667661d None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:42.885558 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822dc7f-7929-448d-acf3-caedf667661d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:42.885832 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822dc7f-7929-448d-acf3-caedf667661d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:42.899120 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822dc7f-7929-448d-acf3-caedf667661d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:42.900721 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822dc7f-7929-448d-acf3-caedf667661d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:42.920327 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-8822dc7f-7929-448d-acf3-caedf667661d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:42.920327 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:42.920327 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:42.920327 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:42.920327 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:42.920327 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:42.920327 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:42.920327 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:42.920327 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:42.920327 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:42.920327 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:42.920327 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:42.920327 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:42.920327 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:42.920327 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:42.920327 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:42.921336 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:42.921336 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:42.921336 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:42.921336 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:42.921336 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:42.921336 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:42.921336 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:42.921336 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:42.921336 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:42.921336 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:42.921336 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:42.921336 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:42.921336 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:42.921336 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:42.921336 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:42.921336 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:42.921336 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:42.922297 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:42.922297 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:42.922297 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:42.922490 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca54c94-af6f-4efd-94ed-62cd130448c6 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:42.922490 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca54c94-af6f-4efd-94ed-62cd130448c6 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:42.922955 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 475/941] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:42.923041 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca54c94-af6f-4efd-94ed-62cd130448c6 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:42.924297 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 467/942] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:05:42.928291 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822dc7f-7929-448d-acf3-caedf667661d None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:42.928733 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a0d5b-4d68-4a2c-b807-24c8b511d7eb None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:42.929029 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a0d5b-4d68-4a2c-b807-24c8b511d7eb None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:42.929393 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a0d5b-4d68-4a2c-b807-24c8b511d7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:42.952790 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-ab2a0d5b-4d68-4a2c-b807-24c8b511d7eb None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:42.955190 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ab2a0d5b-4d68-4a2c-b807-24c8b511d7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:43.019682 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:43.043073 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822dc7f-7929-448d-acf3-caedf667661d None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:43.053772 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 468/943] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:05:43.054002 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc5367-c800-4c52-84b4-16e75d46e40b None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:43.054270 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc5367-c800-4c52-84b4-16e75d46e40b None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:43.054780 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc5367-c800-4c52-84b4-16e75d46e40b None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:43.060334 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 469/944] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:05:43.061671 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e2c69-2998-43f2-83cc-bff93ed7ce06 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:43.061873 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e2c69-2998-43f2-83cc-bff93ed7ce06 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:43.062153 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e2c69-2998-43f2-83cc-bff93ed7ce06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:43.083385 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e8338-c0fd-4afc-a9b6-00df5134497f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:43.083914 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-364e2c69-2998-43f2-83cc-bff93ed7ce06 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:43.084440 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e8338-c0fd-4afc-a9b6-00df5134497f None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:43.084869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e8338-c0fd-4afc-a9b6-00df5134497f None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:43.085149 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-364e2c69-2998-43f2-83cc-bff93ed7ce06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:43.085471 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e8338-c0fd-4afc-a9b6-00df5134497f None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:43.086268 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e8338-c0fd-4afc-a9b6-00df5134497f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:43.086753 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e8338-c0fd-4afc-a9b6-00df5134497f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:43.088581 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e8338-c0fd-4afc-a9b6-00df5134497f None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:43.106877 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 476/945] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:43.107957 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e8338-c0fd-4afc-a9b6-00df5134497f None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:43.166876 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 470/946] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:05:43.215231 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e8338-c0fd-4afc-a9b6-00df5134497f None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:43.252815 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71527a96-7699-4c84-a99b-27cc745b21ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:43.253451 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71527a96-7699-4c84-a99b-27cc745b21ca None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:43.253734 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71527a96-7699-4c84-a99b-27cc745b21ca None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:43.254008 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71527a96-7699-4c84-a99b-27cc745b21ca None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:43.261800 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71527a96-7699-4c84-a99b-27cc745b21ca None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:43.263282 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71527a96-7699-4c84-a99b-27cc745b21ca None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:43.266219 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:43.278075 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-71527a96-7699-4c84-a99b-27cc745b21ca None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 19:05:43.278075 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:43.278075 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:43.278075 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:43.278075 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:43.278075 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:43.278075 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:43.278075 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:43.278075 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:43.278075 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:43.278075 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:43.278075 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:43.278075 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:05:43.278075 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:05:43.278075 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:05:43.278075 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:05:43.279162 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:43.279162 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:43.279162 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:05:43.279162 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:43.279162 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:05:43.279162 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:43.279162 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:43.279162 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:43.279162 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:43.279162 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:43.279162 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:43.279162 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:43.279162 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:43.279162 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:43.279162 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:43.279162 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:43.279162 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:43.279162 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:43.280160 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:43.280160 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:43.280160 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:05:43.280160 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:05:43.280160 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:05:43.280160 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:05:43.280160 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:05:43.280160 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:05:43.280160 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 19:05:43.280160 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:43.282447 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 477/947] 10.222.0.79 () {56 vars in 1117 bytes} [Wed Aug 31 19:05:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:43.288545 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e2c69-2998-43f2-83cc-bff93ed7ce06 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:43.339885 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:43.365842 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71527a96-7699-4c84-a99b-27cc745b21ca None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:43.427247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e2c69-2998-43f2-83cc-bff93ed7ce06 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:43.477604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0c46b-43ae-4c29-95e8-aba08266e5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:43.479016 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0c46b-43ae-4c29-95e8-aba08266e5dd None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:43.479273 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0c46b-43ae-4c29-95e8-aba08266e5dd None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:43.479969 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0c46b-43ae-4c29-95e8-aba08266e5dd None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:43.480884 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce0c46b-43ae-4c29-95e8-aba08266e5dd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:43.481474 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce0c46b-43ae-4c29-95e8-aba08266e5dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:43.484937 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce0c46b-43ae-4c29-95e8-aba08266e5dd None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:43.485144 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71527a96-7699-4c84-a99b-27cc745b21ca None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:43.508419 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 471/948] 10.222.0.79 () {56 vars in 1149 bytes} [Wed Aug 31 19:05:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:43.508419 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0c46b-43ae-4c29-95e8-aba08266e5dd None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:43.531483 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3e210-15a2-40bf-b2a0-546349c70ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:43.532216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3e210-15a2-40bf-b2a0-546349c70ffe None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:43.532560 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3e210-15a2-40bf-b2a0-546349c70ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:43.532899 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3e210-15a2-40bf-b2a0-546349c70ffe None admin] PATH_INFO: `/v3/services/compute` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:43.533555 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3e210-15a2-40bf-b2a0-546349c70ffe None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:43.535492 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3e210-15a2-40bf-b2a0-546349c70ffe None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:43.545370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-ffa3e210-15a2-40bf-b2a0-546349c70ffe None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 19:05:43.545370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:43.545370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:05:43.545370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:05:43.545370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:05:43.545370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:05:43.545370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:05:43.545370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:05:43.545370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 19:05:43.545370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:43.545370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:05:43.545370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:43.545370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:43.545370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:43.545370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:43.545370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:43.545370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:43.546369 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:43.546369 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:43.546369 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:43.546369 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:43.546369 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:43.546369 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:43.546369 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:05:43.546369 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:05:43.546369 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:05:43.546369 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:05:43.546369 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:43.546369 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:43.546369 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:43.546369 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:43.546369 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:43.546369 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:43.547784 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:43.547784 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:43.547784 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:43.547784 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:43.547784 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:43.547784 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:43.547784 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:43.547784 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:43.547784 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:43.547784 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:43.547784 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:05:43.547784 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:05:43.547784 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 19:05:43.547784 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:43.547784 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 478/949] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:05:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:05:43.548563 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3e210-15a2-40bf-b2a0-546349c70ffe None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:43.618204 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:43.635502 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0c46b-43ae-4c29-95e8-aba08266e5dd None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:43.637254 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:43.665185 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3e210-15a2-40bf-b2a0-546349c70ffe None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:43.679279 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8ecc9-d3b9-40a7-b687-0266612cbb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:43.680003 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8ecc9-d3b9-40a7-b687-0266612cbb26 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:43.680351 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8ecc9-d3b9-40a7-b687-0266612cbb26 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:43.680697 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8ecc9-d3b9-40a7-b687-0266612cbb26 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:43.681392 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef8ecc9-d3b9-40a7-b687-0266612cbb26 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:43.682881 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef8ecc9-d3b9-40a7-b687-0266612cbb26 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:43.694420 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-8ef8ecc9-d3b9-40a7-b687-0266612cbb26 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:05:43.694420 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:43.694420 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:05:43.694420 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:05:43.694420 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:05:43.694420 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:05:43.694420 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:05:43.694420 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:05:43.694420 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:05:43.694420 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:43.694420 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:05:43.694420 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:43.694420 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:43.694420 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:43.694420 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:43.694420 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:43.694420 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:43.695466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:43.695466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:43.695466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:43.695466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:43.695466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:43.695466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:43.695466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:05:43.695466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:05:43.695466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:05:43.695466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:05:43.695466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:43.695466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:43.695466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:43.695466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:43.695466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:43.695466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:43.696405 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:43.696405 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:43.696405 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:43.696405 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:43.696405 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:43.696405 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:43.696405 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:43.696405 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:43.696405 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:43.696405 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:43.696405 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:05:43.696405 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:05:43.696405 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:05:43.696405 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:43.696405 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 472/950] 10.222.0.79 () {56 vars in 1126 bytes} [Wed Aug 31 19:05:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:43.697326 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8ecc9-d3b9-40a7-b687-0266612cbb26 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:43.708010 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479989a2-4c3c-45d1-8518-67eb4f558f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:43.708639 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479989a2-4c3c-45d1-8518-67eb4f558f43 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:43.708916 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479989a2-4c3c-45d1-8518-67eb4f558f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:43.709185 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479989a2-4c3c-45d1-8518-67eb4f558f43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:43.721196 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479989a2-4c3c-45d1-8518-67eb4f558f43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:43.722679 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479989a2-4c3c-45d1-8518-67eb4f558f43 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:43.740009 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-479989a2-4c3c-45d1-8518-67eb4f558f43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:43.740009 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:43.740009 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:43.740009 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:43.740009 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:43.740009 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:43.740009 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:43.740009 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:43.740009 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:43.740009 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:43.740009 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:43.740009 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:43.740009 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:43.740009 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:43.740009 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:43.740009 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:43.740969 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:43.740969 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:43.740969 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:43.740969 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:43.740969 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:43.740969 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:43.740969 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:43.740969 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:43.740969 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:43.740969 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:43.740969 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:43.740969 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:43.740969 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:43.740969 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:43.740969 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:43.740969 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:43.740969 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:43.741857 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:43.741857 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:43.741857 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:43.746585 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 479/951] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:43.747356 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479989a2-4c3c-45d1-8518-67eb4f558f43 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:43.815753 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8ecc9-d3b9-40a7-b687-0266612cbb26 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:43.859020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac8a1b2-ec55-45b3-adb7-d8de78bc9005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:43.859020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8a1b2-ec55-45b3-adb7-d8de78bc9005 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:43.859020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8a1b2-ec55-45b3-adb7-d8de78bc9005 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:43.859020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8a1b2-ec55-45b3-adb7-d8de78bc9005 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:43.859974 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac8a1b2-ec55-45b3-adb7-d8de78bc9005 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:43.860447 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac8a1b2-ec55-45b3-adb7-d8de78bc9005 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:43.862839 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac8a1b2-ec55-45b3-adb7-d8de78bc9005 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:43.864140 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479989a2-4c3c-45d1-8518-67eb4f558f43 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:43.874502 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 473/952] 10.222.0.79 () {56 vars in 1112 bytes} [Wed Aug 31 19:05:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:43.874502 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac8a1b2-ec55-45b3-adb7-d8de78bc9005 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:43.887396 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:43.905798 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:43.909918 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e0eda-3bb4-4c9a-8259-24f95dbea0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:43.910567 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e0eda-3bb4-4c9a-8259-24f95dbea0d3 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:43.910827 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e0eda-3bb4-4c9a-8259-24f95dbea0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:43.911100 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e0eda-3bb4-4c9a-8259-24f95dbea0d3 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:43.911771 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e0eda-3bb4-4c9a-8259-24f95dbea0d3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:43.912062 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e0eda-3bb4-4c9a-8259-24f95dbea0d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:43.913606 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e0eda-3bb4-4c9a-8259-24f95dbea0d3 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:43.923234 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 480/953] 10.222.0.79 () {56 vars in 1122 bytes} [Wed Aug 31 19:05:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:43.923234 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e0eda-3bb4-4c9a-8259-24f95dbea0d3 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:43.989408 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac8a1b2-ec55-45b3-adb7-d8de78bc9005 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:44.026184 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac94b4-5634-42e1-9f4a-553a6e56cc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:44.026986 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac94b4-5634-42e1-9f4a-553a6e56cc58 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:44.026986 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac94b4-5634-42e1-9f4a-553a6e56cc58 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:44.027281 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac94b4-5634-42e1-9f4a-553a6e56cc58 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:44.027928 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac94b4-5634-42e1-9f4a-553a6e56cc58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:44.028231 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac94b4-5634-42e1-9f4a-553a6e56cc58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:44.029596 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac94b4-5634-42e1-9f4a-553a6e56cc58 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:44.042296 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e0eda-3bb4-4c9a-8259-24f95dbea0d3 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:44.042608 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 474/954] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:44.043191 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac94b4-5634-42e1-9f4a-553a6e56cc58 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:44.085602 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07558cf6-e41e-463e-932a-b6d18b6249a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:44.086214 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07558cf6-e41e-463e-932a-b6d18b6249a1 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:44.086523 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07558cf6-e41e-463e-932a-b6d18b6249a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:44.086789 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07558cf6-e41e-463e-932a-b6d18b6249a1 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:44.087431 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07558cf6-e41e-463e-932a-b6d18b6249a1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:44.087734 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07558cf6-e41e-463e-932a-b6d18b6249a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:44.089112 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07558cf6-e41e-463e-932a-b6d18b6249a1 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:44.106493 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 481/955] 10.222.0.79 () {56 vars in 1112 bytes} [Wed Aug 31 19:05:43 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:44.106493 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07558cf6-e41e-463e-932a-b6d18b6249a1 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:44.149771 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:44.179408 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:44.198825 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac94b4-5634-42e1-9f4a-553a6e56cc58 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:44.227497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07558cf6-e41e-463e-932a-b6d18b6249a1 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:44.255763 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02a695-7ab8-4342-8886-bc0c5559cead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:44.256578 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02a695-7ab8-4342-8886-bc0c5559cead None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:44.256979 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02a695-7ab8-4342-8886-bc0c5559cead None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:44.257255 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02a695-7ab8-4342-8886-bc0c5559cead None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:44.257931 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02a695-7ab8-4342-8886-bc0c5559cead None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:44.258538 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02a695-7ab8-4342-8886-bc0c5559cead None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:44.260475 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02a695-7ab8-4342-8886-bc0c5559cead None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:44.270666 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 475/956] 10.222.0.79 () {56 vars in 1122 bytes} [Wed Aug 31 19:05:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:44.274926 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02a695-7ab8-4342-8886-bc0c5559cead None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:44.276472 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a675c074-d231-4d3c-9458-bf83de2173d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:44.277125 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675c074-d231-4d3c-9458-bf83de2173d9 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:44.277472 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675c074-d231-4d3c-9458-bf83de2173d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:44.277896 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675c074-d231-4d3c-9458-bf83de2173d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:44.287723 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a675c074-d231-4d3c-9458-bf83de2173d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:44.289251 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a675c074-d231-4d3c-9458-bf83de2173d9 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:44.302564 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-a675c074-d231-4d3c-9458-bf83de2173d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:44.302564 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:44.302564 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:44.302564 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:44.302564 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:44.302564 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:44.302564 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:44.302564 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:44.302564 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:44.302564 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:44.302564 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:44.302564 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:44.302564 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:05:44.302564 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:05:44.302564 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:05:44.303743 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:05:44.303743 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:44.303743 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:44.303743 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:44.303743 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:44.303743 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:44.303743 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:44.303743 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:44.303743 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:44.303743 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:44.303743 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:44.303743 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:44.303743 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:44.303743 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:44.303743 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:44.303743 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:44.303743 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:44.304852 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:05:44.304852 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:05:44.304852 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:05:44.304852 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:05:44.304852 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:05:44.304852 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:05:44.304852 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:44.304852 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:44.304852 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 482/957] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:05:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:44.309353 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a675c074-d231-4d3c-9458-bf83de2173d9 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:44.398350 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02a695-7ab8-4342-8886-bc0c5559cead None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:44.429999 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a675c074-d231-4d3c-9458-bf83de2173d9 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:44.432932 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:44.439342 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d658df6-93bf-4ac3-8474-717781cb30b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:44.440215 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d658df6-93bf-4ac3-8474-717781cb30b7 None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:44.440510 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d658df6-93bf-4ac3-8474-717781cb30b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:44.440784 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d658df6-93bf-4ac3-8474-717781cb30b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:44.441452 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d658df6-93bf-4ac3-8474-717781cb30b7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:44.442861 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d658df6-93bf-4ac3-8474-717781cb30b7 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:44.463975 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 476/958] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:05:44 2022] POST /identity/v3/endpoints => generated 349 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:05:44.465283 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d7475-7cf6-48d3-9805-2aa754abd318 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:44.465619 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d7475-7cf6-48d3-9805-2aa754abd318 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:44.465895 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d7475-7cf6-48d3-9805-2aa754abd318 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:44.467369 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 477/959] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:05:44.473236 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fa5c1-1963-444e-a0e9-0f7d301232fa None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:44.473578 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fa5c1-1963-444e-a0e9-0f7d301232fa None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:44.473892 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fa5c1-1963-444e-a0e9-0f7d301232fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:44.489571 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c658b5-d48a-49ea-8461-a8e4fd7102b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:44.490629 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c658b5-d48a-49ea-8461-a8e4fd7102b2 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:44.491073 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c658b5-d48a-49ea-8461-a8e4fd7102b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:44.491550 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c658b5-d48a-49ea-8461-a8e4fd7102b2 None admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:44.492759 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c658b5-d48a-49ea-8461-a8e4fd7102b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:44.493245 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c658b5-d48a-49ea-8461-a8e4fd7102b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:44.495161 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c658b5-d48a-49ea-8461-a8e4fd7102b2 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:44.495346 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-846fa5c1-1963-444e-a0e9-0f7d301232fa None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:44.496593 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-846fa5c1-1963-444e-a0e9-0f7d301232fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:44.500802 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:44.519021 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 483/960] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 19:05:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:05:44.520676 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c658b5-d48a-49ea-8461-a8e4fd7102b2 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:44.606733 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 478/961] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:05:44.666723 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c658b5-d48a-49ea-8461-a8e4fd7102b2 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:44.703276 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff57c6-e8ea-4c25-8eb3-570e40e6db6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:44.704186 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff57c6-e8ea-4c25-8eb3-570e40e6db6d None admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:44.704636 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff57c6-e8ea-4c25-8eb3-570e40e6db6d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:44.705052 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff57c6-e8ea-4c25-8eb3-570e40e6db6d None admin] PATH_INFO: `/v3/projects/f9e550ea75dd4245bd9c2bcd6322c507/users/3e070c93f47045ecb5bf0a1622395091/roles/adbf346347dc40afa78c773cfc32c750` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:44.707686 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff57c6-e8ea-4c25-8eb3-570e40e6db6d None admin] RBAC: Authorizing `identity:create_grant(project_id=f9e550ea75dd4245bd9c2bcd6322c507, user_id=3e070c93f47045ecb5bf0a1622395091, role_id=adbf346347dc40afa78c773cfc32c750)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:44.709295 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff57c6-e8ea-4c25-8eb3-570e40e6db6d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:44.725992 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 484/962] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 19:05:44 2022] PUT /identity/v3/projects/f9e550ea75dd4245bd9c2bcd6322c507/users/3e070c93f47045ecb5bf0a1622395091/roles/adbf346347dc40afa78c773cfc32c750 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:05:44.904495 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846fa5c1-1963-444e-a0e9-0f7d301232fa None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:45.013317 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846fa5c1-1963-444e-a0e9-0f7d301232fa None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:45.052098 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30edd49f-2621-494e-a523-1527eb130b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:45.052827 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edd49f-2621-494e-a523-1527eb130b39 None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:45.053107 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edd49f-2621-494e-a523-1527eb130b39 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:45.053382 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edd49f-2621-494e-a523-1527eb130b39 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:45.054038 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30edd49f-2621-494e-a523-1527eb130b39 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:45.055544 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30edd49f-2621-494e-a523-1527eb130b39 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:45.058543 dv-cinder-852210-6-smb devstack@keystone.service[81683]: WARNING keystone.server.flask.common [None req-30edd49f-2621-494e-a523-1527eb130b39 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 31 19:05:45.072342 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.sql.core [None req-30edd49f-2621-494e-a523-1527eb130b39 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 19:05:45.072342 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 19:05:45.072342 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [parameters: {'user_id': 'c337ced62cbb429289e79931d2476435', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 19:05:45.072342 dv-cinder-852210-6-smb devstack@keystone.service[81683]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81683) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 19:05:45.080448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-30edd49f-2621-494e-a523-1527eb130b39 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 19:05:45.080448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:45.080448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 19:05:45.080448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 19:05:45.080448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 19:05:45.080448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 19:05:45.080448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 19:05:45.080448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 19:05:45.080448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 19:05:45.080448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application conn.query(q) Aug 31 19:05:45.080448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 19:05:45.080448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 19:05:45.080448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 19:05:45.080448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application result.read() Aug 31 19:05:45.080448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 19:05:45.081536 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 19:05:45.081536 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 19:05:45.081536 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 19:05:45.081536 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 19:05:45.081536 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 19:05:45.081536 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 19:05:45.081536 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 19:05:45.081536 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 19:05:45.081536 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:45.081536 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 19:05:45.081536 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:45.081536 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:45.081536 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 19:05:45.081536 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 19:05:45.081536 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 31 19:05:45.081536 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 31 19:05:45.081536 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 19:05:45.081536 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application next(self.gen) Aug 31 19:05:45.082789 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 19:05:45.082789 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application yield resource Aug 31 19:05:45.082789 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 19:05:45.082789 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application next(self.gen) Aug 31 19:05:45.082789 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 19:05:45.082789 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 19:05:45.082789 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 19:05:45.082789 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 19:05:45.082789 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 19:05:45.082789 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise self.value Aug 31 19:05:45.082789 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 19:05:45.082789 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 19:05:45.082789 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 19:05:45.082789 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application session.commit() Aug 31 19:05:45.082789 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 19:05:45.082789 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 19:05:45.082789 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 19:05:45.084307 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 19:05:45.084307 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 19:05:45.084307 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self.session.flush() Aug 31 19:05:45.084307 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 19:05:45.084307 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 19:05:45.084307 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 19:05:45.084307 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 19:05:45.084307 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 19:05:45.084307 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application compat.raise_( Aug 31 19:05:45.084307 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 19:05:45.084307 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception Aug 31 19:05:45.084307 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 19:05:45.084307 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 19:05:45.084307 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 19:05:45.084307 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 19:05:45.084307 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 19:05:45.084307 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 19:05:45.085214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 19:05:45.085214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 19:05:45.085214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 31 19:05:45.085214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 31 19:05:45.085214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 19:05:45.085214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 19:05:45.085214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 19:05:45.085214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 19:05:45.085214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 19:05:45.085214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 19:05:45.085214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 19:05:45.085214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 19:05:45.085214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 19:05:45.085214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 19:05:45.085214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 19:05:45.085214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception Aug 31 19:05:45.086072 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 19:05:45.086072 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 19:05:45.086072 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 19:05:45.086072 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 19:05:45.086072 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 19:05:45.086072 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 19:05:45.086072 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 19:05:45.086072 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application conn.query(q) Aug 31 19:05:45.086072 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 19:05:45.086072 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 19:05:45.086072 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 19:05:45.086072 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application result.read() Aug 31 19:05:45.086072 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 19:05:45.086072 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 19:05:45.086072 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 19:05:45.086072 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 19:05:45.086968 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 19:05:45.086968 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 19:05:45.086968 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 19:05:45.086968 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 19:05:45.086968 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 19:05:45.086968 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 19:05:45.086968 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [parameters: {'user_id': 'c337ced62cbb429289e79931d2476435', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 19:05:45.086968 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 19:05:45.086968 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:45.086968 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:05:45.086968 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:45.086968 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:45.086968 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:45.086968 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:45.086968 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:45.088244 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:45.088244 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:45.088244 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:45.088244 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:45.088244 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:45.088244 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:45.088244 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:45.088244 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 31 19:05:45.088244 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 31 19:05:45.088244 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:45.088244 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:45.088244 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:05:45.088244 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:45.088244 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:05:45.088244 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:45.088244 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 31 19:05:45.088244 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 31 19:05:45.090816 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 31 19:05:45.090816 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 31 19:05:45.090816 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 19:05:45.090816 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 19:05:45.090816 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 19:05:45.090816 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:45.090816 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 479/963] 10.222.0.79 () {60 vars in 1131 bytes} [Wed Aug 31 19:05:44 2022] POST /identity/v3/users => generated 160 bytes in 178 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:45.091349 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff57c6-e8ea-4c25-8eb3-570e40e6db6d None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:45.118150 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:45.223424 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff57c6-e8ea-4c25-8eb3-570e40e6db6d None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:45.265107 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21bb51-e458-4eb0-9058-be996cc8f882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:45.266603 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21bb51-e458-4eb0-9058-be996cc8f882 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:45.267222 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21bb51-e458-4eb0-9058-be996cc8f882 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:45.267730 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21bb51-e458-4eb0-9058-be996cc8f882 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:45.277578 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21bb51-e458-4eb0-9058-be996cc8f882 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:45.279831 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21bb51-e458-4eb0-9058-be996cc8f882 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:45.294639 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-1f21bb51-e458-4eb0-9058-be996cc8f882 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 19:05:45.294639 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:45.294639 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:45.294639 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:45.294639 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:45.294639 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:45.294639 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:45.294639 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:45.294639 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:45.294639 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:45.294639 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:45.294639 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:45.294639 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:05:45.294639 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:05:45.294639 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:05:45.294639 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:05:45.295947 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:45.295947 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:45.295947 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:05:45.295947 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:45.295947 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:05:45.295947 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:45.295947 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:45.295947 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:45.295947 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:45.295947 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:45.295947 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:45.295947 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:45.295947 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:45.295947 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:45.295947 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:45.295947 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:45.295947 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:45.295947 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:45.297810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:45.297810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:45.297810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:05:45.297810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:05:45.297810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:05:45.297810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:05:45.297810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:05:45.297810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:05:45.297810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 19:05:45.297810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:45.305229 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 485/964] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:05:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:45.307001 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30edd49f-2621-494e-a523-1527eb130b39 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:45.328679 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:45.422642 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30edd49f-2621-494e-a523-1527eb130b39 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:45.459284 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c35fcc8-0134-42ea-b822-be403d80905f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:45.459906 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35fcc8-0134-42ea-b822-be403d80905f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:45.460193 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35fcc8-0134-42ea-b822-be403d80905f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:45.460467 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35fcc8-0134-42ea-b822-be403d80905f None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:45.461187 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c35fcc8-0134-42ea-b822-be403d80905f None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:45.461493 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c35fcc8-0134-42ea-b822-be403d80905f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:45.463170 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c35fcc8-0134-42ea-b822-be403d80905f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:45.504705 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 480/965] 10.222.0.79 () {56 vars in 1101 bytes} [Wed Aug 31 19:05:45 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:46.115940 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134f8cf-fe9c-41ff-881e-8b0ba1ce7bcd None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:46.116531 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134f8cf-fe9c-41ff-881e-8b0ba1ce7bcd None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:46.116531 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134f8cf-fe9c-41ff-881e-8b0ba1ce7bcd None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:46.117988 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 486/966] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:05:46.123153 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2131d1b-ace5-46ed-bc7a-e4424fa9bf43 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:46.123673 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2131d1b-ace5-46ed-bc7a-e4424fa9bf43 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:46.123764 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2131d1b-ace5-46ed-bc7a-e4424fa9bf43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:46.142337 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-e2131d1b-ace5-46ed-bc7a-e4424fa9bf43 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:46.143883 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e2131d1b-ace5-46ed-bc7a-e4424fa9bf43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:46.205963 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:46.220018 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 481/967] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:05:46.493347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134f8cf-fe9c-41ff-881e-8b0ba1ce7bcd None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:46.559449 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6d21a-c45c-48f1-a7cf-83e2904ef2a6 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:46.559741 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6d21a-c45c-48f1-a7cf-83e2904ef2a6 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:46.560019 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6d21a-c45c-48f1-a7cf-83e2904ef2a6 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:46.561500 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 482/968] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:05:46.566540 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90399d-6ab8-4102-8262-42496100577a None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:46.566835 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90399d-6ab8-4102-8262-42496100577a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:46.567117 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90399d-6ab8-4102-8262-42496100577a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:46.586648 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-fa90399d-6ab8-4102-8262-42496100577a None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:46.587844 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-fa90399d-6ab8-4102-8262-42496100577a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:46.588597 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:46.624900 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134f8cf-fe9c-41ff-881e-8b0ba1ce7bcd None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:46.665805 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c86d4-e698-4025-8099-ed5ff93d0be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:46.666760 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c86d4-e698-4025-8099-ed5ff93d0be5 None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:46.667255 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c86d4-e698-4025-8099-ed5ff93d0be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:46.667726 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c86d4-e698-4025-8099-ed5ff93d0be5 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:46.668687 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c86d4-e698-4025-8099-ed5ff93d0be5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:46.669811 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 483/969] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:05:46.670583 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c86d4-e698-4025-8099-ed5ff93d0be5 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:46.687136 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 487/970] 10.222.0.79 () {60 vars in 1141 bytes} [Wed Aug 31 19:05:46 2022] POST /identity/v3/services => generated 242 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:05:46.806676 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0e08b-84ed-4608-b839-56d0873f2b8f None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:46.806974 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0e08b-84ed-4608-b839-56d0873f2b8f None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:46.807152 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0e08b-84ed-4608-b839-56d0873f2b8f None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:46.808681 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 484/971] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:05:46.814666 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f64ab-50c1-4f40-a830-772bd5df2753 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:46.814959 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f64ab-50c1-4f40-a830-772bd5df2753 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:46.815229 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f64ab-50c1-4f40-a830-772bd5df2753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:46.835865 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-108f64ab-50c1-4f40-a830-772bd5df2753 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:46.837058 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-108f64ab-50c1-4f40-a830-772bd5df2753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:46.925903 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 488/972] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:46 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:05:46.938712 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0e08b-84ed-4608-b839-56d0873f2b8f None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:47.054628 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0e08b-84ed-4608-b839-56d0873f2b8f None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:47.075415 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:47.090894 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ca7d9-78a5-4afc-9964-f5e97e8b2693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:47.091535 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ca7d9-78a5-4afc-9964-f5e97e8b2693 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:47.091813 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ca7d9-78a5-4afc-9964-f5e97e8b2693 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:47.092087 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ca7d9-78a5-4afc-9964-f5e97e8b2693 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:47.092671 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ca7d9-78a5-4afc-9964-f5e97e8b2693 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:47.094601 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ca7d9-78a5-4afc-9964-f5e97e8b2693 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:47.104144 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-2f4ca7d9-78a5-4afc-9964-f5e97e8b2693 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:05:47.104144 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:47.104144 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:05:47.104144 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:05:47.104144 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:05:47.104144 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:05:47.104144 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:05:47.104144 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:05:47.104144 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:05:47.104144 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:47.104144 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:05:47.104144 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:47.104144 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:47.104144 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:47.104144 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:47.104144 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:47.104144 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:47.105228 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:47.105228 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:47.105228 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:47.105228 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:47.105228 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:47.105228 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:47.105228 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:05:47.105228 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:05:47.105228 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:05:47.105228 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:05:47.105228 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:47.105228 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:47.105228 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:47.105228 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:47.105228 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:47.105228 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:47.107631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:47.107631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:47.107631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:47.107631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:47.107631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:47.107631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:47.107631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:47.107631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:47.107631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:47.107631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:47.107631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:05:47.107631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:05:47.107631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:05:47.107631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:47.107631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 485/973] 10.222.0.79 () {56 vars in 1126 bytes} [Wed Aug 31 19:05:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:47.112014 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f64ab-50c1-4f40-a830-772bd5df2753 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:47.182597 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:47.206963 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ca7d9-78a5-4afc-9964-f5e97e8b2693 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:47.222427 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f64ab-50c1-4f40-a830-772bd5df2753 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:47.260135 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed603cc7-7caf-48ab-82ca-49e272131396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:47.260754 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed603cc7-7caf-48ab-82ca-49e272131396 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:47.261034 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed603cc7-7caf-48ab-82ca-49e272131396 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:47.261308 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed603cc7-7caf-48ab-82ca-49e272131396 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:47.261953 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed603cc7-7caf-48ab-82ca-49e272131396 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:47.262256 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed603cc7-7caf-48ab-82ca-49e272131396 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:47.263662 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed603cc7-7caf-48ab-82ca-49e272131396 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:47.269545 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 489/974] 10.222.0.79 () {56 vars in 1122 bytes} [Wed Aug 31 19:05:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:47.275265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed603cc7-7caf-48ab-82ca-49e272131396 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:47.320836 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ca7d9-78a5-4afc-9964-f5e97e8b2693 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:47.358169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12d449-92fb-47b0-9b65-8f55ad794a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:47.358829 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12d449-92fb-47b0-9b65-8f55ad794a69 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:47.359145 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12d449-92fb-47b0-9b65-8f55ad794a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:47.359415 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12d449-92fb-47b0-9b65-8f55ad794a69 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:47.370029 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a12d449-92fb-47b0-9b65-8f55ad794a69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:05:47.375340 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-0a12d449-92fb-47b0-9b65-8f55ad794a69 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 19:05:47.375340 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:47.375340 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:47.375340 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:47.375340 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:47.375340 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:47.375340 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:47.375340 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:47.375340 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:47.375340 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:47.375340 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:47.375340 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:47.375340 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:05:47.375340 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:05:47.375340 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:05:47.375340 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:05:47.376381 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:05:47.376381 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:05:47.376381 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:05:47.376381 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:05:47.376381 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:47.376381 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:47.376381 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:47.376381 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:47.376381 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:47.376381 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:47.376381 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:47.376381 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:47.376381 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:47.376381 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:47.376381 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:47.376381 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:47.377246 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:47.377246 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:47.377246 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:47.377246 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:47.377246 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:05:47.377246 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:05:47.377246 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:05:47.377246 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:05:47.377246 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:05:47.377246 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:05:47.377246 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 19:05:47.377246 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:47.377246 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 486/975] 10.222.0.79 () {56 vars in 1120 bytes} [Wed Aug 31 19:05:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:05:47.382569 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12d449-92fb-47b0-9b65-8f55ad794a69 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:47.388737 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed603cc7-7caf-48ab-82ca-49e272131396 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:47.420265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:47.426701 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398a470-c3fe-4d29-9455-6753a8fda010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:47.427367 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398a470-c3fe-4d29-9455-6753a8fda010 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:47.427654 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398a470-c3fe-4d29-9455-6753a8fda010 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:47.427930 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398a470-c3fe-4d29-9455-6753a8fda010 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:47.428571 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c398a470-c3fe-4d29-9455-6753a8fda010 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:47.428876 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c398a470-c3fe-4d29-9455-6753a8fda010 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:47.430242 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c398a470-c3fe-4d29-9455-6753a8fda010 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:47.435059 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:47.435639 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 490/976] 10.222.0.79 () {56 vars in 1122 bytes} [Wed Aug 31 19:05:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:05:47.441354 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398a470-c3fe-4d29-9455-6753a8fda010 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:47.497457 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12d449-92fb-47b0-9b65-8f55ad794a69 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:47.541489 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc88b3c-294b-45d6-ad44-a9433606bd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:47.542227 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc88b3c-294b-45d6-ad44-a9433606bd28 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:47.542537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc88b3c-294b-45d6-ad44-a9433606bd28 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:47.542812 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc88b3c-294b-45d6-ad44-a9433606bd28 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:47.543490 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc88b3c-294b-45d6-ad44-a9433606bd28 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:47.543798 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc88b3c-294b-45d6-ad44-a9433606bd28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:47.545169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc88b3c-294b-45d6-ad44-a9433606bd28 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:47.554098 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398a470-c3fe-4d29-9455-6753a8fda010 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:47.558505 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 487/977] 10.222.0.79 () {56 vars in 1115 bytes} [Wed Aug 31 19:05:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:05:47.560010 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc88b3c-294b-45d6-ad44-a9433606bd28 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:47.596728 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8148058-6fe7-461f-b2ec-557426b01d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:47.597399 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8148058-6fe7-461f-b2ec-557426b01d70 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:47.597682 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8148058-6fe7-461f-b2ec-557426b01d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:47.597949 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8148058-6fe7-461f-b2ec-557426b01d70 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:47.598696 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8148058-6fe7-461f-b2ec-557426b01d70 None admin] RBAC: Adding query filter params (interface=admin, service_id=cceb3127a3854671928e1d966e1c606e, region_id=RegionOne) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:47.599004 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8148058-6fe7-461f-b2ec-557426b01d70 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:47.600368 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8148058-6fe7-461f-b2ec-557426b01d70 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:47.605700 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 491/978] 10.222.0.79 () {56 vars in 1249 bytes} [Wed Aug 31 19:05:47 2022] GET /identity/v3/endpoints?service_id=cceb3127a3854671928e1d966e1c606e&interface=admin®ion_id=RegionOne => generated 193 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:05:47.611960 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8148058-6fe7-461f-b2ec-557426b01d70 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:47.673310 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:47.683515 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc88b3c-294b-45d6-ad44-a9433606bd28 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:47.691348 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:47.722339 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249d2cc-10d7-4a80-a89c-d54ecc7d3989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:47.722573 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8148058-6fe7-461f-b2ec-557426b01d70 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:47.723010 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249d2cc-10d7-4a80-a89c-d54ecc7d3989 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:47.723289 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249d2cc-10d7-4a80-a89c-d54ecc7d3989 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:47.723561 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249d2cc-10d7-4a80-a89c-d54ecc7d3989 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:47.736387 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d249d2cc-10d7-4a80-a89c-d54ecc7d3989 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:47.737892 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d249d2cc-10d7-4a80-a89c-d54ecc7d3989 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:47.755121 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-d249d2cc-10d7-4a80-a89c-d54ecc7d3989 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:47.755121 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:47.755121 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:47.755121 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:47.755121 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:47.755121 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:47.755121 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:47.755121 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:47.755121 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:47.755121 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:47.755121 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:47.755121 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:47.755121 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:47.755121 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:47.755121 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:47.755121 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:47.756940 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:47.756940 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:47.756940 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:47.756940 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:47.756940 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:47.756940 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:47.756940 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:47.756940 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:47.756940 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:47.756940 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:47.756940 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:47.756940 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:47.756940 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:47.756940 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:47.756940 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:47.756940 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:47.756940 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:47.758068 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:47.758068 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:47.758068 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:47.758068 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 488/979] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:05:47.762326 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249d2cc-10d7-4a80-a89c-d54ecc7d3989 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:47.768212 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095244a5-572f-479e-9d43-f1349215a6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:47.769158 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095244a5-572f-479e-9d43-f1349215a6da None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:47.769615 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095244a5-572f-479e-9d43-f1349215a6da None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:47.770033 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095244a5-572f-479e-9d43-f1349215a6da None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:47.770969 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095244a5-572f-479e-9d43-f1349215a6da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:47.772482 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095244a5-572f-479e-9d43-f1349215a6da None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:47.782621 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 492/980] 10.222.0.79 () {56 vars in 1087 bytes} [Wed Aug 31 19:05:47 2022] GET /identity/v3/services => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:05:47.879974 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249d2cc-10d7-4a80-a89c-d54ecc7d3989 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:47.920797 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb951d2f-c0ed-406d-9799-770ea6fb9a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:47.921419 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb951d2f-c0ed-406d-9799-770ea6fb9a20 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:47.921732 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb951d2f-c0ed-406d-9799-770ea6fb9a20 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:47.922004 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb951d2f-c0ed-406d-9799-770ea6fb9a20 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:47.922687 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb951d2f-c0ed-406d-9799-770ea6fb9a20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:47.922989 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb951d2f-c0ed-406d-9799-770ea6fb9a20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:47.924359 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb951d2f-c0ed-406d-9799-770ea6fb9a20 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:47.942471 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 489/981] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:05:47.944867 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095244a5-572f-479e-9d43-f1349215a6da None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:48.068456 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095244a5-572f-479e-9d43-f1349215a6da None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:48.095491 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:48.110975 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b59f32-73e3-4398-b649-bd565db4b942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:48.111781 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b59f32-73e3-4398-b649-bd565db4b942 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:48.112045 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b59f32-73e3-4398-b649-bd565db4b942 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:48.112363 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b59f32-73e3-4398-b649-bd565db4b942 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:48.120457 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b59f32-73e3-4398-b649-bd565db4b942 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:48.121901 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b59f32-73e3-4398-b649-bd565db4b942 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:48.136203 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-67b59f32-73e3-4398-b649-bd565db4b942 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 19:05:48.136203 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:48.136203 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:48.136203 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:48.136203 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:48.136203 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:48.136203 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:48.136203 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:48.136203 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:48.136203 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:48.136203 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:48.136203 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:48.136203 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:05:48.136203 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:05:48.136203 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:05:48.136203 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:05:48.137544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:48.137544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:48.137544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:05:48.137544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:48.137544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:05:48.137544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:48.137544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:48.137544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:48.137544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:48.137544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:48.137544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:48.137544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:48.137544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:48.137544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:48.137544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:48.137544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:48.137544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:48.137544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:48.139810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:48.139810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:48.139810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:05:48.139810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:05:48.139810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:05:48.139810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:05:48.139810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:05:48.139810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:05:48.139810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 19:05:48.139810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:48.141389 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 493/982] 10.222.0.79 () {56 vars in 1117 bytes} [Wed Aug 31 19:05:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:48.144283 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb951d2f-c0ed-406d-9799-770ea6fb9a20 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:48.165720 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:48.257075 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb951d2f-c0ed-406d-9799-770ea6fb9a20 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:48.298040 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c56163-4b47-4c4c-9e9a-a381eb4407a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:48.298686 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c56163-4b47-4c4c-9e9a-a381eb4407a5 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:48.298969 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c56163-4b47-4c4c-9e9a-a381eb4407a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:48.299242 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c56163-4b47-4c4c-9e9a-a381eb4407a5 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:48.299988 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c56163-4b47-4c4c-9e9a-a381eb4407a5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:48.300301 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c56163-4b47-4c4c-9e9a-a381eb4407a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:48.301739 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c56163-4b47-4c4c-9e9a-a381eb4407a5 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:48.326034 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 490/983] 10.222.0.79 () {56 vars in 1149 bytes} [Wed Aug 31 19:05:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:48.327414 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b59f32-73e3-4398-b649-bd565db4b942 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:48.440886 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b59f32-73e3-4398-b649-bd565db4b942 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:48.482631 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45620460-25d2-44c4-b1fa-abb5100031ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:48.483244 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45620460-25d2-44c4-b1fa-abb5100031ba None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:48.483526 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45620460-25d2-44c4-b1fa-abb5100031ba None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:48.483830 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45620460-25d2-44c4-b1fa-abb5100031ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:48.543099 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:48.566789 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45620460-25d2-44c4-b1fa-abb5100031ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:48.568333 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45620460-25d2-44c4-b1fa-abb5100031ba None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:48.642558 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a13ec5-03a6-4fa8-a982-80b101428c4c None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:48.643157 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a13ec5-03a6-4fa8-a982-80b101428c4c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:48.643639 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a13ec5-03a6-4fa8-a982-80b101428c4c None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:48.645185 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 491/984] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:05:48.651278 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee2820-146e-4b24-81a5-ebf9ad6ca6c7 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:48.651654 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee2820-146e-4b24-81a5-ebf9ad6ca6c7 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:48.652000 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee2820-146e-4b24-81a5-ebf9ad6ca6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:48.671059 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-feee2820-146e-4b24-81a5-ebf9ad6ca6c7 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:48.672799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-feee2820-146e-4b24-81a5-ebf9ad6ca6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:48.698383 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 494/985] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:05:48 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 19:05:48.704351 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45620460-25d2-44c4-b1fa-abb5100031ba None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:48.752681 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 492/986] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:48 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:05:48.794220 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:48.816561 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45620460-25d2-44c4-b1fa-abb5100031ba None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:48.854658 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5cac7-7dea-4824-b833-1b90cbeccfa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:48.855345 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5cac7-7dea-4824-b833-1b90cbeccfa8 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:48.855765 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5cac7-7dea-4824-b833-1b90cbeccfa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:48.856042 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5cac7-7dea-4824-b833-1b90cbeccfa8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:48.868781 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e5cac7-7dea-4824-b833-1b90cbeccfa8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:48.870493 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e5cac7-7dea-4824-b833-1b90cbeccfa8 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:48.887159 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-69e5cac7-7dea-4824-b833-1b90cbeccfa8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:48.887159 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:48.887159 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:48.887159 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:48.887159 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:48.887159 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:48.887159 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:48.887159 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:48.887159 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:48.887159 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:48.887159 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:48.887159 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:48.887159 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:48.887159 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:48.887159 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:48.887159 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:48.888166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:48.888166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:48.888166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:48.888166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:48.888166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:48.888166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:48.888166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:48.888166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:48.888166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:48.888166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:48.888166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:48.888166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:48.888166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:48.888166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:48.888166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:48.888166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:48.888166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:48.889075 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:48.889075 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:48.889075 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:48.889075 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 495/987] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:05:48.894162 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee2820-146e-4b24-81a5-ebf9ad6ca6c7 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:48.905201 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:49.005685 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee2820-146e-4b24-81a5-ebf9ad6ca6c7 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:49.037204 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5cac7-7dea-4824-b833-1b90cbeccfa8 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:49.041679 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c70fa5-4c67-4e2d-ab61-1d876fa2f0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:49.042292 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c70fa5-4c67-4e2d-ab61-1d876fa2f0a8 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:49.042599 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c70fa5-4c67-4e2d-ab61-1d876fa2f0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:49.042867 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c70fa5-4c67-4e2d-ab61-1d876fa2f0a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:49.043533 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c70fa5-4c67-4e2d-ab61-1d876fa2f0a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:49.043831 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c70fa5-4c67-4e2d-ab61-1d876fa2f0a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:49.045184 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c70fa5-4c67-4e2d-ab61-1d876fa2f0a8 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:49.067962 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 493/988] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:05:49.069173 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c70fa5-4c67-4e2d-ab61-1d876fa2f0a8 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:49.143258 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:49.170896 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5cac7-7dea-4824-b833-1b90cbeccfa8 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:49.181422 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c70fa5-4c67-4e2d-ab61-1d876fa2f0a8 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:49.212961 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3a21a-0267-4083-b920-7f217d454576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:49.213910 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3a21a-0267-4083-b920-7f217d454576 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:49.214246 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3a21a-0267-4083-b920-7f217d454576 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:49.214614 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3a21a-0267-4083-b920-7f217d454576 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:49.215194 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f3a21a-0267-4083-b920-7f217d454576 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:49.216560 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f3a21a-0267-4083-b920-7f217d454576 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:49.218590 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:49.221054 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b06d67-0ae5-4a3e-92a8-8d0c235d6f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:49.221823 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b06d67-0ae5-4a3e-92a8-8d0c235d6f19 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:49.222171 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b06d67-0ae5-4a3e-92a8-8d0c235d6f19 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:49.222560 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b06d67-0ae5-4a3e-92a8-8d0c235d6f19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:49.227897 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-c5f3a21a-0267-4083-b920-7f217d454576 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 19:05:49.227897 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:49.227897 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:05:49.227897 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:05:49.227897 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:05:49.227897 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:05:49.227897 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:05:49.227897 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:05:49.227897 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 19:05:49.227897 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:49.227897 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:05:49.227897 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:49.227897 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:49.227897 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:49.227897 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:49.227897 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:49.227897 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:49.229413 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:49.229413 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:49.229413 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:49.229413 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:49.229413 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:49.229413 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:49.229413 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:05:49.229413 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:05:49.229413 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:05:49.229413 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:05:49.229413 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:49.229413 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:49.229413 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:49.229413 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:49.229413 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:49.229413 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:49.230516 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:49.230516 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:49.230516 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:49.230516 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:49.230516 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:49.230516 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:49.230516 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:49.230516 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:49.230516 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:49.230516 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:49.230516 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:05:49.230516 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:05:49.230516 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 19:05:49.230516 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:49.231392 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b06d67-0ae5-4a3e-92a8-8d0c235d6f19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:49.232145 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b06d67-0ae5-4a3e-92a8-8d0c235d6f19 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:49.234871 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 496/989] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:05:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:49.237957 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3a21a-0267-4083-b920-7f217d454576 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:49.244885 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-38b06d67-0ae5-4a3e-92a8-8d0c235d6f19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:49.244885 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:49.244885 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:49.244885 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:49.244885 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:49.244885 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:49.244885 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:49.244885 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:49.244885 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:49.244885 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:49.244885 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:49.244885 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:49.244885 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:05:49.244885 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:05:49.244885 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:05:49.246295 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:05:49.246295 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:49.246295 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:49.246295 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:49.246295 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:49.246295 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:49.246295 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:49.246295 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:49.246295 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:49.246295 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:49.246295 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:49.246295 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:49.246295 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:49.246295 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:49.246295 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:49.246295 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:49.246295 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:49.249395 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:05:49.249395 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:05:49.249395 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:05:49.249395 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:05:49.249395 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:05:49.249395 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:05:49.249395 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:49.249395 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:49.251469 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 494/990] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:05:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:05:49.252366 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b06d67-0ae5-4a3e-92a8-8d0c235d6f19 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:49.355951 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3a21a-0267-4083-b920-7f217d454576 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:49.380605 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b06d67-0ae5-4a3e-92a8-8d0c235d6f19 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:49.400924 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b018343-7bce-4c70-878c-d8357c85156f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:49.401540 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b018343-7bce-4c70-878c-d8357c85156f None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:49.402116 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b018343-7bce-4c70-878c-d8357c85156f None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:49.402116 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b018343-7bce-4c70-878c-d8357c85156f None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:49.402791 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b018343-7bce-4c70-878c-d8357c85156f None admin] RBAC: Adding query filter params (name=compute) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:49.402791 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b018343-7bce-4c70-878c-d8357c85156f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:49.404869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b018343-7bce-4c70-878c-d8357c85156f None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:49.410797 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 497/991] 10.222.0.79 () {56 vars in 1112 bytes} [Wed Aug 31 19:05:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:05:49.411544 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:49.416459 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b018343-7bce-4c70-878c-d8357c85156f None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:49.425427 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de492b1-12d4-4e0b-ab55-9666e4c5367e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:49.426110 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de492b1-12d4-4e0b-ab55-9666e4c5367e None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:49.426390 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de492b1-12d4-4e0b-ab55-9666e4c5367e None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:49.426698 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de492b1-12d4-4e0b-ab55-9666e4c5367e None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:49.427424 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de492b1-12d4-4e0b-ab55-9666e4c5367e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:49.427736 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de492b1-12d4-4e0b-ab55-9666e4c5367e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:49.429326 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de492b1-12d4-4e0b-ab55-9666e4c5367e None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:49.442911 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 495/992] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 19:05:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:49.449635 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de492b1-12d4-4e0b-ab55-9666e4c5367e None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:49.491136 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:49.546346 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b018343-7bce-4c70-878c-d8357c85156f None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:49.578646 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de492b1-12d4-4e0b-ab55-9666e4c5367e None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:49.590291 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea9c21-d3cd-43f3-bc9a-6eb8b0d99e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:49.590982 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea9c21-d3cd-43f3-bc9a-6eb8b0d99e5e None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:49.591283 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea9c21-d3cd-43f3-bc9a-6eb8b0d99e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:49.591578 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea9c21-d3cd-43f3-bc9a-6eb8b0d99e5e None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:49.592284 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea9c21-d3cd-43f3-bc9a-6eb8b0d99e5e None admin] RBAC: Adding query filter params (type=compute) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:49.592589 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea9c21-d3cd-43f3-bc9a-6eb8b0d99e5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:49.594764 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea9c21-d3cd-43f3-bc9a-6eb8b0d99e5e None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:49.600448 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 498/993] 10.222.0.79 () {56 vars in 1112 bytes} [Wed Aug 31 19:05:49 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:05:49.606503 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea9c21-d3cd-43f3-bc9a-6eb8b0d99e5e None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:49.630013 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f570fc-85ab-405a-ae58-cd5260920581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:49.630665 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f570fc-85ab-405a-ae58-cd5260920581 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:49.631134 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f570fc-85ab-405a-ae58-cd5260920581 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:49.631588 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f570fc-85ab-405a-ae58-cd5260920581 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:49.632374 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f570fc-85ab-405a-ae58-cd5260920581 None admin] RBAC: Adding query filter params (role.id=adbf346347dc40afa78c773cfc32c750, scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507, user.id=3e070c93f47045ecb5bf0a1622395091) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:49.632680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f570fc-85ab-405a-ae58-cd5260920581 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:49.634111 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f570fc-85ab-405a-ae58-cd5260920581 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:49.641883 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 496/994] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:05:49 2022] GET /identity/v3/role_assignments?user.id=3e070c93f47045ecb5bf0a1622395091&scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507&role.id=adbf346347dc40afa78c773cfc32c750 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:05:49.744730 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea9c21-d3cd-43f3-bc9a-6eb8b0d99e5e None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:49.779722 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:49.785746 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573054f-47c7-40c4-ade4-e3d8a81442c3 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:49.786025 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573054f-47c7-40c4-ade4-e3d8a81442c3 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:49.786293 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573054f-47c7-40c4-ade4-e3d8a81442c3 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:49.787712 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 497/995] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:05:49.794141 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7cc0e-f579-4c48-9739-7ab5299a2826 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:49.795116 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7cc0e-f579-4c48-9739-7ab5299a2826 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:49.795116 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7cc0e-f579-4c48-9739-7ab5299a2826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:49.796028 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0dce0-3492-49a1-a090-3e7bda393b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:49.797163 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0dce0-3492-49a1-a090-3e7bda393b53 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:49.797163 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0dce0-3492-49a1-a090-3e7bda393b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:49.798262 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0dce0-3492-49a1-a090-3e7bda393b53 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:49.798262 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0dce0-3492-49a1-a090-3e7bda393b53 None admin] RBAC: Adding query filter params (interface=public, service_id=476cbc32f40c4d829210b4fc9744bd47, region_id=RegionOne) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:49.798262 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0dce0-3492-49a1-a090-3e7bda393b53 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:49.800104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0dce0-3492-49a1-a090-3e7bda393b53 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:49.807144 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 499/996] 10.222.0.79 () {56 vars in 1251 bytes} [Wed Aug 31 19:05:49 2022] GET /identity/v3/endpoints?service_id=476cbc32f40c4d829210b4fc9744bd47&interface=public®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:05:49.813360 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0dce0-3492-49a1-a090-3e7bda393b53 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:49.815734 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-62b7cc0e-f579-4c48-9739-7ab5299a2826 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:49.816989 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-62b7cc0e-f579-4c48-9739-7ab5299a2826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:49.876859 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:49.905477 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 498/997] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:49 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:05:49.945610 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0dce0-3492-49a1-a090-3e7bda393b53 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:49.987114 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8945d-38d2-4fa3-997e-d1b35c1834f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:49.987722 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8945d-38d2-4fa3-997e-d1b35c1834f8 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:49.988016 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8945d-38d2-4fa3-997e-d1b35c1834f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:49.988313 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8945d-38d2-4fa3-997e-d1b35c1834f8 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:49.988928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f8945d-38d2-4fa3-997e-d1b35c1834f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:49.990430 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f8945d-38d2-4fa3-997e-d1b35c1834f8 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:49.997722 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 500/998] 10.222.0.79 () {56 vars in 1087 bytes} [Wed Aug 31 19:05:49 2022] GET /identity/v3/services => generated 1727 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:05:50.192996 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7cc0e-f579-4c48-9739-7ab5299a2826 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:50.291688 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7cc0e-f579-4c48-9739-7ab5299a2826 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:50.325384 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b47dd-73ac-4c35-b17c-fd5f3e2359eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:50.326014 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b47dd-73ac-4c35-b17c-fd5f3e2359eb None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:50.326287 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b47dd-73ac-4c35-b17c-fd5f3e2359eb None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:50.326584 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b47dd-73ac-4c35-b17c-fd5f3e2359eb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:50.327165 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990b47dd-73ac-4c35-b17c-fd5f3e2359eb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:50.329051 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990b47dd-73ac-4c35-b17c-fd5f3e2359eb None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:50.338008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-990b47dd-73ac-4c35-b17c-fd5f3e2359eb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:05:50.338008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:50.338008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:05:50.338008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:05:50.338008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:05:50.338008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:05:50.338008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:05:50.338008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:05:50.338008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:05:50.338008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:50.338008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:05:50.338008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:50.338008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:50.338008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:50.338008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:50.338008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:50.338008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:50.339259 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:50.339259 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:50.339259 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:50.339259 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:50.339259 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:50.339259 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:50.339259 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:05:50.339259 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:05:50.339259 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:05:50.339259 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:05:50.339259 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:50.339259 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:50.339259 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:50.339259 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:50.339259 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:50.339259 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:50.340280 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:50.340280 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:50.340280 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:50.340280 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:50.340280 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:50.340280 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:50.340280 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:50.340280 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:50.340280 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:50.340280 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:50.340280 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:05:50.340280 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:05:50.340280 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 19:05:50.340280 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:50.342554 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 499/999] 10.222.0.79 () {56 vars in 1126 bytes} [Wed Aug 31 19:05:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:50.345741 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8945d-38d2-4fa3-997e-d1b35c1834f8 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:50.404135 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:50.451374 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8945d-38d2-4fa3-997e-d1b35c1834f8 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:50.487859 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa4e72-f185-4e1c-af8d-c353d94d445a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:50.488475 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa4e72-f185-4e1c-af8d-c353d94d445a None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:50.488753 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa4e72-f185-4e1c-af8d-c353d94d445a None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:50.489025 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa4e72-f185-4e1c-af8d-c353d94d445a None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:50.489660 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa4e72-f185-4e1c-af8d-c353d94d445a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:50.489964 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa4e72-f185-4e1c-af8d-c353d94d445a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:50.491463 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa4e72-f185-4e1c-af8d-c353d94d445a None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:50.501214 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 501/1000] 10.222.0.79 () {56 vars in 1122 bytes} [Wed Aug 31 19:05:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:50.502439 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b47dd-73ac-4c35-b17c-fd5f3e2359eb None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:50.553017 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:50.614929 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b47dd-73ac-4c35-b17c-fd5f3e2359eb None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:50.652620 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbdc14-e6f3-4a8e-b82c-a73bda7b2cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:50.653241 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbdc14-e6f3-4a8e-b82c-a73bda7b2cee None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:50.653525 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbdc14-e6f3-4a8e-b82c-a73bda7b2cee None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:50.653782 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbdc14-e6f3-4a8e-b82c-a73bda7b2cee None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:50.654920 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fbdc14-e6f3-4a8e-b82c-a73bda7b2cee None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:50.655025 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fbdc14-e6f3-4a8e-b82c-a73bda7b2cee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:50.657189 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fbdc14-e6f3-4a8e-b82c-a73bda7b2cee None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:50.668679 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 500/1001] 10.222.0.79 () {56 vars in 1122 bytes} [Wed Aug 31 19:05:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:05:50.670159 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa4e72-f185-4e1c-af8d-c353d94d445a None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:50.790127 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa4e72-f185-4e1c-af8d-c353d94d445a None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:50.810715 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:50.829352 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88341010-bfef-4a61-911c-8cead2565142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:50.829968 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88341010-bfef-4a61-911c-8cead2565142 None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:50.830248 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88341010-bfef-4a61-911c-8cead2565142 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:50.830550 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88341010-bfef-4a61-911c-8cead2565142 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:50.831303 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88341010-bfef-4a61-911c-8cead2565142 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:50.832676 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88341010-bfef-4a61-911c-8cead2565142 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:50.855576 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 502/1002] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:05:50 2022] POST /identity/v3/endpoints => generated 325 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:05:51.652105 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ffd6ae-ce61-4dd6-8d39-63682336a40a None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:51.652656 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ffd6ae-ce61-4dd6-8d39-63682336a40a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:51.652656 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ffd6ae-ce61-4dd6-8d39-63682336a40a None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:51.654395 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 501/1003] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:05:51.659556 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576e4e0-218e-4b00-b3e3-6224817df8b7 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:51.659964 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576e4e0-218e-4b00-b3e3-6224817df8b7 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:51.660149 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576e4e0-218e-4b00-b3e3-6224817df8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:51.679150 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-1576e4e0-218e-4b00-b3e3-6224817df8b7 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:51.680338 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1576e4e0-218e-4b00-b3e3-6224817df8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:51.756623 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 503/1004] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:51 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:05:51.954733 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563da22-46bc-44b6-baca-347338a916b3 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:51.955116 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563da22-46bc-44b6-baca-347338a916b3 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:51.955336 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563da22-46bc-44b6-baca-347338a916b3 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:51.956893 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 502/1005] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:05:51.962511 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45dddb-d0d0-4a55-88cf-99f3f0897aca None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:51.962811 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45dddb-d0d0-4a55-88cf-99f3f0897aca None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:51.963070 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45dddb-d0d0-4a55-88cf-99f3f0897aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:51.982514 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-6d45dddb-d0d0-4a55-88cf-99f3f0897aca None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:51.983696 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-6d45dddb-d0d0-4a55-88cf-99f3f0897aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:52.031538 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563da22-46bc-44b6-baca-347338a916b3 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:52.055827 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 504/1006] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:51 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:05:52.147589 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563da22-46bc-44b6-baca-347338a916b3 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:52.157411 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:52.185147 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119c54b-54f0-4d0f-9efa-fda62106ec94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:52.185836 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119c54b-54f0-4d0f-9efa-fda62106ec94 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:52.186115 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119c54b-54f0-4d0f-9efa-fda62106ec94 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:52.186435 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119c54b-54f0-4d0f-9efa-fda62106ec94 None admin] PATH_INFO: `/v3/services/image` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:52.187696 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6119c54b-54f0-4d0f-9efa-fda62106ec94 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:52.189152 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6119c54b-54f0-4d0f-9efa-fda62106ec94 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:52.198548 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-6119c54b-54f0-4d0f-9efa-fda62106ec94 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 19:05:52.198548 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:52.198548 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:05:52.198548 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:05:52.198548 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:05:52.198548 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:05:52.198548 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:05:52.198548 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:05:52.198548 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 19:05:52.198548 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:52.198548 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:05:52.198548 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:52.198548 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:52.198548 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:52.198548 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:52.198548 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:52.198548 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:52.199541 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:52.199541 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:52.199541 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:52.199541 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:52.199541 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:52.199541 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:52.199541 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:05:52.199541 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:05:52.199541 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:05:52.199541 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:05:52.199541 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:52.199541 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:52.199541 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:52.199541 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:52.199541 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:52.199541 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:52.203992 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:52.203992 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:52.203992 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:52.203992 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:52.203992 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:52.203992 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:52.203992 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:52.203992 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:52.203992 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:52.203992 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:52.203992 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:05:52.203992 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:05:52.203992 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 19:05:52.203992 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:52.203992 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 503/1007] 10.222.0.79 () {56 vars in 1105 bytes} [Wed Aug 31 19:05:52 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:05:52.206591 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45dddb-d0d0-4a55-88cf-99f3f0897aca None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:52.242563 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:52.326068 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119c54b-54f0-4d0f-9efa-fda62106ec94 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:52.331034 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45dddb-d0d0-4a55-88cf-99f3f0897aca None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:52.379690 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ad03f-3082-4397-af5d-eda1bb243eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:52.380364 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ad03f-3082-4397-af5d-eda1bb243eee None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:52.380646 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ad03f-3082-4397-af5d-eda1bb243eee None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:52.380972 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ad03f-3082-4397-af5d-eda1bb243eee None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:52.382067 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ad03f-3082-4397-af5d-eda1bb243eee None admin] RBAC: Adding query filter params (name=image) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:52.382382 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ad03f-3082-4397-af5d-eda1bb243eee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:52.384211 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ad03f-3082-4397-af5d-eda1bb243eee None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:52.389894 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 505/1008] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:52.396032 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ad03f-3082-4397-af5d-eda1bb243eee None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:52.437942 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119c54b-54f0-4d0f-9efa-fda62106ec94 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:52.479401 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54717828-8007-4265-b585-57f0d0678507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:52.479952 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54717828-8007-4265-b585-57f0d0678507 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:52.480236 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54717828-8007-4265-b585-57f0d0678507 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:52.480503 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54717828-8007-4265-b585-57f0d0678507 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:52.481086 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54717828-8007-4265-b585-57f0d0678507 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:52.482483 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54717828-8007-4265-b585-57f0d0678507 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:52.491699 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-54717828-8007-4265-b585-57f0d0678507 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 19:05:52.491699 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:52.491699 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:05:52.491699 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:05:52.491699 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:05:52.491699 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:05:52.491699 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:05:52.491699 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:05:52.491699 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 19:05:52.491699 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:52.491699 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:05:52.491699 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:52.491699 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:52.491699 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:52.491699 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:52.491699 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:52.491699 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:52.492723 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:52.492723 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:52.492723 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:52.492723 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:52.492723 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:52.492723 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:52.492723 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:05:52.492723 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:05:52.492723 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:05:52.492723 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:05:52.492723 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:52.492723 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:52.492723 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:52.492723 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:52.492723 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:52.492723 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:52.493552 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:52.493552 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:52.493552 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:52.493552 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:52.493552 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:52.493552 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:52.493552 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:52.493552 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:52.493552 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:52.493552 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:52.493552 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:05:52.493552 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:05:52.493552 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 19:05:52.493552 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:52.493552 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 504/1009] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:05:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:05:52.498576 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54717828-8007-4265-b585-57f0d0678507 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:52.509818 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:52.517393 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ad03f-3082-4397-af5d-eda1bb243eee None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:52.543954 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:52.561219 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57089ce-8cff-46dc-8b6f-07a4abffb201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:52.561830 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57089ce-8cff-46dc-8b6f-07a4abffb201 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:52.562190 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57089ce-8cff-46dc-8b6f-07a4abffb201 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:52.562488 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57089ce-8cff-46dc-8b6f-07a4abffb201 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:52.563554 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57089ce-8cff-46dc-8b6f-07a4abffb201 None admin] RBAC: Adding query filter params (type=image) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:52.563860 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57089ce-8cff-46dc-8b6f-07a4abffb201 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:52.565718 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57089ce-8cff-46dc-8b6f-07a4abffb201 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:52.582503 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 506/1010] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:52 2022] GET /identity/v3/services?type=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:05:52.629616 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54717828-8007-4265-b585-57f0d0678507 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:52.669808 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096aeb7d-0383-40aa-af76-7a3abfd5df77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:52.670663 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096aeb7d-0383-40aa-af76-7a3abfd5df77 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:52.670775 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096aeb7d-0383-40aa-af76-7a3abfd5df77 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:52.670995 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096aeb7d-0383-40aa-af76-7a3abfd5df77 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:52.672043 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096aeb7d-0383-40aa-af76-7a3abfd5df77 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:52.672043 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096aeb7d-0383-40aa-af76-7a3abfd5df77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:52.673373 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096aeb7d-0383-40aa-af76-7a3abfd5df77 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:52.679205 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 505/1011] 10.222.0.79 () {56 vars in 1112 bytes} [Wed Aug 31 19:05:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:05:52.694157 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57089ce-8cff-46dc-8b6f-07a4abffb201 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:52.805815 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321dd97d-4431-4480-96b5-ecd27c1db1fa None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:52.805991 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321dd97d-4431-4480-96b5-ecd27c1db1fa None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:52.806294 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321dd97d-4431-4480-96b5-ecd27c1db1fa None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:52.807840 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 506/1012] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:05:52.813659 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352fe47-517d-48eb-a230-382e499028ac None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:52.814172 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352fe47-517d-48eb-a230-382e499028ac None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:52.814688 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352fe47-517d-48eb-a230-382e499028ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:52.816802 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57089ce-8cff-46dc-8b6f-07a4abffb201 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:52.838734 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-a352fe47-517d-48eb-a230-382e499028ac None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:52.840541 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a352fe47-517d-48eb-a230-382e499028ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:52.857571 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c3236-bee9-4782-a74a-423922c07706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:52.858629 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c3236-bee9-4782-a74a-423922c07706 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:52.859064 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c3236-bee9-4782-a74a-423922c07706 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:52.859464 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c3236-bee9-4782-a74a-423922c07706 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:52.860098 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c3236-bee9-4782-a74a-423922c07706 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:52.860536 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c3236-bee9-4782-a74a-423922c07706 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:52.862199 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c3236-bee9-4782-a74a-423922c07706 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:52.868419 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 507/1013] 10.222.0.79 () {56 vars in 1112 bytes} [Wed Aug 31 19:05:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:52.874202 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c3236-bee9-4782-a74a-423922c07706 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:52.907874 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:52.926114 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 507/1014] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:52 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:05:52.999508 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c3236-bee9-4782-a74a-423922c07706 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:53.041319 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5cf75-eea1-462e-9a4f-43f36754579c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:53.041940 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5cf75-eea1-462e-9a4f-43f36754579c None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:53.042214 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5cf75-eea1-462e-9a4f-43f36754579c None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:53.042567 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5cf75-eea1-462e-9a4f-43f36754579c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:53.043500 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d5cf75-eea1-462e-9a4f-43f36754579c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:53.045878 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d5cf75-eea1-462e-9a4f-43f36754579c None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:53.075955 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 508/1015] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:05:52 2022] POST /identity/v3/endpoints => generated 334 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:05:53.219201 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352fe47-517d-48eb-a230-382e499028ac None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:53.266684 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:53.348717 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352fe47-517d-48eb-a230-382e499028ac None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:53.399855 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d89416-833c-4971-b2ea-ce48187be0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:53.400489 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d89416-833c-4971-b2ea-ce48187be0ce None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:53.400766 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d89416-833c-4971-b2ea-ce48187be0ce None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:53.401030 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d89416-833c-4971-b2ea-ce48187be0ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:53.402120 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d89416-833c-4971-b2ea-ce48187be0ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:53.403590 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d89416-833c-4971-b2ea-ce48187be0ce None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:53.410594 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 508/1016] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:53.412405 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5cf75-eea1-462e-9a4f-43f36754579c None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:53.520503 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:53.564446 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5cf75-eea1-462e-9a4f-43f36754579c None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:53.621500 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38901cad-36e5-4580-a565-412143ef1481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:53.622033 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38901cad-36e5-4580-a565-412143ef1481 None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:53.622334 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38901cad-36e5-4580-a565-412143ef1481 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:53.622644 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38901cad-36e5-4580-a565-412143ef1481 None admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:53.623318 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38901cad-36e5-4580-a565-412143ef1481 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:53.625294 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38901cad-36e5-4580-a565-412143ef1481 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:53.666501 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 509/1017] 10.222.0.79 () {60 vars in 1141 bytes} [Wed Aug 31 19:05:53 2022] POST /identity/v3/projects => generated 311 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:05:54.552618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea04051-d134-4db0-b27d-a2165682120e None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:54.553135 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea04051-d134-4db0-b27d-a2165682120e None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:54.553135 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea04051-d134-4db0-b27d-a2165682120e None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:54.554622 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 509/1018] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:05:54.559860 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b260f9b-cab9-4a1e-b36d-be04c76cd1ac None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:54.560302 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b260f9b-cab9-4a1e-b36d-be04c76cd1ac None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:54.560479 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b260f9b-cab9-4a1e-b36d-be04c76cd1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:54.578726 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-4b260f9b-cab9-4a1e-b36d-be04c76cd1ac None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:54.579920 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-4b260f9b-cab9-4a1e-b36d-be04c76cd1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:54.658867 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 510/1019] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:54 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:05:54.929040 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea04051-d134-4db0-b27d-a2165682120e None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:55.037585 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:55.046853 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea04051-d134-4db0-b27d-a2165682120e None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:55.085132 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df23cc1-a639-41ca-8f7e-50e4ca149ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:55.085800 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df23cc1-a639-41ca-8f7e-50e4ca149ffb None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:55.086120 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df23cc1-a639-41ca-8f7e-50e4ca149ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:55.086393 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df23cc1-a639-41ca-8f7e-50e4ca149ffb None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:55.087397 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df23cc1-a639-41ca-8f7e-50e4ca149ffb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:55.089300 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df23cc1-a639-41ca-8f7e-50e4ca149ffb None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:55.110503 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 510/1020] 10.222.0.79 () {60 vars in 1141 bytes} [Wed Aug 31 19:05:54 2022] POST /identity/v3/services => generated 242 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:05:55.164427 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f949dca-6283-485e-8515-40d5007a65b7 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:55.164758 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f949dca-6283-485e-8515-40d5007a65b7 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:55.164995 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f949dca-6283-485e-8515-40d5007a65b7 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:55.166567 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 511/1021] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:05:55.172658 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3491c-0422-4bc3-9200-e072d030cdc7 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:55.172957 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3491c-0422-4bc3-9200-e072d030cdc7 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:55.173215 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3491c-0422-4bc3-9200-e072d030cdc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:55.194317 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-d4b3491c-0422-4bc3-9200-e072d030cdc7 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:55.195516 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d4b3491c-0422-4bc3-9200-e072d030cdc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:55.280160 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 511/1022] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:55 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:05:55.552152 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f949dca-6283-485e-8515-40d5007a65b7 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:55.621099 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:55.669304 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f949dca-6283-485e-8515-40d5007a65b7 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:55.703132 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490ef53-c031-46d6-a379-c7426c39351a None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:55.703685 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490ef53-c031-46d6-a379-c7426c39351a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:55.703685 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490ef53-c031-46d6-a379-c7426c39351a None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:55.705016 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 512/1023] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:05:55.709965 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66664819-f161-434a-a555-83814b0667ab None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:55.710159 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be090b34-826c-44d0-bc55-07d2f540fd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:55.710320 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66664819-f161-434a-a555-83814b0667ab None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:55.710541 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66664819-f161-434a-a555-83814b0667ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:55.710797 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be090b34-826c-44d0-bc55-07d2f540fd2b None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:55.711076 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be090b34-826c-44d0-bc55-07d2f540fd2b None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:55.711345 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be090b34-826c-44d0-bc55-07d2f540fd2b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:55.722751 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be090b34-826c-44d0-bc55-07d2f540fd2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:05:55.727814 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-be090b34-826c-44d0-bc55-07d2f540fd2b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 19:05:55.727814 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:55.727814 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:55.727814 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:55.727814 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:55.727814 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:55.727814 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:55.727814 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:55.727814 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:55.727814 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:55.727814 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:55.727814 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:55.727814 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:05:55.727814 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:05:55.727814 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:05:55.727814 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:05:55.728777 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:05:55.728777 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:05:55.728777 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:05:55.728777 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:05:55.728777 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:55.728777 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:55.728777 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:55.728777 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:55.728777 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:55.728777 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:55.728777 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:55.728777 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:55.728777 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:55.728777 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:55.728777 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:55.728777 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:55.729635 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:55.729635 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:55.729635 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:55.729635 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:55.729635 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:05:55.729635 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:05:55.729635 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:05:55.729635 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:05:55.729635 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:05:55.729635 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:05:55.729635 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 19:05:55.729635 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:55.731742 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-66664819-f161-434a-a555-83814b0667ab None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:55.733014 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-66664819-f161-434a-a555-83814b0667ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:55.733937 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 512/1024] 10.222.0.79 () {56 vars in 1120 bytes} [Wed Aug 31 19:05:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:55.735014 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be090b34-826c-44d0-bc55-07d2f540fd2b None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:55.816569 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 513/1025] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:55 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:05:55.858562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be090b34-826c-44d0-bc55-07d2f540fd2b None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:55.884021 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:55.896504 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590bbed-896d-402f-a2cb-f05e3649c92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:55.897101 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590bbed-896d-402f-a2cb-f05e3649c92e None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:55.897378 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590bbed-896d-402f-a2cb-f05e3649c92e None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:55.897641 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590bbed-896d-402f-a2cb-f05e3649c92e None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:55.898291 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590bbed-896d-402f-a2cb-f05e3649c92e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:55.898616 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590bbed-896d-402f-a2cb-f05e3649c92e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:55.899961 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590bbed-896d-402f-a2cb-f05e3649c92e None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:55.908881 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 513/1026] 10.222.0.79 () {56 vars in 1115 bytes} [Wed Aug 31 19:05:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:55.914634 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66664819-f161-434a-a555-83814b0667ab None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:55.927272 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:56.025676 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66664819-f161-434a-a555-83814b0667ab None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:56.063026 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11c359-e39c-4b61-9b4a-d5314379821b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:56.064120 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11c359-e39c-4b61-9b4a-d5314379821b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:56.064603 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11c359-e39c-4b61-9b4a-d5314379821b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:56.065073 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11c359-e39c-4b61-9b4a-d5314379821b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:56.077619 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11c359-e39c-4b61-9b4a-d5314379821b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:56.079370 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11c359-e39c-4b61-9b4a-d5314379821b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:56.092842 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590bbed-896d-402f-a2cb-f05e3649c92e None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:56.095537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-2f11c359-e39c-4b61-9b4a-d5314379821b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:56.095537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:56.095537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:56.095537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:56.095537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:56.095537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:56.095537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:56.095537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:56.095537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:56.095537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:56.095537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:56.095537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:56.095537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:56.095537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:56.095537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:56.095537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:56.096479 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:56.096479 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:56.096479 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:56.096479 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:56.096479 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:56.096479 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:56.096479 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:56.096479 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:56.096479 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:56.096479 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:56.096479 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:56.096479 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:56.096479 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:56.096479 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:56.096479 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:56.096479 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:56.096479 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:56.097363 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:56.097363 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:56.097363 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:56.099865 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 514/1027] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:56.106068 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11c359-e39c-4b61-9b4a-d5314379821b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:56.174023 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:56.215669 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590bbed-896d-402f-a2cb-f05e3649c92e None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:56.218246 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11c359-e39c-4b61-9b4a-d5314379821b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:56.254574 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a9bf6-a154-4646-8d10-60a9e79ae043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:56.255346 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a9bf6-a154-4646-8d10-60a9e79ae043 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:56.255630 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a9bf6-a154-4646-8d10-60a9e79ae043 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:56.255905 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a9bf6-a154-4646-8d10-60a9e79ae043 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:56.257852 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a9bf6-a154-4646-8d10-60a9e79ae043 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:56.259345 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a9bf6-a154-4646-8d10-60a9e79ae043 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:56.262437 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850637d-a955-4d25-9b0d-6791f4e8f1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:56.263108 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850637d-a955-4d25-9b0d-6791f4e8f1e2 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:56.263389 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850637d-a955-4d25-9b0d-6791f4e8f1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:56.263659 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850637d-a955-4d25-9b0d-6791f4e8f1e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:56.264333 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5850637d-a955-4d25-9b0d-6791f4e8f1e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:56.264635 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5850637d-a955-4d25-9b0d-6791f4e8f1e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:56.266744 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 514/1028] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:05:56.266960 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5850637d-a955-4d25-9b0d-6791f4e8f1e2 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:56.267663 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a9bf6-a154-4646-8d10-60a9e79ae043 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:56.281916 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 515/1029] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:05:56.287525 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850637d-a955-4d25-9b0d-6791f4e8f1e2 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:56.329189 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:56.397251 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a9bf6-a154-4646-8d10-60a9e79ae043 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:56.402327 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850637d-a955-4d25-9b0d-6791f4e8f1e2 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:56.428849 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:56.437505 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c278a-4f0c-4655-9305-bd2655d203c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:56.438094 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c278a-4f0c-4655-9305-bd2655d203c1 None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:56.438374 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c278a-4f0c-4655-9305-bd2655d203c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:56.438676 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c278a-4f0c-4655-9305-bd2655d203c1 None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:56.439325 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c278a-4f0c-4655-9305-bd2655d203c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:56.440192 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a294a3-d3f2-45a3-8685-eced0add5785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:56.440736 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c278a-4f0c-4655-9305-bd2655d203c1 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:56.440837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a294a3-d3f2-45a3-8685-eced0add5785 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:56.441083 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a294a3-d3f2-45a3-8685-eced0add5785 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:56.441352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a294a3-d3f2-45a3-8685-eced0add5785 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:56.448639 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a294a3-d3f2-45a3-8685-eced0add5785 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:56.450067 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a294a3-d3f2-45a3-8685-eced0add5785 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:56.462926 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-63a294a3-d3f2-45a3-8685-eced0add5785 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:05:56.462926 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:56.462926 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:56.462926 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:56.462926 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:56.462926 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:56.462926 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:56.462926 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:56.462926 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:56.462926 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:56.462926 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:56.462926 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:56.462926 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:05:56.462926 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:05:56.462926 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:05:56.462926 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:05:56.464220 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:56.464220 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:56.464220 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:05:56.464220 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:56.464220 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:05:56.464220 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:05:56.464220 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:56.464220 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:56.464220 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:56.464220 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:56.464220 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:56.464220 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:56.464220 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:56.464220 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:56.464220 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:56.464220 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:56.464220 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:56.464220 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:56.465425 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:56.465425 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:56.465425 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:05:56.465425 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:05:56.465425 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:05:56.465425 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:05:56.465425 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:05:56.465425 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:05:56.465425 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:05:56.465425 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:56.469413 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 516/1030] 10.222.0.79 () {56 vars in 1093 bytes} [Wed Aug 31 19:05:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:05:56.474526 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 515/1031] 10.222.0.79 () {60 vars in 1132 bytes} [Wed Aug 31 19:05:56 2022] POST /identity/v3/users => generated 285 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:05:56.474703 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a294a3-d3f2-45a3-8685-eced0add5785 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:56.597044 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a294a3-d3f2-45a3-8685-eced0add5785 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:56.643075 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1a632-bc14-4c4d-a462-31dc35ef6f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:56.643693 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1a632-bc14-4c4d-a462-31dc35ef6f36 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:56.643973 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1a632-bc14-4c4d-a462-31dc35ef6f36 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:56.644245 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1a632-bc14-4c4d-a462-31dc35ef6f36 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:56.645002 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1a632-bc14-4c4d-a462-31dc35ef6f36 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:56.645328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1a632-bc14-4c4d-a462-31dc35ef6f36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:56.646826 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1a632-bc14-4c4d-a462-31dc35ef6f36 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:56.670579 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 517/1032] 10.222.0.79 () {56 vars in 1133 bytes} [Wed Aug 31 19:05:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:56.673291 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c278a-4f0c-4655-9305-bd2655d203c1 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:56.793113 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c278a-4f0c-4655-9305-bd2655d203c1 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:56.804517 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:56.835340 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e8875-cc0a-45df-9a7b-921a9d954b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:56.836227 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e8875-cc0a-45df-9a7b-921a9d954b42 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:56.836655 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e8875-cc0a-45df-9a7b-921a9d954b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:56.837083 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e8875-cc0a-45df-9a7b-921a9d954b42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:56.920849 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e8875-cc0a-45df-9a7b-921a9d954b42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:56.922554 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e8875-cc0a-45df-9a7b-921a9d954b42 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:57.035413 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 516/1033] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:05:56 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 19:05:57.042001 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1a632-bc14-4c4d-a462-31dc35ef6f36 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:57.087710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:57.114820 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56af1f-c7b4-4c24-bf8a-5eb676fb130f None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:57.115136 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56af1f-c7b4-4c24-bf8a-5eb676fb130f None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:57.115367 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56af1f-c7b4-4c24-bf8a-5eb676fb130f None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:57.116846 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 517/1034] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:05:57.121687 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8070e02-701f-4cd4-a1d8-57edc11c63a5 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:57.121968 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8070e02-701f-4cd4-a1d8-57edc11c63a5 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:57.122244 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8070e02-701f-4cd4-a1d8-57edc11c63a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:57.140761 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-d8070e02-701f-4cd4-a1d8-57edc11c63a5 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:57.142084 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d8070e02-701f-4cd4-a1d8-57edc11c63a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:57.145904 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:57.155730 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1a632-bc14-4c4d-a462-31dc35ef6f36 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:57.205653 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd756075-14e6-4e9d-85e0-b3f4ed219a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:57.206199 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd756075-14e6-4e9d-85e0-b3f4ed219a62 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:57.206498 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd756075-14e6-4e9d-85e0-b3f4ed219a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:57.206773 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd756075-14e6-4e9d-85e0-b3f4ed219a62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:57.222443 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd756075-14e6-4e9d-85e0-b3f4ed219a62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:57.222443 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd756075-14e6-4e9d-85e0-b3f4ed219a62 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:57.223191 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 518/1035] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:05:57.236830 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-fd756075-14e6-4e9d-85e0-b3f4ed219a62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:57.236830 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:57.236830 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:57.236830 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:57.236830 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:57.236830 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:57.236830 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:57.236830 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:57.236830 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:57.236830 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:57.236830 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:57.236830 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:57.236830 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:05:57.236830 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:05:57.236830 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:05:57.236830 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:05:57.237803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:57.237803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:57.237803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:57.237803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:57.237803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:57.237803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:57.237803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:57.237803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:57.237803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:57.237803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:57.237803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:57.237803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:57.237803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:57.237803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:57.237803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:57.237803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:57.237803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:05:57.238744 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:05:57.238744 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:05:57.238744 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:57.242943 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 518/1036] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:57.244051 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8070e02-701f-4cd4-a1d8-57edc11c63a5 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:57.363901 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8070e02-701f-4cd4-a1d8-57edc11c63a5 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:57.399835 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd4dfd-3aea-4176-a077-abde7f425e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:57.400503 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd4dfd-3aea-4176-a077-abde7f425e9e None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:57.400787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd4dfd-3aea-4176-a077-abde7f425e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:57.401060 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd4dfd-3aea-4176-a077-abde7f425e9e None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:57.401712 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fd4dfd-3aea-4176-a077-abde7f425e9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:57.402018 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fd4dfd-3aea-4176-a077-abde7f425e9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:57.403413 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fd4dfd-3aea-4176-a077-abde7f425e9e None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:57.413615 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:57.418570 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 519/1037] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:57.424678 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd756075-14e6-4e9d-85e0-b3f4ed219a62 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:57.484805 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd4dfd-3aea-4176-a077-abde7f425e9e None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:57.538759 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:57.550176 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd756075-14e6-4e9d-85e0-b3f4ed219a62 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:57.597526 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad69bd-dfd6-443c-810c-6ed9f5342144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:57.598158 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad69bd-dfd6-443c-810c-6ed9f5342144 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:57.598433 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad69bd-dfd6-443c-810c-6ed9f5342144 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:57.598734 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad69bd-dfd6-443c-810c-6ed9f5342144 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:57.606054 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad69bd-dfd6-443c-810c-6ed9f5342144 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:57.607518 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad69bd-dfd6-443c-810c-6ed9f5342144 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:57.615303 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd4dfd-3aea-4176-a077-abde7f425e9e None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:57.619667 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-c1ad69bd-dfd6-443c-810c-6ed9f5342144 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:57.619667 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:57.619667 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:57.619667 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:57.619667 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:57.619667 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:57.619667 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:57.619667 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:57.619667 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:57.619667 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:57.619667 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:57.619667 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:57.619667 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:05:57.619667 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:05:57.619667 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:05:57.620799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:05:57.620799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:57.620799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:57.620799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:57.620799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:57.620799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:57.620799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:57.620799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:57.620799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:57.620799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:57.620799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:57.620799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:57.620799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:57.620799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:57.620799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:57.620799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:57.620799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:57.627515 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:05:57.627515 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:05:57.627515 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:05:57.627515 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:05:57.627515 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:05:57.627515 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:05:57.627515 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:05:57.627515 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:57.627515 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 519/1038] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:05:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:57.627515 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad69bd-dfd6-443c-810c-6ed9f5342144 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:57.663437 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69878a4-c847-46f7-8ac9-0a0d0f86ec35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:57.664096 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69878a4-c847-46f7-8ac9-0a0d0f86ec35 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:57.664373 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69878a4-c847-46f7-8ac9-0a0d0f86ec35 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:57.664634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69878a4-c847-46f7-8ac9-0a0d0f86ec35 None admin] PATH_INFO: `/v3/services/image` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:57.665219 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69878a4-c847-46f7-8ac9-0a0d0f86ec35 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:57.666629 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69878a4-c847-46f7-8ac9-0a0d0f86ec35 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:57.676830 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-e69878a4-c847-46f7-8ac9-0a0d0f86ec35 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 19:05:57.676830 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:57.676830 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:05:57.676830 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:05:57.676830 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:05:57.676830 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:05:57.676830 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:05:57.676830 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:05:57.676830 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 19:05:57.676830 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:57.676830 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:05:57.676830 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:57.676830 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:57.676830 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:57.676830 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:57.676830 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:57.676830 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:57.678425 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:57.678425 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:57.678425 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:57.678425 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:57.678425 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:57.678425 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:57.678425 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:05:57.678425 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:05:57.678425 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:05:57.678425 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:05:57.678425 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:57.678425 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:57.678425 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:57.678425 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:57.678425 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:57.678425 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:57.679316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:57.679316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:57.679316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:57.679316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:57.679316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:57.679316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:57.679316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:57.679316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:57.679316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:57.679316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:57.679316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:05:57.679316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:05:57.679316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 19:05:57.679316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:05:57.679316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 520/1039] 10.222.0.79 () {56 vars in 1105 bytes} [Wed Aug 31 19:05:57 2022] GET /identity/v3/services/image => generated 86 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:05:57.683778 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69878a4-c847-46f7-8ac9-0a0d0f86ec35 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:57.747401 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad69bd-dfd6-443c-810c-6ed9f5342144 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:57.759379 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:57.785686 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd16a5-d454-4cc3-82ac-cf8442878e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:57.786291 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd16a5-d454-4cc3-82ac-cf8442878e73 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:57.786595 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd16a5-d454-4cc3-82ac-cf8442878e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:57.786865 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd16a5-d454-4cc3-82ac-cf8442878e73 None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:57.787555 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd16a5-d454-4cc3-82ac-cf8442878e73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:57.787849 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd16a5-d454-4cc3-82ac-cf8442878e73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:57.789295 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd16a5-d454-4cc3-82ac-cf8442878e73 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:57.808139 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 520/1040] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 19:05:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:05:57.808335 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69878a4-c847-46f7-8ac9-0a0d0f86ec35 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:57.809370 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd16a5-d454-4cc3-82ac-cf8442878e73 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:57.826577 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:57.846912 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f119c3-eb37-4998-9599-ff2e7552febb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:57.847690 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f119c3-eb37-4998-9599-ff2e7552febb None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:57.847992 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f119c3-eb37-4998-9599-ff2e7552febb None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:57.848270 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f119c3-eb37-4998-9599-ff2e7552febb None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:57.849721 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f119c3-eb37-4998-9599-ff2e7552febb None admin] RBAC: Adding query filter params (name=image) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:57.850037 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f119c3-eb37-4998-9599-ff2e7552febb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:57.851972 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f119c3-eb37-4998-9599-ff2e7552febb None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:57.857449 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 521/1041] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:57.864106 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f119c3-eb37-4998-9599-ff2e7552febb None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:57.924367 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd16a5-d454-4cc3-82ac-cf8442878e73 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:57.965804 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833baac-8056-46d1-9306-30a8588c7034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:57.966412 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833baac-8056-46d1-9306-30a8588c7034 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:57.966720 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833baac-8056-46d1-9306-30a8588c7034 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:57.966992 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833baac-8056-46d1-9306-30a8588c7034 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:57.967733 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7833baac-8056-46d1-9306-30a8588c7034 None admin] RBAC: Adding query filter params (role.id=adbf346347dc40afa78c773cfc32c750, scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507, user.id=1fd6d45d1bc3479da72cb1a1990a6137) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:57.968053 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7833baac-8056-46d1-9306-30a8588c7034 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:57.969555 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7833baac-8056-46d1-9306-30a8588c7034 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:57.975539 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 521/1042] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:05:57 2022] GET /identity/v3/role_assignments?user.id=1fd6d45d1bc3479da72cb1a1990a6137&scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507&role.id=adbf346347dc40afa78c773cfc32c750 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:57.992107 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f119c3-eb37-4998-9599-ff2e7552febb None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:58.028787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:58.039493 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd692c3-144a-41c1-bc8a-dfb75f5e6b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:58.040155 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd692c3-144a-41c1-bc8a-dfb75f5e6b3d None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:58.040435 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd692c3-144a-41c1-bc8a-dfb75f5e6b3d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:58.040712 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd692c3-144a-41c1-bc8a-dfb75f5e6b3d None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:58.041381 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd692c3-144a-41c1-bc8a-dfb75f5e6b3d None admin] RBAC: Adding query filter params (type=image) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:58.041678 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd692c3-144a-41c1-bc8a-dfb75f5e6b3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:58.043135 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd692c3-144a-41c1-bc8a-dfb75f5e6b3d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:58.054776 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 522/1043] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:05:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:05:58.055970 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833baac-8056-46d1-9306-30a8588c7034 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:58.166573 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:58.198322 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833baac-8056-46d1-9306-30a8588c7034 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:58.246637 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612e6db-1ba7-4120-85d5-08a1d365ea8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:58.247252 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612e6db-1ba7-4120-85d5-08a1d365ea8f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:58.247532 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612e6db-1ba7-4120-85d5-08a1d365ea8f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:58.247787 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612e6db-1ba7-4120-85d5-08a1d365ea8f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:58.248495 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b612e6db-1ba7-4120-85d5-08a1d365ea8f None admin] RBAC: Adding query filter params (interface=public, service_id=a269c4abb7ec4ad199d0dadf1a0c54cf, region_id=RegionOne) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:58.248798 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b612e6db-1ba7-4120-85d5-08a1d365ea8f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:58.250205 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b612e6db-1ba7-4120-85d5-08a1d365ea8f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:58.256894 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 522/1044] 10.222.0.79 () {56 vars in 1251 bytes} [Wed Aug 31 19:05:58 2022] GET /identity/v3/endpoints?service_id=a269c4abb7ec4ad199d0dadf1a0c54cf&interface=public®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:58.262360 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd692c3-144a-41c1-bc8a-dfb75f5e6b3d None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:58.384114 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd692c3-144a-41c1-bc8a-dfb75f5e6b3d None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:58.419239 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e5b18-1dab-4730-8c81-af10469c5898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:58.419851 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e5b18-1dab-4730-8c81-af10469c5898 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:58.420125 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e5b18-1dab-4730-8c81-af10469c5898 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:58.420391 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e5b18-1dab-4730-8c81-af10469c5898 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:58.420992 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0e5b18-1dab-4730-8c81-af10469c5898 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:58.422968 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0e5b18-1dab-4730-8c81-af10469c5898 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:58.429965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 523/1045] 10.222.0.79 () {56 vars in 1087 bytes} [Wed Aug 31 19:05:58 2022] GET /identity/v3/services => generated 1957 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:05:58.509151 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8de9c5-bcef-40ff-a7a8-69349bb883f6 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:58.509545 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8de9c5-bcef-40ff-a7a8-69349bb883f6 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:58.509744 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8de9c5-bcef-40ff-a7a8-69349bb883f6 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:58.511317 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 523/1046] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:05:58.517371 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a5fef-b5e7-446d-8d92-d6bbe6b4169a None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:58.517650 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a5fef-b5e7-446d-8d92-d6bbe6b4169a None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:58.517913 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a5fef-b5e7-446d-8d92-d6bbe6b4169a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:58.538304 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-234a5fef-b5e7-446d-8d92-d6bbe6b4169a None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:58.539561 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-234a5fef-b5e7-446d-8d92-d6bbe6b4169a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:05:58.606343 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:58.632663 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 524/1047] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:58 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:05:58.901073 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8de9c5-bcef-40ff-a7a8-69349bb883f6 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:59.038648 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8de9c5-bcef-40ff-a7a8-69349bb883f6 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:59.082360 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa84e3-0fc0-4318-88c7-b732a2f1594e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:59.083841 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa84e3-0fc0-4318-88c7-b732a2f1594e None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:59.084329 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa84e3-0fc0-4318-88c7-b732a2f1594e None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:59.084832 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa84e3-0fc0-4318-88c7-b732a2f1594e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:59.094435 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:59.102037 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aa84e3-0fc0-4318-88c7-b732a2f1594e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:05:59.111900 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-c7aa84e3-0fc0-4318-88c7-b732a2f1594e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:05:59.111900 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:05:59.111900 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:05:59.111900 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:05:59.111900 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:05:59.111900 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:05:59.111900 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:05:59.111900 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:05:59.111900 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:05:59.111900 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:05:59.111900 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:05:59.111900 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:05:59.111900 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:05:59.111900 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:05:59.111900 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:05:59.111900 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:05:59.113574 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:05:59.113574 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:05:59.113574 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:05:59.113574 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:05:59.113574 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:05:59.113574 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:05:59.113574 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:05:59.113574 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:05:59.113574 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:05:59.113574 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:05:59.113574 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:05:59.113574 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:05:59.113574 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:05:59.113574 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:05:59.113574 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:05:59.113574 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:05:59.114418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:05:59.114418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:05:59.114418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:05:59.114418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:05:59.114418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:05:59.114418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:05:59.114418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:05:59.114418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:05:59.114418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:05:59.114418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:05:59.114418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:05:59.114418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:05:59.114418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 524/1048] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 19:05:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:05:59.120542 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a5fef-b5e7-446d-8d92-d6bbe6b4169a None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:59.233617 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a5fef-b5e7-446d-8d92-d6bbe6b4169a None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:59.273593 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bec23e-cf3d-49ca-a046-533eb96e97eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:59.274223 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bec23e-cf3d-49ca-a046-533eb96e97eb None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:59.274525 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bec23e-cf3d-49ca-a046-533eb96e97eb None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:59.275252 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bec23e-cf3d-49ca-a046-533eb96e97eb None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:59.276067 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bec23e-cf3d-49ca-a046-533eb96e97eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:05:59.276067 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bec23e-cf3d-49ca-a046-533eb96e97eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:59.277143 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bec23e-cf3d-49ca-a046-533eb96e97eb None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:59.286887 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 525/1049] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:05:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:59.293382 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa84e3-0fc0-4318-88c7-b732a2f1594e None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:59.428835 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa84e3-0fc0-4318-88c7-b732a2f1594e None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:59.466075 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851dfb5-09e5-4d7b-9012-6e6659f5edc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:59.466763 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851dfb5-09e5-4d7b-9012-6e6659f5edc8 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:59.467103 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851dfb5-09e5-4d7b-9012-6e6659f5edc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:59.467341 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851dfb5-09e5-4d7b-9012-6e6659f5edc8 None admin] PATH_INFO: `/v3/users/6f77a96674894d3d8913862d070e4201` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:59.484572 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851dfb5-09e5-4d7b-9012-6e6659f5edc8 None admin] RBAC: Authorizing `identity:get_user(user_id=6f77a96674894d3d8913862d070e4201)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:59.485948 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851dfb5-09e5-4d7b-9012-6e6659f5edc8 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:59.493416 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 525/1050] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:05:59 2022] GET /identity/v3/users/6f77a96674894d3d8913862d070e4201 => generated 285 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:05:59.494441 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bec23e-cf3d-49ca-a046-533eb96e97eb None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:59.561326 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:59.619737 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bec23e-cf3d-49ca-a046-533eb96e97eb None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:59.657536 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75297894-34e0-4acb-9a81-68f5affa26f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:05:59.658145 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75297894-34e0-4acb-9a81-68f5affa26f3 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:59.658426 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75297894-34e0-4acb-9a81-68f5affa26f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:59.658740 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75297894-34e0-4acb-9a81-68f5affa26f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:59.741858 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75297894-34e0-4acb-9a81-68f5affa26f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:05:59.743265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75297894-34e0-4acb-9a81-68f5affa26f3 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:05:59.795037 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:59.853028 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 526/1051] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:05:59 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 19:05:59.858839 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851dfb5-09e5-4d7b-9012-6e6659f5edc8 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:05:59.931713 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:05:59.957877 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10043f86-27a2-47ee-a646-75d7a9470010 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:59.958197 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10043f86-27a2-47ee-a646-75d7a9470010 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:59.958517 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10043f86-27a2-47ee-a646-75d7a9470010 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:59.960335 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 527/1052] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:05:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:05:59.966345 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cced4fd-d2c5-48d8-a84b-148a6c3bf840 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:05:59.966698 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cced4fd-d2c5-48d8-a84b-148a6c3bf840 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:05:59.967029 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cced4fd-d2c5-48d8-a84b-148a6c3bf840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:05:59.988823 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-1cced4fd-d2c5-48d8-a84b-148a6c3bf840 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:05:59.989491 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851dfb5-09e5-4d7b-9012-6e6659f5edc8 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:05:59.990304 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1cced4fd-d2c5-48d8-a84b-148a6c3bf840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:00.031773 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab7eb07-5784-42d2-abf3-411b7d7e7c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:00.032527 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7eb07-5784-42d2-abf3-411b7d7e7c3c None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:00.032832 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7eb07-5784-42d2-abf3-411b7d7e7c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:00.033143 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7eb07-5784-42d2-abf3-411b7d7e7c3c None admin] PATH_INFO: `/v3/projects/9968cc1b40974386bd7f0a178c7b0463` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:00.034453 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab7eb07-5784-42d2-abf3-411b7d7e7c3c None admin] RBAC: Authorizing `identity:get_project(project_id=9968cc1b40974386bd7f0a178c7b0463)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:00.036206 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab7eb07-5784-42d2-abf3-411b7d7e7c3c None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:00.038191 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 526/1053] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:05:59 2022] GET /identity/v3/projects/9968cc1b40974386bd7f0a178c7b0463 => generated 311 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:00.044732 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab7eb07-5784-42d2-abf3-411b7d7e7c3c None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:00.069734 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 528/1054] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:05:59 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:06:00.163860 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab7eb07-5784-42d2-abf3-411b7d7e7c3c None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:00.192810 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:00.203712 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa9d2c-8ffa-45f4-a285-c5a2ab389882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:00.204319 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa9d2c-8ffa-45f4-a285-c5a2ab389882 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:00.204596 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa9d2c-8ffa-45f4-a285-c5a2ab389882 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:00.204872 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa9d2c-8ffa-45f4-a285-c5a2ab389882 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:00.205600 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa9d2c-8ffa-45f4-a285-c5a2ab389882 None admin] RBAC: Adding query filter params (role.id=edc551338adb4ae88bdafc591ad69582, scope.project.id=9968cc1b40974386bd7f0a178c7b0463, user.id=6f77a96674894d3d8913862d070e4201) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:00.205935 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa9d2c-8ffa-45f4-a285-c5a2ab389882 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:00.207455 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa9d2c-8ffa-45f4-a285-c5a2ab389882 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:00.214801 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 527/1055] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:06:00 2022] GET /identity/v3/role_assignments?user.id=6f77a96674894d3d8913862d070e4201&scope.project.id=9968cc1b40974386bd7f0a178c7b0463&role.id=edc551338adb4ae88bdafc591ad69582 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:06:00.344431 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cced4fd-d2c5-48d8-a84b-148a6c3bf840 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:00.396613 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae016e0-9ddc-480d-82a7-a031b49654b4 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:00.397006 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae016e0-9ddc-480d-82a7-a031b49654b4 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:00.397377 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae016e0-9ddc-480d-82a7-a031b49654b4 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:00.398831 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 528/1056] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:06:00.404205 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec2846-95b3-4d8c-81d2-7d3f5758bf6f None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:00.404588 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec2846-95b3-4d8c-81d2-7d3f5758bf6f None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:00.404866 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec2846-95b3-4d8c-81d2-7d3f5758bf6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:00.423236 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-7fec2846-95b3-4d8c-81d2-7d3f5758bf6f None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:00.424457 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7fec2846-95b3-4d8c-81d2-7d3f5758bf6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:00.444703 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:00.468800 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cced4fd-d2c5-48d8-a84b-148a6c3bf840 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:00.506503 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 529/1057] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:00 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:06:00.514419 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779b3a5-1268-432d-b1a9-337e3faca257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:00.515646 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779b3a5-1268-432d-b1a9-337e3faca257 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:00.515924 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779b3a5-1268-432d-b1a9-337e3faca257 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:00.516192 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779b3a5-1268-432d-b1a9-337e3faca257 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:00.529801 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4779b3a5-1268-432d-b1a9-337e3faca257 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:06:00.532126 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-4779b3a5-1268-432d-b1a9-337e3faca257 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 19:06:00.532126 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:06:00.532126 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:06:00.532126 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:06:00.532126 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:06:00.532126 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:06:00.532126 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:06:00.532126 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:06:00.532126 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:06:00.532126 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:06:00.532126 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:06:00.532126 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:06:00.532126 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:06:00.532126 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:06:00.532126 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:06:00.532126 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:06:00.533053 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:06:00.533053 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:06:00.533053 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:06:00.533053 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:06:00.533053 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:06:00.533053 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:06:00.533053 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:06:00.533053 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:06:00.533053 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:06:00.533053 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:06:00.533053 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:06:00.533053 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:06:00.533053 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:06:00.533053 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:06:00.533053 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:06:00.533053 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:06:00.533981 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:06:00.533981 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:06:00.533981 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:06:00.533981 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:06:00.533981 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:06:00.533981 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:06:00.533981 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:06:00.533981 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:06:00.533981 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:06:00.533981 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:06:00.533981 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 19:06:00.533981 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:06:00.533981 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 529/1058] 10.222.0.79 () {56 vars in 1120 bytes} [Wed Aug 31 19:06:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:06:00.541796 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec2846-95b3-4d8c-81d2-7d3f5758bf6f None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:00.655727 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec2846-95b3-4d8c-81d2-7d3f5758bf6f None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:00.680323 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:00.700291 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98f124-29df-49cc-9ef5-15b75935ede3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:00.700910 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98f124-29df-49cc-9ef5-15b75935ede3 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:00.701184 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98f124-29df-49cc-9ef5-15b75935ede3 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:00.701459 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98f124-29df-49cc-9ef5-15b75935ede3 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:00.702182 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98f124-29df-49cc-9ef5-15b75935ede3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:00.703096 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98f124-29df-49cc-9ef5-15b75935ede3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:00.704804 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98f124-29df-49cc-9ef5-15b75935ede3 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:00.724008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 530/1059] 10.222.0.79 () {56 vars in 1115 bytes} [Wed Aug 31 19:06:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:00.726798 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779b3a5-1268-432d-b1a9-337e3faca257 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:00.791795 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98f124-29df-49cc-9ef5-15b75935ede3 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:00.846217 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779b3a5-1268-432d-b1a9-337e3faca257 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:00.888109 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ac978-ea6f-40cf-8dc7-0c84a056e8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:00.888880 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ac978-ea6f-40cf-8dc7-0c84a056e8b1 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:00.889157 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ac978-ea6f-40cf-8dc7-0c84a056e8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:00.889444 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ac978-ea6f-40cf-8dc7-0c84a056e8b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:00.899226 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:00.905146 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ac978-ea6f-40cf-8dc7-0c84a056e8b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:00.906946 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ac978-ea6f-40cf-8dc7-0c84a056e8b1 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:00.913053 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98f124-29df-49cc-9ef5-15b75935ede3 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:00.922156 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-d27ac978-ea6f-40cf-8dc7-0c84a056e8b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:06:00.922156 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:06:00.922156 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:06:00.922156 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:06:00.922156 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:06:00.922156 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:06:00.922156 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:06:00.922156 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:06:00.922156 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:06:00.922156 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:06:00.922156 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:06:00.922156 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:06:00.922156 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:06:00.922156 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:06:00.922156 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:06:00.922156 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:06:00.928175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:06:00.928175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:06:00.928175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:06:00.928175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:06:00.928175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:06:00.928175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:06:00.928175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:06:00.928175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:06:00.928175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:06:00.928175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:06:00.928175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:06:00.928175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:06:00.928175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:06:00.928175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:06:00.928175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:06:00.928175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:06:00.928175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:06:00.929296 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:06:00.929296 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:06:00.929296 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:06:00.929296 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 530/1060] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:06:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:06:00.930991 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ac978-ea6f-40cf-8dc7-0c84a056e8b1 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:00.965014 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8dd3a-0a60-445c-ad39-3c58084202c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:00.965636 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8dd3a-0a60-445c-ad39-3c58084202c8 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:00.965917 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8dd3a-0a60-445c-ad39-3c58084202c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:00.966187 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8dd3a-0a60-445c-ad39-3c58084202c8 None admin] PATH_INFO: `/v3/services/image` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:00.966803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d8dd3a-0a60-445c-ad39-3c58084202c8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:00.968203 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d8dd3a-0a60-445c-ad39-3c58084202c8 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:00.977367 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-97d8dd3a-0a60-445c-ad39-3c58084202c8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 19:06:00.977367 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:06:00.977367 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:06:00.977367 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:06:00.977367 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:06:00.977367 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:06:00.977367 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:06:00.977367 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:06:00.977367 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 19:06:00.977367 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:06:00.977367 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:06:00.977367 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:06:00.977367 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:06:00.977367 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:06:00.977367 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:06:00.977367 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:06:00.977367 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:06:00.978372 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:06:00.978372 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:06:00.978372 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:06:00.978372 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:06:00.978372 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:06:00.978372 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:06:00.978372 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:06:00.978372 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:06:00.978372 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:06:00.978372 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:06:00.978372 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:06:00.978372 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:06:00.978372 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:06:00.978372 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:06:00.978372 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:06:00.978372 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:06:00.979882 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:06:00.979882 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:06:00.979882 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:06:00.979882 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:06:00.979882 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:06:00.979882 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:06:00.979882 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:06:00.979882 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:06:00.979882 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:06:00.979882 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:06:00.979882 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:06:00.979882 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:06:00.979882 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 19:06:00.979882 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:06:00.979882 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 531/1061] 10.222.0.79 () {56 vars in 1105 bytes} [Wed Aug 31 19:06:00 2022] GET /identity/v3/services/image => generated 86 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:06:00.984779 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8dd3a-0a60-445c-ad39-3c58084202c8 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:01.038970 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:01.062357 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ac978-ea6f-40cf-8dc7-0c84a056e8b1 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:01.097903 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f40f4-6431-4a5a-9735-5fa92a987989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:01.098549 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f40f4-6431-4a5a-9735-5fa92a987989 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:01.098831 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f40f4-6431-4a5a-9735-5fa92a987989 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:01.099101 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f40f4-6431-4a5a-9735-5fa92a987989 None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:01.099756 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f40f4-6431-4a5a-9735-5fa92a987989 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:01.100062 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f40f4-6431-4a5a-9735-5fa92a987989 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:01.101690 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f40f4-6431-4a5a-9735-5fa92a987989 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:01.104216 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8dd3a-0a60-445c-ad39-3c58084202c8 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:01.115194 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 531/1062] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:06:01.121009 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f40f4-6431-4a5a-9735-5fa92a987989 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:01.148755 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92649c1c-93a4-42b7-a106-328c128c8429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:01.149485 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92649c1c-93a4-42b7-a106-328c128c8429 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:01.149760 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92649c1c-93a4-42b7-a106-328c128c8429 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:01.150050 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92649c1c-93a4-42b7-a106-328c128c8429 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:01.150950 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92649c1c-93a4-42b7-a106-328c128c8429 None admin] RBAC: Adding query filter params (name=image) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:01.151256 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92649c1c-93a4-42b7-a106-328c128c8429 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:01.152631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92649c1c-93a4-42b7-a106-328c128c8429 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:01.163639 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 532/1063] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:06:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:06:01.165057 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92649c1c-93a4-42b7-a106-328c128c8429 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:01.189755 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:01.257311 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f40f4-6431-4a5a-9735-5fa92a987989 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:01.290499 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92649c1c-93a4-42b7-a106-328c128c8429 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:01.300095 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748fbde-7e4d-4ce4-9f86-09a89b90711c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:01.300740 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748fbde-7e4d-4ce4-9f86-09a89b90711c None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:01.301022 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748fbde-7e4d-4ce4-9f86-09a89b90711c None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:01.301294 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748fbde-7e4d-4ce4-9f86-09a89b90711c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:01.306659 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:01.310445 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f748fbde-7e4d-4ce4-9f86-09a89b90711c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:01.312135 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f748fbde-7e4d-4ce4-9f86-09a89b90711c None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:01.327819 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-f748fbde-7e4d-4ce4-9f86-09a89b90711c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:06:01.327819 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:06:01.327819 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:06:01.327819 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:06:01.327819 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:06:01.327819 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:06:01.327819 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:06:01.327819 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:06:01.327819 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:06:01.327819 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:06:01.327819 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:06:01.327819 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:06:01.327819 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:06:01.327819 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:06:01.327819 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:06:01.327819 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:06:01.328852 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:06:01.328852 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:06:01.328852 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:06:01.328852 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:06:01.328852 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:06:01.328852 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:06:01.328852 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:06:01.328852 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:06:01.328852 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:06:01.328852 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:06:01.328852 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:06:01.328852 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:06:01.328852 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:06:01.328852 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:06:01.328852 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:06:01.328852 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:06:01.328852 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:06:01.328852 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:06:01.329786 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:06:01.329786 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:06:01.329786 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:06:01.329786 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:06:01.329786 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:06:01.329786 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:06:01.329786 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:06:01.329786 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:06:01.329786 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:06:01.329786 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:06:01.334201 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 532/1064] 10.222.0.79 () {56 vars in 1093 bytes} [Wed Aug 31 19:06:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:06:01.335205 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748fbde-7e4d-4ce4-9f86-09a89b90711c None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:01.348000 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd43df2-73a1-4d94-9013-711be083df53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:01.348690 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd43df2-73a1-4d94-9013-711be083df53 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:01.348976 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd43df2-73a1-4d94-9013-711be083df53 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:01.349276 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd43df2-73a1-4d94-9013-711be083df53 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:01.350081 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd43df2-73a1-4d94-9013-711be083df53 None admin] RBAC: Adding query filter params (type=image) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:01.350673 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd43df2-73a1-4d94-9013-711be083df53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:01.352138 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd43df2-73a1-4d94-9013-711be083df53 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:01.359455 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 533/1065] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:06:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:01.365263 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd43df2-73a1-4d94-9013-711be083df53 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:01.476543 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748fbde-7e4d-4ce4-9f86-09a89b90711c None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:01.488482 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:01.496028 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd43df2-73a1-4d94-9013-711be083df53 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:01.533481 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba919eb2-2320-43fc-ad96-1196c44a1c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:01.534268 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba919eb2-2320-43fc-ad96-1196c44a1c80 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:01.534657 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba919eb2-2320-43fc-ad96-1196c44a1c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:01.535263 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba919eb2-2320-43fc-ad96-1196c44a1c80 None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:01.536082 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba919eb2-2320-43fc-ad96-1196c44a1c80 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:01.536466 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba919eb2-2320-43fc-ad96-1196c44a1c80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:01.537988 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba919eb2-2320-43fc-ad96-1196c44a1c80 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:01.539751 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29fa96-3e32-4689-a046-b163e9020905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:01.540768 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29fa96-3e32-4689-a046-b163e9020905 None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:01.541044 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29fa96-3e32-4689-a046-b163e9020905 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:01.541314 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29fa96-3e32-4689-a046-b163e9020905 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:01.541995 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e29fa96-3e32-4689-a046-b163e9020905 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:01.543380 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e29fa96-3e32-4689-a046-b163e9020905 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:01.561074 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 533/1066] 10.222.0.79 () {56 vars in 1133 bytes} [Wed Aug 31 19:06:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:01.569853 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba919eb2-2320-43fc-ad96-1196c44a1c80 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:01.575263 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 534/1067] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:06:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:06:01.733149 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba919eb2-2320-43fc-ad96-1196c44a1c80 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:01.778715 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd65faf-2fa6-4023-99a3-2266ee1fc39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:01.779348 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd65faf-2fa6-4023-99a3-2266ee1fc39d None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:01.779623 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd65faf-2fa6-4023-99a3-2266ee1fc39d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:01.779889 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd65faf-2fa6-4023-99a3-2266ee1fc39d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:01.790289 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd65faf-2fa6-4023-99a3-2266ee1fc39d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:01.791811 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd65faf-2fa6-4023-99a3-2266ee1fc39d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:01.807195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-cfd65faf-2fa6-4023-99a3-2266ee1fc39d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:06:01.807195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:06:01.807195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:06:01.807195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:06:01.807195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:06:01.807195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:06:01.807195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:06:01.807195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:06:01.807195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:06:01.807195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:06:01.807195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:06:01.807195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:06:01.807195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:06:01.807195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:06:01.807195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:06:01.807195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:06:01.808201 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:06:01.808201 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:06:01.808201 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:06:01.808201 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:06:01.808201 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:06:01.808201 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:06:01.808201 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:06:01.808201 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:06:01.808201 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:06:01.808201 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:06:01.808201 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:06:01.808201 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:06:01.808201 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:06:01.808201 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:06:01.808201 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:06:01.808201 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:06:01.808201 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:06:01.810280 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:06:01.810280 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:06:01.810280 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:06:01.810280 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 534/1068] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:06:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:06:01.816450 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29fa96-3e32-4689-a046-b163e9020905 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:01.849264 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:01.926939 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29fa96-3e32-4689-a046-b163e9020905 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:01.964125 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3519a-ed98-479a-9e4a-3953f8d934e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:01.964731 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3519a-ed98-479a-9e4a-3953f8d934e3 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:01.965005 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3519a-ed98-479a-9e4a-3953f8d934e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:01.965273 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3519a-ed98-479a-9e4a-3953f8d934e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:01.965915 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3519a-ed98-479a-9e4a-3953f8d934e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:01.966211 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3519a-ed98-479a-9e4a-3953f8d934e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:01.967608 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3519a-ed98-479a-9e4a-3953f8d934e3 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:01.980619 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 535/1069] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:01.986320 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd65faf-2fa6-4023-99a3-2266ee1fc39d None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:02.005846 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:02.091951 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd65faf-2fa6-4023-99a3-2266ee1fc39d None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:02.126582 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6a2d6-3aa3-4f7c-a454-f942972ffe94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:02.127208 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6a2d6-3aa3-4f7c-a454-f942972ffe94 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:02.127485 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6a2d6-3aa3-4f7c-a454-f942972ffe94 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:02.127759 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6a2d6-3aa3-4f7c-a454-f942972ffe94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:02.134547 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b6a2d6-3aa3-4f7c-a454-f942972ffe94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:02.135977 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b6a2d6-3aa3-4f7c-a454-f942972ffe94 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:02.147013 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-46b6a2d6-3aa3-4f7c-a454-f942972ffe94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:06:02.147013 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:06:02.147013 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:06:02.147013 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:06:02.147013 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:06:02.147013 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:06:02.147013 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:06:02.147013 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:06:02.147013 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:06:02.147013 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:06:02.147013 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:06:02.147013 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:06:02.147013 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:06:02.147013 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:06:02.147013 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:06:02.147889 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:06:02.147889 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:06:02.147889 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:06:02.147889 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:06:02.147889 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:06:02.147889 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:06:02.147889 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:06:02.147889 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:06:02.147889 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:06:02.147889 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:06:02.147889 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:06:02.147889 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:06:02.147889 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:06:02.147889 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:06:02.147889 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:06:02.147889 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:06:02.147889 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:06:02.148766 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:06:02.148766 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:06:02.148766 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:06:02.148766 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:06:02.148766 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:06:02.148766 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:06:02.148766 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:06:02.148766 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:06:02.150785 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 535/1070] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:06:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:06:02.154050 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3519a-ed98-479a-9e4a-3953f8d934e3 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:02.223300 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd1391-0cb6-4525-b362-f0198091c531 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:02.223645 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd1391-0cb6-4525-b362-f0198091c531 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:02.223836 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd1391-0cb6-4525-b362-f0198091c531 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:02.225583 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 536/1071] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:06:02.230340 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdbc61-a632-4378-8995-db9b930b89b9 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:02.230645 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdbc61-a632-4378-8995-db9b930b89b9 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:02.230914 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdbc61-a632-4378-8995-db9b930b89b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:02.251037 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-3cfdbc61-a632-4378-8995-db9b930b89b9 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:02.251528 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:02.252128 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-3cfdbc61-a632-4378-8995-db9b930b89b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:02.265475 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3519a-ed98-479a-9e4a-3953f8d934e3 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:02.305451 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4cd36a-06c0-4f4c-88bf-0cb2da968793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:02.306066 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4cd36a-06c0-4f4c-88bf-0cb2da968793 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:02.306336 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4cd36a-06c0-4f4c-88bf-0cb2da968793 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:02.306652 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4cd36a-06c0-4f4c-88bf-0cb2da968793 None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:02.307350 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4cd36a-06c0-4f4c-88bf-0cb2da968793 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:02.307656 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4cd36a-06c0-4f4c-88bf-0cb2da968793 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:02.309087 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4cd36a-06c0-4f4c-88bf-0cb2da968793 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:02.321186 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 536/1072] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 19:06:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:02.328023 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4cd36a-06c0-4f4c-88bf-0cb2da968793 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:02.332791 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 537/1073] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:06:02.434975 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4cd36a-06c0-4f4c-88bf-0cb2da968793 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:02.478775 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486e9de-8a1d-440c-bdc9-c3bec31459af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:02.479504 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486e9de-8a1d-440c-bdc9-c3bec31459af None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:02.479921 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486e9de-8a1d-440c-bdc9-c3bec31459af None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:02.480348 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486e9de-8a1d-440c-bdc9-c3bec31459af None admin] PATH_INFO: `/v3/projects/f9e550ea75dd4245bd9c2bcd6322c507/users/1fd6d45d1bc3479da72cb1a1990a6137/roles/adbf346347dc40afa78c773cfc32c750` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:02.482848 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d486e9de-8a1d-440c-bdc9-c3bec31459af None admin] RBAC: Authorizing `identity:create_grant(project_id=f9e550ea75dd4245bd9c2bcd6322c507, user_id=1fd6d45d1bc3479da72cb1a1990a6137, role_id=adbf346347dc40afa78c773cfc32c750)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:02.484946 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d486e9de-8a1d-440c-bdc9-c3bec31459af None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:02.509290 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 537/1074] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 19:06:02 2022] PUT /identity/v3/projects/f9e550ea75dd4245bd9c2bcd6322c507/users/1fd6d45d1bc3479da72cb1a1990a6137/roles/adbf346347dc40afa78c773cfc32c750 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:06:02.612984 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfdbc61-a632-4378-8995-db9b930b89b9 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:02.621871 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:02.745974 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfdbc61-a632-4378-8995-db9b930b89b9 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:02.792920 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66984f-a7c9-4c18-8dfa-39c5aa93ef74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:02.793473 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66984f-a7c9-4c18-8dfa-39c5aa93ef74 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:02.793751 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66984f-a7c9-4c18-8dfa-39c5aa93ef74 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:02.794022 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66984f-a7c9-4c18-8dfa-39c5aa93ef74 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:02.805680 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a66984f-a7c9-4c18-8dfa-39c5aa93ef74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:06:02.810512 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-5a66984f-a7c9-4c18-8dfa-39c5aa93ef74 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:06:02.810512 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:06:02.810512 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:06:02.810512 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:06:02.810512 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:06:02.810512 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:06:02.810512 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:06:02.810512 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:06:02.810512 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:06:02.810512 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:06:02.810512 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:06:02.810512 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:06:02.810512 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:06:02.810512 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:06:02.810512 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:06:02.810512 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:06:02.811458 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:06:02.811458 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:06:02.811458 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:06:02.811458 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:06:02.811458 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:06:02.811458 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:06:02.811458 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:06:02.811458 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:06:02.811458 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:06:02.811458 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:06:02.811458 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:06:02.811458 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:06:02.811458 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:06:02.811458 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:06:02.811458 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:06:02.811458 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:06:02.812873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:06:02.812873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:06:02.812873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:06:02.812873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:06:02.812873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:06:02.812873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:06:02.812873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:06:02.812873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:06:02.812873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:06:02.812873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:06:02.812873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:06:02.812873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:06:02.812873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 538/1075] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 19:06:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:06:02.818376 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486e9de-8a1d-440c-bdc9-c3bec31459af None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:02.833331 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:02.928334 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486e9de-8a1d-440c-bdc9-c3bec31459af None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:02.962775 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29822807-c011-404f-bac0-698d417ec7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:02.963384 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29822807-c011-404f-bac0-698d417ec7f5 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:02.963659 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29822807-c011-404f-bac0-698d417ec7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:02.963930 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29822807-c011-404f-bac0-698d417ec7f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:02.964598 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29822807-c011-404f-bac0-698d417ec7f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:02.964903 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29822807-c011-404f-bac0-698d417ec7f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:02.966278 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29822807-c011-404f-bac0-698d417ec7f5 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:02.980724 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 538/1076] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:06:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:06:02.982226 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66984f-a7c9-4c18-8dfa-39c5aa93ef74 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:03.050520 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:03.087288 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66984f-a7c9-4c18-8dfa-39c5aa93ef74 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:03.120815 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd439b4-bf70-4655-90a0-04ada031d518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:03.121437 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd439b4-bf70-4655-90a0-04ada031d518 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:03.121710 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd439b4-bf70-4655-90a0-04ada031d518 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:03.121977 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd439b4-bf70-4655-90a0-04ada031d518 None admin] PATH_INFO: `/v3/users/6f77a96674894d3d8913862d070e4201` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:03.123108 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd439b4-bf70-4655-90a0-04ada031d518 None admin] RBAC: Authorizing `identity:get_user(user_id=6f77a96674894d3d8913862d070e4201)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:03.124585 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd439b4-bf70-4655-90a0-04ada031d518 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:03.126303 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 539/1077] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:06:02 2022] GET /identity/v3/users/6f77a96674894d3d8913862d070e4201 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:06:03.132021 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29822807-c011-404f-bac0-698d417ec7f5 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:03.211370 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:03.243402 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29822807-c011-404f-bac0-698d417ec7f5 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:03.278341 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c3cd5-0421-4201-9679-cd24775d27ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:03.279008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c3cd5-0421-4201-9679-cd24775d27ea None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:03.279258 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c3cd5-0421-4201-9679-cd24775d27ea None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:03.279528 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c3cd5-0421-4201-9679-cd24775d27ea None admin] PATH_INFO: `/v3/projects/9968cc1b40974386bd7f0a178c7b0463` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:03.281191 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037c3cd5-0421-4201-9679-cd24775d27ea None admin] RBAC: Authorizing `identity:get_project(project_id=9968cc1b40974386bd7f0a178c7b0463)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:03.282641 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037c3cd5-0421-4201-9679-cd24775d27ea None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:03.285109 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 539/1078] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:06:03 2022] GET /identity/v3/projects/9968cc1b40974386bd7f0a178c7b0463 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:03.291131 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd439b4-bf70-4655-90a0-04ada031d518 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:03.392356 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd439b4-bf70-4655-90a0-04ada031d518 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:03.427660 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7ac41-436c-45d6-bf39-3b2ecd91cf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:03.428326 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7ac41-436c-45d6-bf39-3b2ecd91cf8a None admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:03.428600 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7ac41-436c-45d6-bf39-3b2ecd91cf8a None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:03.428869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7ac41-436c-45d6-bf39-3b2ecd91cf8a None admin] PATH_INFO: `/v3/projects/9968cc1b40974386bd7f0a178c7b0463/users/6f77a96674894d3d8913862d070e4201/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:03.430788 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7ac41-436c-45d6-bf39-3b2ecd91cf8a None admin] RBAC: Authorizing `identity:create_grant(project_id=9968cc1b40974386bd7f0a178c7b0463, user_id=6f77a96674894d3d8913862d070e4201, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:03.432211 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7ac41-436c-45d6-bf39-3b2ecd91cf8a None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:03.434402 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:03.446326 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 540/1079] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 19:06:03 2022] PUT /identity/v3/projects/9968cc1b40974386bd7f0a178c7b0463/users/6f77a96674894d3d8913862d070e4201/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:06:03.569478 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0ebc4-8768-4a8d-973e-02d41de19423 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:03.569759 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0ebc4-8768-4a8d-973e-02d41de19423 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:03.570031 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0ebc4-8768-4a8d-973e-02d41de19423 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:03.571451 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 540/1080] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:06:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:06:03.577095 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24eb615-d896-4870-91de-272d3079d559 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:03.577947 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24eb615-d896-4870-91de-272d3079d559 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:03.578227 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24eb615-d896-4870-91de-272d3079d559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:03.598768 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-b24eb615-d896-4870-91de-272d3079d559 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:03.600448 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-b24eb615-d896-4870-91de-272d3079d559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:03.672663 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 541/1081] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:06:03.939204 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0ebc4-8768-4a8d-973e-02d41de19423 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:04.043918 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0ebc4-8768-4a8d-973e-02d41de19423 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:04.083702 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2f783-149c-4243-91ef-ff54054278f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:04.084316 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2f783-149c-4243-91ef-ff54054278f8 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:04.084596 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2f783-149c-4243-91ef-ff54054278f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:04.084870 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2f783-149c-4243-91ef-ff54054278f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:04.095747 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:04.157527 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2f783-149c-4243-91ef-ff54054278f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:04.159245 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2f783-149c-4243-91ef-ff54054278f8 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:04.259683 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 541/1082] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:06:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:06:04.265734 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24eb615-d896-4870-91de-272d3079d559 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:04.369048 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24eb615-d896-4870-91de-272d3079d559 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:04.392487 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:04.406179 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0848d-9f10-43d2-9642-e57757621c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:04.406850 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0848d-9f10-43d2-9642-e57757621c93 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:04.407129 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0848d-9f10-43d2-9642-e57757621c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:04.407398 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0848d-9f10-43d2-9642-e57757621c93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:04.417978 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0848d-9f10-43d2-9642-e57757621c93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:04.419488 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0848d-9f10-43d2-9642-e57757621c93 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:04.439030 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-d5c0848d-9f10-43d2-9642-e57757621c93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:06:04.439030 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:06:04.439030 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:06:04.439030 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:06:04.439030 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:06:04.439030 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:06:04.439030 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:06:04.439030 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:06:04.439030 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:06:04.439030 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:06:04.439030 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:06:04.439030 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:06:04.439030 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:06:04.439030 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:06:04.439030 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:06:04.439030 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:06:04.440216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:06:04.440216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:06:04.440216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:06:04.440216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:06:04.440216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:06:04.440216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:06:04.440216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:06:04.440216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:06:04.440216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:06:04.440216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:06:04.440216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:06:04.440216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:06:04.440216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:06:04.440216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:06:04.440216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:06:04.440216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:06:04.440216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:06:04.441251 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:06:04.441251 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:06:04.441251 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:06:04.441251 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 542/1083] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:06:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:06:04.446025 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2f783-149c-4243-91ef-ff54054278f8 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:04.451699 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6302f-f479-4d8f-a3f7-97672f8779b6 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:04.451982 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6302f-f479-4d8f-a3f7-97672f8779b6 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:04.452774 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6302f-f479-4d8f-a3f7-97672f8779b6 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:04.454229 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 543/1084] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:06:04.458870 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb957166-7513-465f-8f0e-6c0f551b02da None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:04.459150 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb957166-7513-465f-8f0e-6c0f551b02da None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:04.459424 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb957166-7513-465f-8f0e-6c0f551b02da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:04.478148 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-cb957166-7513-465f-8f0e-6c0f551b02da None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:04.479362 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-cb957166-7513-465f-8f0e-6c0f551b02da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:04.491377 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:04.557564 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 544/1085] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:06:04.565333 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2f783-149c-4243-91ef-ff54054278f8 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:04.602225 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1508103-48cb-491f-a97d-ba5aa92195e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:04.602901 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1508103-48cb-491f-a97d-ba5aa92195e7 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:04.603182 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1508103-48cb-491f-a97d-ba5aa92195e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:04.603454 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1508103-48cb-491f-a97d-ba5aa92195e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:04.604123 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1508103-48cb-491f-a97d-ba5aa92195e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:04.604422 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1508103-48cb-491f-a97d-ba5aa92195e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:04.605810 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1508103-48cb-491f-a97d-ba5aa92195e7 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:04.618406 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 542/1086] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:06:04.822811 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb957166-7513-465f-8f0e-6c0f551b02da None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:04.929860 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb957166-7513-465f-8f0e-6c0f551b02da None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:04.937774 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:04.966161 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb44f16-fe20-4f28-b34a-ef7dd61c84fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:04.966882 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb44f16-fe20-4f28-b34a-ef7dd61c84fb None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:04.967105 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb44f16-fe20-4f28-b34a-ef7dd61c84fb None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:04.967374 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb44f16-fe20-4f28-b34a-ef7dd61c84fb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:04.977560 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb44f16-fe20-4f28-b34a-ef7dd61c84fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:06:04.982301 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-3bb44f16-fe20-4f28-b34a-ef7dd61c84fb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 19:06:04.982301 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:06:04.982301 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:06:04.982301 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:06:04.982301 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:06:04.982301 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:06:04.982301 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:06:04.982301 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:06:04.982301 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:06:04.982301 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:06:04.982301 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:06:04.982301 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:06:04.982301 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:06:04.982301 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:06:04.982301 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:06:04.982301 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:06:04.983270 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:06:04.983270 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:06:04.983270 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:06:04.983270 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:06:04.983270 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:06:04.983270 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:06:04.983270 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:06:04.983270 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:06:04.983270 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:06:04.983270 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:06:04.983270 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:06:04.983270 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:06:04.983270 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:06:04.983270 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:06:04.983270 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:06:04.983270 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:06:04.984194 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:06:04.984194 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:06:04.984194 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:06:04.984194 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:06:04.984194 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:06:04.984194 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:06:04.984194 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:06:04.984194 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:06:04.984194 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:06:04.984194 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:06:04.984194 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 19:06:04.984194 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:06:04.984194 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 545/1087] 10.222.0.79 () {56 vars in 1120 bytes} [Wed Aug 31 19:06:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:06:04.989670 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1508103-48cb-491f-a97d-ba5aa92195e7 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:05.087235 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:05.091029 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1508103-48cb-491f-a97d-ba5aa92195e7 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:05.125658 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28c0f7-7052-45bb-8801-9c5f88418065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:05.126266 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28c0f7-7052-45bb-8801-9c5f88418065 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:05.126584 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28c0f7-7052-45bb-8801-9c5f88418065 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:05.126861 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28c0f7-7052-45bb-8801-9c5f88418065 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:05.127610 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d28c0f7-7052-45bb-8801-9c5f88418065 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:05.128001 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d28c0f7-7052-45bb-8801-9c5f88418065 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:05.129366 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d28c0f7-7052-45bb-8801-9c5f88418065 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:05.137637 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 543/1088] 10.222.0.79 () {56 vars in 1115 bytes} [Wed Aug 31 19:06:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:05.143327 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb44f16-fe20-4f28-b34a-ef7dd61c84fb None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:05.243447 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb44f16-fe20-4f28-b34a-ef7dd61c84fb None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:05.276885 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cac9c-8095-4b25-9dfe-63e44b2c2cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:05.277546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cac9c-8095-4b25-9dfe-63e44b2c2cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:05.277827 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cac9c-8095-4b25-9dfe-63e44b2c2cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:05.278097 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cac9c-8095-4b25-9dfe-63e44b2c2cb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:05.288658 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87cac9c-8095-4b25-9dfe-63e44b2c2cb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:05.290138 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87cac9c-8095-4b25-9dfe-63e44b2c2cb8 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:05.306316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-d87cac9c-8095-4b25-9dfe-63e44b2c2cb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:06:05.306316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:06:05.306316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:06:05.306316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:06:05.306316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:06:05.306316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:06:05.306316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:06:05.306316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:06:05.306316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:06:05.306316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:06:05.306316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:06:05.306316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:06:05.306316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:06:05.306316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:06:05.306316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:06:05.306316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:06:05.307965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:06:05.307965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:06:05.307965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:06:05.307965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:06:05.307965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:06:05.307965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:06:05.307965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:06:05.307965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:06:05.307965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:06:05.307965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:06:05.307965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:06:05.307965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:06:05.307965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:06:05.307965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:06:05.307965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:06:05.307965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:06:05.307965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:06:05.308855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:06:05.308855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:06:05.308855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:06:05.308855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 546/1089] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:06:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:06:05.313716 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28c0f7-7052-45bb-8801-9c5f88418065 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:05.414862 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28c0f7-7052-45bb-8801-9c5f88418065 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:05.433237 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3de93-7e58-4791-a7d5-a6d075ce89d3 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:05.433514 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3de93-7e58-4791-a7d5-a6d075ce89d3 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:05.433783 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3de93-7e58-4791-a7d5-a6d075ce89d3 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:05.435137 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 547/1090] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:06:05.440915 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a75267-529d-45d2-89da-4d40e0f3f403 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:05.441258 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a75267-529d-45d2-89da-4d40e0f3f403 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:05.441594 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a75267-529d-45d2-89da-4d40e0f3f403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:05.450427 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a4065-d548-48c0-9826-906dcd1c8500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:05.451119 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a4065-d548-48c0-9826-906dcd1c8500 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:05.451422 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a4065-d548-48c0-9826-906dcd1c8500 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:05.451717 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a4065-d548-48c0-9826-906dcd1c8500 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:05.452434 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a4065-d548-48c0-9826-906dcd1c8500 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:05.452758 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a4065-d548-48c0-9826-906dcd1c8500 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:05.454162 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a4065-d548-48c0-9826-906dcd1c8500 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:05.459989 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-99a75267-529d-45d2-89da-4d40e0f3f403 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:05.461160 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-99a75267-529d-45d2-89da-4d40e0f3f403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:05.465775 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 544/1091] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:06:05.471487 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a4065-d548-48c0-9826-906dcd1c8500 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:05.474788 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:05.501471 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:05.539115 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 548/1092] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:06:05.581008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a4065-d548-48c0-9826-906dcd1c8500 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:05.615537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44545e7-2260-44c5-aabc-f78b8b1ee43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:05.616158 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44545e7-2260-44c5-aabc-f78b8b1ee43a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:05.616432 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44545e7-2260-44c5-aabc-f78b8b1ee43a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:05.616706 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44545e7-2260-44c5-aabc-f78b8b1ee43a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:05.624003 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44545e7-2260-44c5-aabc-f78b8b1ee43a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:05.625423 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44545e7-2260-44c5-aabc-f78b8b1ee43a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:05.636577 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-e44545e7-2260-44c5-aabc-f78b8b1ee43a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:06:05.636577 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:06:05.636577 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:06:05.636577 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:06:05.636577 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:06:05.636577 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:06:05.636577 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:06:05.636577 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:06:05.636577 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:06:05.636577 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:06:05.636577 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:06:05.636577 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:06:05.636577 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:06:05.636577 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:06:05.636577 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:06:05.636577 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:06:05.637710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:06:05.637710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:06:05.637710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:06:05.637710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:06:05.637710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:06:05.637710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:06:05.637710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:06:05.637710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:06:05.637710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:06:05.637710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:06:05.637710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:06:05.637710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:06:05.637710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:06:05.637710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:06:05.637710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:06:05.637710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:06:05.637710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:06:05.637710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:06:05.638933 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:06:05.638933 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:06:05.638933 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:06:05.638933 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:06:05.638933 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:06:05.638933 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:06:05.638933 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:06:05.638933 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:06:05.638933 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 19:06:05.638933 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:06:05.639837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 545/1093] 10.222.0.79 () {56 vars in 1093 bytes} [Wed Aug 31 19:06:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:06:05.643535 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a75267-529d-45d2-89da-4d40e0f3f403 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:05.742523 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a75267-529d-45d2-89da-4d40e0f3f403 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:05.775109 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785fc636-dc36-40b4-99d0-e4b03f24f298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:05.775710 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fc636-dc36-40b4-99d0-e4b03f24f298 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:05.775988 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fc636-dc36-40b4-99d0-e4b03f24f298 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:05.776258 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fc636-dc36-40b4-99d0-e4b03f24f298 None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:05.776988 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785fc636-dc36-40b4-99d0-e4b03f24f298 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:05.777290 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785fc636-dc36-40b4-99d0-e4b03f24f298 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:05.778759 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785fc636-dc36-40b4-99d0-e4b03f24f298 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:05.795677 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 549/1094] 10.222.0.79 () {56 vars in 1133 bytes} [Wed Aug 31 19:06:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:06:05.802136 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44545e7-2260-44c5-aabc-f78b8b1ee43a None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:05.822846 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785fc636-dc36-40b4-99d0-e4b03f24f298 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:05.831274 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:05.885782 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:05.905911 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44545e7-2260-44c5-aabc-f78b8b1ee43a None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:05.928625 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785fc636-dc36-40b4-99d0-e4b03f24f298 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:05.940009 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9647d8b-d5e2-4f9f-abc2-c811f556afca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:05.940621 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9647d8b-d5e2-4f9f-abc2-c811f556afca None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:05.940900 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9647d8b-d5e2-4f9f-abc2-c811f556afca None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:05.941170 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9647d8b-d5e2-4f9f-abc2-c811f556afca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:05.964602 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35d7ae-e793-4019-a659-87bc441c2179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:05.965231 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35d7ae-e793-4019-a659-87bc441c2179 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:05.965564 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35d7ae-e793-4019-a659-87bc441c2179 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:05.965838 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35d7ae-e793-4019-a659-87bc441c2179 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:05.979017 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f35d7ae-e793-4019-a659-87bc441c2179 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:06:05.983768 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-7f35d7ae-e793-4019-a659-87bc441c2179 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:06:05.983768 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:06:05.983768 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:06:05.983768 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:06:05.983768 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:06:05.983768 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:06:05.983768 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:06:05.983768 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:06:05.983768 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:06:05.983768 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:06:05.983768 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:06:05.983768 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:06:05.983768 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:06:05.983768 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:06:05.983768 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:06:05.983768 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:06:05.984952 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:06:05.984952 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:06:05.984952 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:06:05.984952 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:06:05.984952 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:06:05.984952 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:06:05.984952 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:06:05.984952 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:06:05.984952 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:06:05.984952 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:06:05.984952 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:06:05.984952 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:06:05.984952 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:06:05.984952 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:06:05.984952 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:06:05.984952 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:06:05.986155 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:06:05.986155 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:06:05.986155 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:06:05.986155 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:06:05.986155 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:06:05.986155 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:06:05.986155 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:06:05.986155 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:06:05.986155 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:06:05.986155 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:06:05.986155 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:06:05.986155 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:06:05.986155 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 550/1095] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 19:06:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:06:05.991098 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35d7ae-e793-4019-a659-87bc441c2179 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:06.015847 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9647d8b-d5e2-4f9f-abc2-c811f556afca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:06.017233 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9647d8b-d5e2-4f9f-abc2-c811f556afca None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:06.056927 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:06.092489 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35d7ae-e793-4019-a659-87bc441c2179 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:06.098675 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:06.117901 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 546/1096] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:06:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:06:06.123642 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9647d8b-d5e2-4f9f-abc2-c811f556afca None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:06.131173 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a329e7-af9b-4a15-8da4-9dd225dbe8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:06.131780 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a329e7-af9b-4a15-8da4-9dd225dbe8ad None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:06.132054 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a329e7-af9b-4a15-8da4-9dd225dbe8ad None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:06.132319 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a329e7-af9b-4a15-8da4-9dd225dbe8ad None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:06.133005 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a329e7-af9b-4a15-8da4-9dd225dbe8ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:06.133298 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a329e7-af9b-4a15-8da4-9dd225dbe8ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:06.134671 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a329e7-af9b-4a15-8da4-9dd225dbe8ad None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:06.144178 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 551/1097] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:06:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:06.149928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a329e7-af9b-4a15-8da4-9dd225dbe8ad None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:06.226378 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9647d8b-d5e2-4f9f-abc2-c811f556afca None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:06.248441 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a329e7-af9b-4a15-8da4-9dd225dbe8ad None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:06.259683 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d6429-807a-4855-b6cd-90cc07124fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:06.260311 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d6429-807a-4855-b6cd-90cc07124fe6 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:06.260589 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d6429-807a-4855-b6cd-90cc07124fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:06.260859 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d6429-807a-4855-b6cd-90cc07124fe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:06.271235 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d6429-807a-4855-b6cd-90cc07124fe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:06.272613 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d6429-807a-4855-b6cd-90cc07124fe6 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:06.274657 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:06.283291 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b243c-7de5-4abe-898e-dfbc77987643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:06.283968 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b243c-7de5-4abe-898e-dfbc77987643 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:06.284207 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b243c-7de5-4abe-898e-dfbc77987643 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:06.284479 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b243c-7de5-4abe-898e-dfbc77987643 None admin] PATH_INFO: `/v3/users/6f77a96674894d3d8913862d070e4201` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:06.285618 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b243c-7de5-4abe-898e-dfbc77987643 None admin] RBAC: Authorizing `identity:get_user(user_id=6f77a96674894d3d8913862d070e4201)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:06.287080 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b243c-7de5-4abe-898e-dfbc77987643 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:06.288393 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-7c6d6429-807a-4855-b6cd-90cc07124fe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:06:06.288393 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:06:06.288393 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:06:06.288393 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:06:06.288393 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:06:06.288393 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:06:06.288393 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:06:06.288393 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:06:06.288393 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:06:06.288393 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:06:06.288393 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:06:06.288393 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:06:06.288393 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:06:06.288393 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:06:06.288393 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:06:06.288393 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:06:06.289396 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:06:06.289396 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:06:06.289396 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:06:06.289396 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:06:06.289396 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:06:06.289396 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:06:06.289396 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:06:06.289396 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:06:06.289396 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:06:06.289396 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:06:06.289396 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:06:06.289396 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:06:06.289396 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:06:06.289396 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:06:06.289396 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:06:06.289396 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:06:06.289396 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:06:06.290325 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:06:06.290325 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:06:06.290325 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:06:06.290537 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 552/1098] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:06:06 2022] GET /identity/v3/users/6f77a96674894d3d8913862d070e4201 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:06:06.290613 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 547/1099] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:06:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:06:06.294484 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b243c-7de5-4abe-898e-dfbc77987643 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:06.295239 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d6429-807a-4855-b6cd-90cc07124fe6 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:06.330471 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:06.397148 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d6429-807a-4855-b6cd-90cc07124fe6 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:06.399329 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b243c-7de5-4abe-898e-dfbc77987643 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:06.432729 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b23bf-90fa-42b5-a2ab-e3e426b1a9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:06.433337 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b23bf-90fa-42b5-a2ab-e3e426b1a9ff None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:06.433612 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b23bf-90fa-42b5-a2ab-e3e426b1a9ff None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:06.433882 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b23bf-90fa-42b5-a2ab-e3e426b1a9ff None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:06.434561 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b23bf-90fa-42b5-a2ab-e3e426b1a9ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:06.434864 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b23bf-90fa-42b5-a2ab-e3e426b1a9ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:06.435585 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341dd0b6-878b-4bb3-b060-6382bfb2aec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:06.436193 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341dd0b6-878b-4bb3-b060-6382bfb2aec8 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:06.436366 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b23bf-90fa-42b5-a2ab-e3e426b1a9ff None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:06.436515 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341dd0b6-878b-4bb3-b060-6382bfb2aec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:06.436732 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341dd0b6-878b-4bb3-b060-6382bfb2aec8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:06.447997 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 548/1100] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:06:06.453602 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b23bf-90fa-42b5-a2ab-e3e426b1a9ff None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:06.501793 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:06.508899 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341dd0b6-878b-4bb3-b060-6382bfb2aec8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:06.510345 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341dd0b6-878b-4bb3-b060-6382bfb2aec8 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:06.569026 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:06.576362 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b23bf-90fa-42b5-a2ab-e3e426b1a9ff None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:06.611262 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b9d33-768e-495b-aac8-7ad48bfc1652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:06.611829 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 553/1101] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:06:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 19:06:06.611941 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b9d33-768e-495b-aac8-7ad48bfc1652 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:06.612152 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b9d33-768e-495b-aac8-7ad48bfc1652 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:06.612424 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b9d33-768e-495b-aac8-7ad48bfc1652 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:06.617686 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341dd0b6-878b-4bb3-b060-6382bfb2aec8 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:06.619111 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b9d33-768e-495b-aac8-7ad48bfc1652 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:06.620548 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b9d33-768e-495b-aac8-7ad48bfc1652 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:06.631714 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-8d3b9d33-768e-495b-aac8-7ad48bfc1652 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:06:06.631714 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:06:06.631714 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:06:06.631714 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:06:06.631714 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:06:06.631714 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:06:06.631714 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:06:06.631714 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:06:06.631714 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:06:06.631714 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:06:06.631714 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:06:06.631714 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:06:06.631714 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:06:06.631714 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:06:06.631714 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:06:06.632796 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:06:06.632796 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:06:06.632796 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:06:06.632796 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:06:06.632796 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:06:06.632796 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:06:06.632796 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:06:06.632796 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:06:06.632796 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:06:06.632796 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:06:06.632796 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:06:06.632796 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:06:06.632796 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:06:06.632796 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:06:06.632796 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:06:06.632796 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:06:06.632796 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:06:06.634036 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:06:06.634036 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:06:06.634036 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:06:06.634036 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:06:06.634036 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:06:06.634036 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:06:06.634036 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:06:06.634036 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:06:06.634036 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 549/1102] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:06:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:06:06.638479 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b9d33-768e-495b-aac8-7ad48bfc1652 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:06.714012 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:06.721091 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341dd0b6-878b-4bb3-b060-6382bfb2aec8 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:06.740021 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b9d33-768e-495b-aac8-7ad48bfc1652 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:06.759928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa15d21-ce58-4246-9ebe-b36c43b9b6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:06.760555 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa15d21-ce58-4246-9ebe-b36c43b9b6bf None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:06.760839 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa15d21-ce58-4246-9ebe-b36c43b9b6bf None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:06.761107 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa15d21-ce58-4246-9ebe-b36c43b9b6bf None admin] PATH_INFO: `/v3/projects/9968cc1b40974386bd7f0a178c7b0463` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:06.762214 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa15d21-ce58-4246-9ebe-b36c43b9b6bf None admin] RBAC: Authorizing `identity:get_project(project_id=9968cc1b40974386bd7f0a178c7b0463)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:06.763675 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa15d21-ce58-4246-9ebe-b36c43b9b6bf None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:06.765348 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 554/1103] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:06:06 2022] GET /identity/v3/projects/9968cc1b40974386bd7f0a178c7b0463 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:06:06.771410 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa15d21-ce58-4246-9ebe-b36c43b9b6bf None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:06.775357 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2708b-f65d-4b9e-a8ed-0bfd7f51b7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:06.775965 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2708b-f65d-4b9e-a8ed-0bfd7f51b7fb None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:06.776243 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2708b-f65d-4b9e-a8ed-0bfd7f51b7fb None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:06.776514 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2708b-f65d-4b9e-a8ed-0bfd7f51b7fb None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:06.777205 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2708b-f65d-4b9e-a8ed-0bfd7f51b7fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:06.777510 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2708b-f65d-4b9e-a8ed-0bfd7f51b7fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:06.778999 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2708b-f65d-4b9e-a8ed-0bfd7f51b7fb None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:06.791470 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 550/1104] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 19:06:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:06:06.797839 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2708b-f65d-4b9e-a8ed-0bfd7f51b7fb None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:06.813012 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:06.884604 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa15d21-ce58-4246-9ebe-b36c43b9b6bf None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:06.904238 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2708b-f65d-4b9e-a8ed-0bfd7f51b7fb None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:06.917726 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c6a90-ea0d-4831-802f-e16e6dbe862e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:06.918328 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c6a90-ea0d-4831-802f-e16e6dbe862e None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:06.918636 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c6a90-ea0d-4831-802f-e16e6dbe862e None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:06.918909 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c6a90-ea0d-4831-802f-e16e6dbe862e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:06.919631 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c6a90-ea0d-4831-802f-e16e6dbe862e None admin] RBAC: Adding query filter params (role.id=edc551338adb4ae88bdafc591ad69582, scope.project.id=9968cc1b40974386bd7f0a178c7b0463, user.id=6f77a96674894d3d8913862d070e4201) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:06.919937 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c6a90-ea0d-4831-802f-e16e6dbe862e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:06.921889 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c6a90-ea0d-4831-802f-e16e6dbe862e None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:06.928337 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 555/1105] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:06:06 2022] GET /identity/v3/role_assignments?user.id=6f77a96674894d3d8913862d070e4201&scope.project.id=9968cc1b40974386bd7f0a178c7b0463&role.id=edc551338adb4ae88bdafc591ad69582 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:06:06.941704 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7cabea-f4ae-4cd7-9a2e-4034451a7f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:06.942333 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7cabea-f4ae-4cd7-9a2e-4034451a7f84 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:06.942647 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7cabea-f4ae-4cd7-9a2e-4034451a7f84 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:06.942925 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7cabea-f4ae-4cd7-9a2e-4034451a7f84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:06.943683 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7cabea-f4ae-4cd7-9a2e-4034451a7f84 None admin] RBAC: Adding query filter params (role.id=adbf346347dc40afa78c773cfc32c750, scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507, user.id=1fd6d45d1bc3479da72cb1a1990a6137) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:06.943995 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7cabea-f4ae-4cd7-9a2e-4034451a7f84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:06.945473 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7cabea-f4ae-4cd7-9a2e-4034451a7f84 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:06.952423 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 551/1106] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:06:06 2022] GET /identity/v3/role_assignments?user.id=1fd6d45d1bc3479da72cb1a1990a6137&scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507&role.id=adbf346347dc40afa78c773cfc32c750 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:06:08.901334 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e060ccd-b04e-4f70-ac9f-d528697273f3 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:08.901891 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e060ccd-b04e-4f70-ac9f-d528697273f3 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:08.901891 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e060ccd-b04e-4f70-ac9f-d528697273f3 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:08.903246 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 556/1107] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:06:08.909372 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421845be-fc5c-45c5-91bf-9fac13839637 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:08.909372 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421845be-fc5c-45c5-91bf-9fac13839637 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:08.909910 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421845be-fc5c-45c5-91bf-9fac13839637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:08.930487 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-421845be-fc5c-45c5-91bf-9fac13839637 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:08.930487 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-421845be-fc5c-45c5-91bf-9fac13839637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:08.997491 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 552/1108] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:06:09.266815 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e060ccd-b04e-4f70-ac9f-d528697273f3 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:09.294800 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:09.368157 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e060ccd-b04e-4f70-ac9f-d528697273f3 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:09.400671 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc002885-6039-4e48-b277-9c452eee1732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:09.401287 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc002885-6039-4e48-b277-9c452eee1732 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:09.401565 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc002885-6039-4e48-b277-9c452eee1732 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:09.401839 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc002885-6039-4e48-b277-9c452eee1732 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:09.402990 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc002885-6039-4e48-b277-9c452eee1732 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:09.404400 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc002885-6039-4e48-b277-9c452eee1732 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:09.406499 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 557/1109] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:06:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:09.412437 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421845be-fc5c-45c5-91bf-9fac13839637 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:09.423002 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:09.508633 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421845be-fc5c-45c5-91bf-9fac13839637 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:09.544667 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e3deb-f493-4579-9880-0c64c3e81ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:09.545290 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e3deb-f493-4579-9880-0c64c3e81ab1 None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:09.545569 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e3deb-f493-4579-9880-0c64c3e81ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:09.546445 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e3deb-f493-4579-9880-0c64c3e81ab1 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:09.547135 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797e3deb-f493-4579-9880-0c64c3e81ab1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:09.548571 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797e3deb-f493-4579-9880-0c64c3e81ab1 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:09.570035 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 553/1110] 10.222.0.79 () {60 vars in 1132 bytes} [Wed Aug 31 19:06:09 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:06:11.490039 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878da31-ac7e-498a-bc5c-b0620772e13d None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:11.492058 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878da31-ac7e-498a-bc5c-b0620772e13d None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:11.492058 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878da31-ac7e-498a-bc5c-b0620772e13d None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:11.492258 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 558/1111] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:06:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:06:11.497970 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2a7d3-1934-4a58-addb-249abfab32a1 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:11.498432 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2a7d3-1934-4a58-addb-249abfab32a1 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:11.498552 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2a7d3-1934-4a58-addb-249abfab32a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:11.517013 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-03f2a7d3-1934-4a58-addb-249abfab32a1 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:11.518191 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-03f2a7d3-1934-4a58-addb-249abfab32a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:11.580768 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:11.589928 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 554/1112] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:06:11.856842 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878da31-ac7e-498a-bc5c-b0620772e13d None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:11.952908 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:11.960225 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878da31-ac7e-498a-bc5c-b0620772e13d None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:11.995543 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711beea-722c-4d7e-9956-d8b2c5f47a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:11.996157 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711beea-722c-4d7e-9956-d8b2c5f47a99 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:11.996432 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711beea-722c-4d7e-9956-d8b2c5f47a99 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:11.996700 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711beea-722c-4d7e-9956-d8b2c5f47a99 None admin] PATH_INFO: `/v3/roles/d01cf7e1efe04d8c8f8d09667717555c` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:11.998061 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0711beea-722c-4d7e-9956-d8b2c5f47a99 None admin] RBAC: Authorizing `identity:get_role(role_id=d01cf7e1efe04d8c8f8d09667717555c)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:12.000071 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0711beea-722c-4d7e-9956-d8b2c5f47a99 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:12.001446 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 559/1113] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:06:11 2022] GET /identity/v3/roles/d01cf7e1efe04d8c8f8d09667717555c => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:12.007945 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f2a7d3-1934-4a58-addb-249abfab32a1 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:12.122241 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f2a7d3-1934-4a58-addb-249abfab32a1 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:12.162604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57ff81-02fb-48ac-ae86-ad75e4b989f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:12.163236 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57ff81-02fb-48ac-ae86-ad75e4b989f6 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:12.163512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57ff81-02fb-48ac-ae86-ad75e4b989f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:12.163783 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57ff81-02fb-48ac-ae86-ad75e4b989f6 None admin] PATH_INFO: `/v3/users/f1e0319ebc024f36bcd3c94e5f042847` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:12.177313 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57ff81-02fb-48ac-ae86-ad75e4b989f6 None admin] RBAC: Authorizing `identity:get_user(user_id=f1e0319ebc024f36bcd3c94e5f042847)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:12.178797 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57ff81-02fb-48ac-ae86-ad75e4b989f6 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:12.180418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 555/1114] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:06:12 2022] GET /identity/v3/users/f1e0319ebc024f36bcd3c94e5f042847 => generated 286 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:12.186326 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711beea-722c-4d7e-9956-d8b2c5f47a99 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:12.283157 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711beea-722c-4d7e-9956-d8b2c5f47a99 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:12.317373 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b95b0a-a706-4db0-8328-5c479cbe7935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:12.317975 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b95b0a-a706-4db0-8328-5c479cbe7935 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:12.318254 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b95b0a-a706-4db0-8328-5c479cbe7935 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:12.318552 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b95b0a-a706-4db0-8328-5c479cbe7935 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:12.348516 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:12.386697 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b95b0a-a706-4db0-8328-5c479cbe7935 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:12.388043 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b95b0a-a706-4db0-8328-5c479cbe7935 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:12.525174 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 560/1115] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:06:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:06:12.531698 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57ff81-02fb-48ac-ae86-ad75e4b989f6 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:12.584690 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:12.632533 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57ff81-02fb-48ac-ae86-ad75e4b989f6 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:12.667923 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3372ae-bcb2-4f0b-95f8-9e29e6495218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:12.668456 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3372ae-bcb2-4f0b-95f8-9e29e6495218 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:12.668735 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3372ae-bcb2-4f0b-95f8-9e29e6495218 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:12.669003 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3372ae-bcb2-4f0b-95f8-9e29e6495218 None admin] PATH_INFO: `/v3/projects/9968cc1b40974386bd7f0a178c7b0463` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:12.670121 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3372ae-bcb2-4f0b-95f8-9e29e6495218 None admin] RBAC: Authorizing `identity:get_project(project_id=9968cc1b40974386bd7f0a178c7b0463)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:12.672211 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3372ae-bcb2-4f0b-95f8-9e29e6495218 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:12.673836 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 556/1116] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:06:12 2022] GET /identity/v3/projects/9968cc1b40974386bd7f0a178c7b0463 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:12.680443 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b95b0a-a706-4db0-8328-5c479cbe7935 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:12.768745 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:12.822943 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b95b0a-a706-4db0-8328-5c479cbe7935 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:12.873532 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf74b11-d8e7-4541-b709-9c01f3e95cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:12.875020 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf74b11-d8e7-4541-b709-9c01f3e95cda None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:12.875453 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf74b11-d8e7-4541-b709-9c01f3e95cda None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:12.875880 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf74b11-d8e7-4541-b709-9c01f3e95cda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:12.877042 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf74b11-d8e7-4541-b709-9c01f3e95cda None admin] RBAC: Adding query filter params (role.id=d01cf7e1efe04d8c8f8d09667717555c, scope.project.id=9968cc1b40974386bd7f0a178c7b0463, user.id=f1e0319ebc024f36bcd3c94e5f042847) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:12.877504 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf74b11-d8e7-4541-b709-9c01f3e95cda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:12.879827 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf74b11-d8e7-4541-b709-9c01f3e95cda None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:12.888772 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 561/1117] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:06:12 2022] GET /identity/v3/role_assignments?user.id=f1e0319ebc024f36bcd3c94e5f042847&scope.project.id=9968cc1b40974386bd7f0a178c7b0463&role.id=d01cf7e1efe04d8c8f8d09667717555c => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:14.750170 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22215aa0-420e-49e3-ae3a-1852a1f49727 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:14.750742 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22215aa0-420e-49e3-ae3a-1852a1f49727 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:14.750742 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22215aa0-420e-49e3-ae3a-1852a1f49727 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:14.752078 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 557/1118] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:06:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:06:14.757208 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58881099-eb9c-4769-ab4e-01d5668f32c5 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:14.757604 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58881099-eb9c-4769-ab4e-01d5668f32c5 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:14.757750 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58881099-eb9c-4769-ab4e-01d5668f32c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:14.782713 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-58881099-eb9c-4769-ab4e-01d5668f32c5 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:14.783902 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-58881099-eb9c-4769-ab4e-01d5668f32c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:14.847921 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 562/1119] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:06:15.123626 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22215aa0-420e-49e3-ae3a-1852a1f49727 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:15.224073 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22215aa0-420e-49e3-ae3a-1852a1f49727 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:15.244899 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:15.259572 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b754a-5220-436f-b0ab-0081c457fec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:15.260190 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b754a-5220-436f-b0ab-0081c457fec8 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:15.260467 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b754a-5220-436f-b0ab-0081c457fec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:15.260738 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b754a-5220-436f-b0ab-0081c457fec8 None admin] PATH_INFO: `/v3/roles/d01cf7e1efe04d8c8f8d09667717555c` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:15.262111 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b754a-5220-436f-b0ab-0081c457fec8 None admin] RBAC: Authorizing `identity:get_role(role_id=d01cf7e1efe04d8c8f8d09667717555c)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:15.263496 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b754a-5220-436f-b0ab-0081c457fec8 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:15.265370 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 558/1120] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:06:15 2022] GET /identity/v3/roles/d01cf7e1efe04d8c8f8d09667717555c => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:15.271482 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58881099-eb9c-4769-ab4e-01d5668f32c5 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:15.337875 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:15.379811 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58881099-eb9c-4769-ab4e-01d5668f32c5 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:15.413081 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00c8f1-38bd-4a8a-9350-395dceec2551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:15.413698 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00c8f1-38bd-4a8a-9350-395dceec2551 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:15.413972 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00c8f1-38bd-4a8a-9350-395dceec2551 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:15.414239 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00c8f1-38bd-4a8a-9350-395dceec2551 None admin] PATH_INFO: `/v3/users/f1e0319ebc024f36bcd3c94e5f042847` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:15.415373 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e00c8f1-38bd-4a8a-9350-395dceec2551 None admin] RBAC: Authorizing `identity:get_user(user_id=f1e0319ebc024f36bcd3c94e5f042847)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:15.416781 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e00c8f1-38bd-4a8a-9350-395dceec2551 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:15.418335 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 563/1121] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:06:15 2022] GET /identity/v3/users/f1e0319ebc024f36bcd3c94e5f042847 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:15.424639 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b754a-5220-436f-b0ab-0081c457fec8 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:15.521262 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b754a-5220-436f-b0ab-0081c457fec8 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:15.554262 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a91ef-b5a6-4114-a524-70e5edfd50ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:15.554915 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a91ef-b5a6-4114-a524-70e5edfd50ef None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:15.555191 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a91ef-b5a6-4114-a524-70e5edfd50ef None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:15.555459 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a91ef-b5a6-4114-a524-70e5edfd50ef None admin] PATH_INFO: `/v3/projects/9968cc1b40974386bd7f0a178c7b0463` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:15.556551 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a91ef-b5a6-4114-a524-70e5edfd50ef None admin] RBAC: Authorizing `identity:get_project(project_id=9968cc1b40974386bd7f0a178c7b0463)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:15.557962 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a91ef-b5a6-4114-a524-70e5edfd50ef None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:15.559609 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 559/1122] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:06:15 2022] GET /identity/v3/projects/9968cc1b40974386bd7f0a178c7b0463 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:15.566278 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00c8f1-38bd-4a8a-9350-395dceec2551 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:15.664022 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00c8f1-38bd-4a8a-9350-395dceec2551 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:15.689523 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:15.698400 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570faf78-4f56-45b6-a05d-faa2a3bd4fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:15.699075 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570faf78-4f56-45b6-a05d-faa2a3bd4fdf None admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:15.699354 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570faf78-4f56-45b6-a05d-faa2a3bd4fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:15.699627 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570faf78-4f56-45b6-a05d-faa2a3bd4fdf None admin] PATH_INFO: `/v3/projects/9968cc1b40974386bd7f0a178c7b0463/users/f1e0319ebc024f36bcd3c94e5f042847/roles/d01cf7e1efe04d8c8f8d09667717555c` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:15.702258 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570faf78-4f56-45b6-a05d-faa2a3bd4fdf None admin] RBAC: Authorizing `identity:create_grant(project_id=9968cc1b40974386bd7f0a178c7b0463, user_id=f1e0319ebc024f36bcd3c94e5f042847, role_id=d01cf7e1efe04d8c8f8d09667717555c)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:15.703713 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570faf78-4f56-45b6-a05d-faa2a3bd4fdf None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:15.715977 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 564/1123] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 19:06:15 2022] PUT /identity/v3/projects/9968cc1b40974386bd7f0a178c7b0463/users/f1e0319ebc024f36bcd3c94e5f042847/roles/d01cf7e1efe04d8c8f8d09667717555c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:06:17.612199 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d085f-90d7-4a4a-8e11-48f1f1d867d4 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:17.612754 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d085f-90d7-4a4a-8e11-48f1f1d867d4 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:17.612754 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d085f-90d7-4a4a-8e11-48f1f1d867d4 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:17.614066 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 560/1124] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:06:17.619657 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e2d85-60db-48cd-b0d2-f07cb6f487ad None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:17.620125 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e2d85-60db-48cd-b0d2-f07cb6f487ad None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:17.620228 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e2d85-60db-48cd-b0d2-f07cb6f487ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:17.638004 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-609e2d85-60db-48cd-b0d2-f07cb6f487ad None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:17.639215 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-609e2d85-60db-48cd-b0d2-f07cb6f487ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:17.703234 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 565/1125] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:06:17.977601 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d085f-90d7-4a4a-8e11-48f1f1d867d4 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:18.034432 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:18.082995 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d085f-90d7-4a4a-8e11-48f1f1d867d4 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:18.118146 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3543d-2c7e-4504-8f59-fc641ad4223a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:18.118825 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3543d-2c7e-4504-8f59-fc641ad4223a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:18.119109 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3543d-2c7e-4504-8f59-fc641ad4223a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:18.119386 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3543d-2c7e-4504-8f59-fc641ad4223a None admin] PATH_INFO: `/v3/roles/d01cf7e1efe04d8c8f8d09667717555c` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:18.120816 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c3543d-2c7e-4504-8f59-fc641ad4223a None admin] RBAC: Authorizing `identity:get_role(role_id=d01cf7e1efe04d8c8f8d09667717555c)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:18.122186 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c3543d-2c7e-4504-8f59-fc641ad4223a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:18.123563 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 561/1126] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:06:17 2022] GET /identity/v3/roles/d01cf7e1efe04d8c8f8d09667717555c => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:06:18.130108 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e2d85-60db-48cd-b0d2-f07cb6f487ad None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:18.227922 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e2d85-60db-48cd-b0d2-f07cb6f487ad None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:18.244236 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:18.263972 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d96aae-a558-4225-a428-c80b13271f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:18.264633 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d96aae-a558-4225-a428-c80b13271f33 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:18.264915 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d96aae-a558-4225-a428-c80b13271f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:18.265188 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d96aae-a558-4225-a428-c80b13271f33 None admin] PATH_INFO: `/v3/users/f1e0319ebc024f36bcd3c94e5f042847` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:18.266307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d96aae-a558-4225-a428-c80b13271f33 None admin] RBAC: Authorizing `identity:get_user(user_id=f1e0319ebc024f36bcd3c94e5f042847)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:18.267770 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d96aae-a558-4225-a428-c80b13271f33 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:18.269370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 566/1127] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:06:18 2022] GET /identity/v3/users/f1e0319ebc024f36bcd3c94e5f042847 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:18.275504 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3543d-2c7e-4504-8f59-fc641ad4223a None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:18.375133 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3543d-2c7e-4504-8f59-fc641ad4223a None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:18.397732 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:18.410697 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5bf27b-6c42-4a2c-a9b6-470d480d0e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:18.411304 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5bf27b-6c42-4a2c-a9b6-470d480d0e6a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:18.411585 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5bf27b-6c42-4a2c-a9b6-470d480d0e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:18.411860 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5bf27b-6c42-4a2c-a9b6-470d480d0e6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:18.480121 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5bf27b-6c42-4a2c-a9b6-470d480d0e6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:18.481480 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5bf27b-6c42-4a2c-a9b6-470d480d0e6a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:18.579620 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 562/1128] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:06:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 19:06:18.585749 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d96aae-a558-4225-a428-c80b13271f33 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:18.684114 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d96aae-a558-4225-a428-c80b13271f33 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:18.717603 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9efb2-4bdb-4292-a7e3-3c1fd98fb2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:18.718220 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9efb2-4bdb-4292-a7e3-3c1fd98fb2bf None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:18.718517 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9efb2-4bdb-4292-a7e3-3c1fd98fb2bf None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:18.718787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9efb2-4bdb-4292-a7e3-3c1fd98fb2bf None admin] PATH_INFO: `/v3/projects/9968cc1b40974386bd7f0a178c7b0463` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:18.719886 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef9efb2-4bdb-4292-a7e3-3c1fd98fb2bf None admin] RBAC: Authorizing `identity:get_project(project_id=9968cc1b40974386bd7f0a178c7b0463)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:18.721288 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef9efb2-4bdb-4292-a7e3-3c1fd98fb2bf None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:18.722937 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 567/1129] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:06:18 2022] GET /identity/v3/projects/9968cc1b40974386bd7f0a178c7b0463 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:18.729629 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5bf27b-6c42-4a2c-a9b6-470d480d0e6a None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:18.755200 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:18.830624 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5bf27b-6c42-4a2c-a9b6-470d480d0e6a None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:18.864727 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c106b5-ca1c-4e8c-a20f-3db26f6043da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:18.865318 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c106b5-ca1c-4e8c-a20f-3db26f6043da None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:18.865597 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c106b5-ca1c-4e8c-a20f-3db26f6043da None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:18.865868 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c106b5-ca1c-4e8c-a20f-3db26f6043da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:18.866623 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c106b5-ca1c-4e8c-a20f-3db26f6043da None admin] RBAC: Adding query filter params (role.id=d01cf7e1efe04d8c8f8d09667717555c, scope.project.id=9968cc1b40974386bd7f0a178c7b0463, user.id=f1e0319ebc024f36bcd3c94e5f042847) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:18.866932 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c106b5-ca1c-4e8c-a20f-3db26f6043da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:18.868354 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c106b5-ca1c-4e8c-a20f-3db26f6043da None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:18.874569 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 563/1130] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:06:18 2022] GET /identity/v3/role_assignments?user.id=f1e0319ebc024f36bcd3c94e5f042847&scope.project.id=9968cc1b40974386bd7f0a178c7b0463&role.id=d01cf7e1efe04d8c8f8d09667717555c => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:20.769282 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e1fc7-6413-4994-8c9b-5c3bc9cf73ad None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:20.769875 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e1fc7-6413-4994-8c9b-5c3bc9cf73ad None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:20.769875 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e1fc7-6413-4994-8c9b-5c3bc9cf73ad None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:20.771186 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 568/1131] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:06:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:06:20.780030 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0da155-93b1-43fe-800c-e1577d774b01 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:20.780489 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0da155-93b1-43fe-800c-e1577d774b01 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:20.780602 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0da155-93b1-43fe-800c-e1577d774b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:20.799868 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-8f0da155-93b1-43fe-800c-e1577d774b01 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:20.800984 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8f0da155-93b1-43fe-800c-e1577d774b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:20.868822 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 564/1132] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:06:21.135479 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e1fc7-6413-4994-8c9b-5c3bc9cf73ad None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:21.188783 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:21.236564 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e1fc7-6413-4994-8c9b-5c3bc9cf73ad None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:21.270426 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730e558-fa41-475e-b2a1-a20708bebad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:21.271079 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730e558-fa41-475e-b2a1-a20708bebad5 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:21.271356 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730e558-fa41-475e-b2a1-a20708bebad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:21.271623 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730e558-fa41-475e-b2a1-a20708bebad5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:21.272729 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730e558-fa41-475e-b2a1-a20708bebad5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:21.274145 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730e558-fa41-475e-b2a1-a20708bebad5 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:21.275747 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 569/1133] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:06:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:21.282393 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0da155-93b1-43fe-800c-e1577d774b01 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:21.300154 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:21.387824 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0da155-93b1-43fe-800c-e1577d774b01 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:21.430867 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c88fe-3ed2-4c5b-9954-3aca9df79b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:21.431533 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c88fe-3ed2-4c5b-9954-3aca9df79b50 None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:21.431756 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c88fe-3ed2-4c5b-9954-3aca9df79b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:21.432028 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c88fe-3ed2-4c5b-9954-3aca9df79b50 None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:21.432678 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7c88fe-3ed2-4c5b-9954-3aca9df79b50 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:21.434104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7c88fe-3ed2-4c5b-9954-3aca9df79b50 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:21.463931 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 565/1134] 10.222.0.79 () {60 vars in 1141 bytes} [Wed Aug 31 19:06:21 2022] POST /identity/v3/projects => generated 311 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:06:23.417960 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0356c-f578-4054-99e9-0a9b25245498 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:23.418578 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0356c-f578-4054-99e9-0a9b25245498 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:23.418578 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0356c-f578-4054-99e9-0a9b25245498 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:23.419842 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 570/1135] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:06:23.424953 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d7cb1-ae15-414b-8abe-387acad358e6 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:23.425439 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d7cb1-ae15-414b-8abe-387acad358e6 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:23.425540 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d7cb1-ae15-414b-8abe-387acad358e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:23.443571 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-da8d7cb1-ae15-414b-8abe-387acad358e6 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:23.444760 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-da8d7cb1-ae15-414b-8abe-387acad358e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:23.508404 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:23.513682 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 566/1136] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:06:23.788671 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0356c-f578-4054-99e9-0a9b25245498 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:23.897266 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0356c-f578-4054-99e9-0a9b25245498 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:23.917514 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:23.932739 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b627d-cb8e-4450-9049-8ba5f32ea542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:23.933361 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b627d-cb8e-4450-9049-8ba5f32ea542 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:23.933639 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b627d-cb8e-4450-9049-8ba5f32ea542 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:23.933908 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b627d-cb8e-4450-9049-8ba5f32ea542 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:23.935045 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b627d-cb8e-4450-9049-8ba5f32ea542 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:23.936495 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b627d-cb8e-4450-9049-8ba5f32ea542 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:23.938101 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 571/1137] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:06:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:23.944056 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d7cb1-ae15-414b-8abe-387acad358e6 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:24.047682 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d7cb1-ae15-414b-8abe-387acad358e6 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:24.084901 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec134bd-c3c0-40cb-8703-1fafdf2d28cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:24.085751 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec134bd-c3c0-40cb-8703-1fafdf2d28cf None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:24.085751 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec134bd-c3c0-40cb-8703-1fafdf2d28cf None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:24.086026 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec134bd-c3c0-40cb-8703-1fafdf2d28cf None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:24.086711 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec134bd-c3c0-40cb-8703-1fafdf2d28cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:24.088151 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec134bd-c3c0-40cb-8703-1fafdf2d28cf None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:24.110551 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 567/1138] 10.222.0.79 () {60 vars in 1132 bytes} [Wed Aug 31 19:06:23 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:06:26.130299 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77426065-7dae-4f1e-96a8-2a1e59875c00 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:26.130895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77426065-7dae-4f1e-96a8-2a1e59875c00 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:26.130895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77426065-7dae-4f1e-96a8-2a1e59875c00 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:26.132195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 572/1139] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:06:26.137297 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143d241-b9d3-415d-943d-dfa6e4440ab0 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:26.137753 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143d241-b9d3-415d-943d-dfa6e4440ab0 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:26.137856 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143d241-b9d3-415d-943d-dfa6e4440ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:26.156032 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-6143d241-b9d3-415d-943d-dfa6e4440ab0 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:26.157209 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6143d241-b9d3-415d-943d-dfa6e4440ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:26.206349 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:26.225433 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 568/1140] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:06:26.487211 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77426065-7dae-4f1e-96a8-2a1e59875c00 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:26.590699 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77426065-7dae-4f1e-96a8-2a1e59875c00 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:26.623218 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be281082-8496-4722-8e5d-0aec6d11c343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:26.624345 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be281082-8496-4722-8e5d-0aec6d11c343 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:26.624621 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be281082-8496-4722-8e5d-0aec6d11c343 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:26.625634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be281082-8496-4722-8e5d-0aec6d11c343 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:26.634951 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be281082-8496-4722-8e5d-0aec6d11c343 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:06:26.640260 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-be281082-8496-4722-8e5d-0aec6d11c343 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:06:26.640260 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:06:26.640260 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:06:26.640260 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:06:26.640260 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:06:26.640260 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:06:26.640260 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:06:26.640260 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:06:26.640260 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:06:26.640260 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:06:26.640260 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:06:26.640260 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:06:26.640260 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:06:26.640260 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:06:26.640260 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:06:26.640260 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:06:26.641426 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:06:26.641426 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:06:26.641426 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:06:26.641426 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:06:26.641426 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:06:26.641426 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:06:26.641426 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:06:26.641426 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:06:26.641426 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:06:26.641426 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:06:26.641426 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:06:26.641426 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:06:26.641426 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:06:26.641426 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:06:26.641426 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:06:26.641426 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:06:26.642569 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:06:26.642569 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:06:26.642569 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:06:26.642569 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:06:26.642569 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:06:26.642569 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:06:26.642569 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:06:26.642569 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:06:26.642569 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:06:26.642569 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:06:26.642569 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:06:26.642569 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:06:26.642569 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 573/1141] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 19:06:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:06:26.647504 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143d241-b9d3-415d-943d-dfa6e4440ab0 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:26.742720 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143d241-b9d3-415d-943d-dfa6e4440ab0 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:26.776236 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5627bcd-8600-4dbf-9b23-0ae660bdc3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:26.776839 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5627bcd-8600-4dbf-9b23-0ae660bdc3b7 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:26.777117 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5627bcd-8600-4dbf-9b23-0ae660bdc3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:26.777388 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5627bcd-8600-4dbf-9b23-0ae660bdc3b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:26.778051 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5627bcd-8600-4dbf-9b23-0ae660bdc3b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:26.778351 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5627bcd-8600-4dbf-9b23-0ae660bdc3b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:26.779749 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5627bcd-8600-4dbf-9b23-0ae660bdc3b7 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:26.787906 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 569/1142] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:06:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:26.793954 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be281082-8496-4722-8e5d-0aec6d11c343 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:26.843212 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:26.894582 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be281082-8496-4722-8e5d-0aec6d11c343 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:26.927876 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b503a8-b0ef-49c3-9690-bdb4ee6f5fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:26.928497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b503a8-b0ef-49c3-9690-bdb4ee6f5fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:26.928778 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b503a8-b0ef-49c3-9690-bdb4ee6f5fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:26.929050 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b503a8-b0ef-49c3-9690-bdb4ee6f5fd3 None admin] PATH_INFO: `/v3/users/d875999786464e41be733abcac2aa6d9` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:26.942480 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b503a8-b0ef-49c3-9690-bdb4ee6f5fd3 None admin] RBAC: Authorizing `identity:get_user(user_id=d875999786464e41be733abcac2aa6d9)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:26.943912 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b503a8-b0ef-49c3-9690-bdb4ee6f5fd3 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:26.945520 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 574/1143] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:06:26 2022] GET /identity/v3/users/d875999786464e41be733abcac2aa6d9 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:26.951558 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5627bcd-8600-4dbf-9b23-0ae660bdc3b7 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:27.000897 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:27.050420 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5627bcd-8600-4dbf-9b23-0ae660bdc3b7 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:27.083032 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87812b2d-dfdb-4be4-b1a5-4b9d47a8ca9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:27.083631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87812b2d-dfdb-4be4-b1a5-4b9d47a8ca9f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:27.083905 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87812b2d-dfdb-4be4-b1a5-4b9d47a8ca9f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:27.084172 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87812b2d-dfdb-4be4-b1a5-4b9d47a8ca9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:27.150607 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87812b2d-dfdb-4be4-b1a5-4b9d47a8ca9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:27.152062 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87812b2d-dfdb-4be4-b1a5-4b9d47a8ca9f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:27.198753 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:27.249996 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 570/1144] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:06:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:06:27.256213 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b503a8-b0ef-49c3-9690-bdb4ee6f5fd3 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:27.355134 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b503a8-b0ef-49c3-9690-bdb4ee6f5fd3 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:27.362803 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:27.389247 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dccdbf-61fb-4570-a99e-8681a9ad3456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:27.389872 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dccdbf-61fb-4570-a99e-8681a9ad3456 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:27.390152 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dccdbf-61fb-4570-a99e-8681a9ad3456 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:27.390426 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dccdbf-61fb-4570-a99e-8681a9ad3456 None admin] PATH_INFO: `/v3/projects/e459822e48564585b7cdfc73c31b8fd5` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:27.391557 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dccdbf-61fb-4570-a99e-8681a9ad3456 None admin] RBAC: Authorizing `identity:get_project(project_id=e459822e48564585b7cdfc73c31b8fd5)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:27.392985 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dccdbf-61fb-4570-a99e-8681a9ad3456 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:27.394699 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 575/1145] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:06:27 2022] GET /identity/v3/projects/e459822e48564585b7cdfc73c31b8fd5 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:27.400892 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87812b2d-dfdb-4be4-b1a5-4b9d47a8ca9f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:27.502099 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87812b2d-dfdb-4be4-b1a5-4b9d47a8ca9f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:27.537454 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59f8b9-e76e-46b6-a8f6-e2415b141d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:27.537984 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59f8b9-e76e-46b6-a8f6-e2415b141d0b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:27.538261 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59f8b9-e76e-46b6-a8f6-e2415b141d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:27.539083 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59f8b9-e76e-46b6-a8f6-e2415b141d0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:27.539299 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa59f8b9-e76e-46b6-a8f6-e2415b141d0b None admin] RBAC: Adding query filter params (role.id=edc551338adb4ae88bdafc591ad69582, scope.project.id=e459822e48564585b7cdfc73c31b8fd5, user.id=d875999786464e41be733abcac2aa6d9) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:27.539603 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa59f8b9-e76e-46b6-a8f6-e2415b141d0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:27.541025 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa59f8b9-e76e-46b6-a8f6-e2415b141d0b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:27.547091 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 571/1146] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:06:27 2022] GET /identity/v3/role_assignments?user.id=d875999786464e41be733abcac2aa6d9&scope.project.id=e459822e48564585b7cdfc73c31b8fd5&role.id=edc551338adb4ae88bdafc591ad69582 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:29.424935 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa893690-96db-49ce-aac5-a762642db744 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:29.425471 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa893690-96db-49ce-aac5-a762642db744 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:29.425471 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa893690-96db-49ce-aac5-a762642db744 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:29.426829 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 576/1147] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:06:29.432123 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0bcce-fca2-4fd2-95de-dc50597ad621 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:29.432534 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0bcce-fca2-4fd2-95de-dc50597ad621 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:29.432674 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0bcce-fca2-4fd2-95de-dc50597ad621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:29.451265 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-82b0bcce-fca2-4fd2-95de-dc50597ad621 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:29.452591 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-82b0bcce-fca2-4fd2-95de-dc50597ad621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:29.459902 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:29.519308 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 572/1148] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:06:29.787558 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa893690-96db-49ce-aac5-a762642db744 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:29.886469 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa893690-96db-49ce-aac5-a762642db744 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:29.919330 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6d4eb-c813-4b3d-ad8a-a56d01d4e7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:29.919948 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6d4eb-c813-4b3d-ad8a-a56d01d4e7ac None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:29.920226 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6d4eb-c813-4b3d-ad8a-a56d01d4e7ac None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:29.921061 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6d4eb-c813-4b3d-ad8a-a56d01d4e7ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:29.931912 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe6d4eb-c813-4b3d-ad8a-a56d01d4e7ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:06:29.936780 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-cbe6d4eb-c813-4b3d-ad8a-a56d01d4e7ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:06:29.936780 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:06:29.936780 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:06:29.936780 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:06:29.936780 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:06:29.936780 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:06:29.936780 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:06:29.936780 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:06:29.936780 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:06:29.936780 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:06:29.936780 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:06:29.936780 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:06:29.936780 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:06:29.936780 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:06:29.936780 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:06:29.936780 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:06:29.937871 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:06:29.937871 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:06:29.937871 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:06:29.937871 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:06:29.937871 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:06:29.937871 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:06:29.937871 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:06:29.937871 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:06:29.937871 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:06:29.937871 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:06:29.937871 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:06:29.937871 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:06:29.937871 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:06:29.937871 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:06:29.937871 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:06:29.937871 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:06:29.939111 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:06:29.939111 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:06:29.939111 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:06:29.939111 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:06:29.939111 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:06:29.939111 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:06:29.939111 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:06:29.939111 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:06:29.939111 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:06:29.939111 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:06:29.939111 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:06:29.939111 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:06:29.939111 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 577/1149] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 19:06:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:06:29.944087 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b0bcce-fca2-4fd2-95de-dc50597ad621 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:30.045125 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b0bcce-fca2-4fd2-95de-dc50597ad621 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:30.077518 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec486656-f984-4cbe-b1b3-b7d994d9e88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:30.078116 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec486656-f984-4cbe-b1b3-b7d994d9e88b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:30.078393 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec486656-f984-4cbe-b1b3-b7d994d9e88b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:30.078690 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec486656-f984-4cbe-b1b3-b7d994d9e88b None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:30.079352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec486656-f984-4cbe-b1b3-b7d994d9e88b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:30.079654 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec486656-f984-4cbe-b1b3-b7d994d9e88b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:30.081037 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec486656-f984-4cbe-b1b3-b7d994d9e88b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:30.088845 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 573/1150] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:06:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:30.095253 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6d4eb-c813-4b3d-ad8a-a56d01d4e7ac None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:30.128425 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:30.191896 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6d4eb-c813-4b3d-ad8a-a56d01d4e7ac None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:30.225189 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a6b46-9a9c-4a74-baf3-c224f7e8041d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:30.225792 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a6b46-9a9c-4a74-baf3-c224f7e8041d None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:30.226067 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a6b46-9a9c-4a74-baf3-c224f7e8041d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:30.226337 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a6b46-9a9c-4a74-baf3-c224f7e8041d None admin] PATH_INFO: `/v3/users/d875999786464e41be733abcac2aa6d9` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:30.227459 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a6b46-9a9c-4a74-baf3-c224f7e8041d None admin] RBAC: Authorizing `identity:get_user(user_id=d875999786464e41be733abcac2aa6d9)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:30.228859 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a6b46-9a9c-4a74-baf3-c224f7e8041d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:30.230400 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 578/1151] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:06:30 2022] GET /identity/v3/users/d875999786464e41be733abcac2aa6d9 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:30.236345 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec486656-f984-4cbe-b1b3-b7d994d9e88b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:30.240109 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:30.345059 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec486656-f984-4cbe-b1b3-b7d994d9e88b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:30.377920 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3fe073-d906-449a-b06a-2971d09b00b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:30.378566 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fe073-d906-449a-b06a-2971d09b00b0 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:30.378846 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fe073-d906-449a-b06a-2971d09b00b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:30.379118 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fe073-d906-449a-b06a-2971d09b00b0 None admin] PATH_INFO: `/v3/projects/e459822e48564585b7cdfc73c31b8fd5` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:30.380219 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3fe073-d906-449a-b06a-2971d09b00b0 None admin] RBAC: Authorizing `identity:get_project(project_id=e459822e48564585b7cdfc73c31b8fd5)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:30.381655 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3fe073-d906-449a-b06a-2971d09b00b0 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:30.383292 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 574/1152] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:06:30 2022] GET /identity/v3/projects/e459822e48564585b7cdfc73c31b8fd5 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:30.389407 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a6b46-9a9c-4a74-baf3-c224f7e8041d None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:30.494207 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a6b46-9a9c-4a74-baf3-c224f7e8041d None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:30.495784 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:30.534451 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05387b89-d9fc-4eac-a9fb-27cf6461244a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:30.535310 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05387b89-d9fc-4eac-a9fb-27cf6461244a None admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:30.535594 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05387b89-d9fc-4eac-a9fb-27cf6461244a None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:30.535868 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05387b89-d9fc-4eac-a9fb-27cf6461244a None admin] PATH_INFO: `/v3/projects/e459822e48564585b7cdfc73c31b8fd5/users/d875999786464e41be733abcac2aa6d9/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:30.537787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05387b89-d9fc-4eac-a9fb-27cf6461244a None admin] RBAC: Authorizing `identity:create_grant(project_id=e459822e48564585b7cdfc73c31b8fd5, user_id=d875999786464e41be733abcac2aa6d9, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:30.539239 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05387b89-d9fc-4eac-a9fb-27cf6461244a None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:30.554004 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 579/1153] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 19:06:30 2022] PUT /identity/v3/projects/e459822e48564585b7cdfc73c31b8fd5/users/d875999786464e41be733abcac2aa6d9/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:06:32.433907 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4b057-1f38-4f4b-b51b-80b2b82ee4a5 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:32.434448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4b057-1f38-4f4b-b51b-80b2b82ee4a5 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:32.434448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4b057-1f38-4f4b-b51b-80b2b82ee4a5 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:32.435825 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 575/1154] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:06:32.441914 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361880b7-7368-4fa9-860b-d28c9a8bec03 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:32.442647 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361880b7-7368-4fa9-860b-d28c9a8bec03 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:32.442647 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361880b7-7368-4fa9-860b-d28c9a8bec03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:32.460904 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-361880b7-7368-4fa9-860b-d28c9a8bec03 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:32.462110 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-361880b7-7368-4fa9-860b-d28c9a8bec03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:32.530340 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 580/1155] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:06:32.797682 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e4b057-1f38-4f4b-b51b-80b2b82ee4a5 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:32.875846 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:32.910480 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e4b057-1f38-4f4b-b51b-80b2b82ee4a5 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:32.944456 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac289ae4-6449-49e7-9300-70ea8693ea48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:32.945076 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac289ae4-6449-49e7-9300-70ea8693ea48 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:32.945354 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac289ae4-6449-49e7-9300-70ea8693ea48 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:32.945625 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac289ae4-6449-49e7-9300-70ea8693ea48 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:32.955900 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac289ae4-6449-49e7-9300-70ea8693ea48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:06:32.960663 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-ac289ae4-6449-49e7-9300-70ea8693ea48 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:06:32.960663 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:06:32.960663 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:06:32.960663 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:06:32.960663 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:06:32.960663 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:06:32.960663 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:06:32.960663 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:06:32.960663 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:06:32.960663 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:06:32.960663 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:06:32.960663 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:06:32.960663 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:06:32.960663 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:06:32.960663 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:06:32.960663 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:06:32.961811 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:06:32.961811 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:06:32.961811 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:06:32.961811 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:06:32.961811 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:06:32.961811 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:06:32.961811 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:06:32.961811 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:06:32.961811 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:06:32.961811 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:06:32.961811 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:06:32.961811 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:06:32.961811 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:06:32.961811 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:06:32.961811 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:06:32.961811 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:06:32.962908 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:06:32.962908 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:06:32.962908 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:06:32.962908 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:06:32.962908 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:06:32.962908 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:06:32.962908 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:06:32.962908 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:06:32.962908 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:06:32.962908 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:06:32.962908 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:06:32.962908 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:06:32.962908 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 576/1156] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 19:06:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:06:32.968549 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361880b7-7368-4fa9-860b-d28c9a8bec03 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:33.056035 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:33.065747 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361880b7-7368-4fa9-860b-d28c9a8bec03 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:33.100005 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1607f-a758-46f8-b9dd-d84b58beda5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:33.100600 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1607f-a758-46f8-b9dd-d84b58beda5d None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:33.100877 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1607f-a758-46f8-b9dd-d84b58beda5d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:33.101149 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1607f-a758-46f8-b9dd-d84b58beda5d None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:33.101805 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a1607f-a758-46f8-b9dd-d84b58beda5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:33.102104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a1607f-a758-46f8-b9dd-d84b58beda5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:33.103493 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a1607f-a758-46f8-b9dd-d84b58beda5d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:33.111275 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 581/1157] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:06:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:33.117140 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac289ae4-6449-49e7-9300-70ea8693ea48 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:33.214376 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac289ae4-6449-49e7-9300-70ea8693ea48 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:33.243365 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:33.248686 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825fc90f-8cbd-4126-a513-f15a5e56c91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:33.249306 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825fc90f-8cbd-4126-a513-f15a5e56c91e None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:33.249583 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825fc90f-8cbd-4126-a513-f15a5e56c91e None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:33.249856 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825fc90f-8cbd-4126-a513-f15a5e56c91e None admin] PATH_INFO: `/v3/users/d875999786464e41be733abcac2aa6d9` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:33.250997 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825fc90f-8cbd-4126-a513-f15a5e56c91e None admin] RBAC: Authorizing `identity:get_user(user_id=d875999786464e41be733abcac2aa6d9)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:33.252420 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825fc90f-8cbd-4126-a513-f15a5e56c91e None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:33.253986 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 577/1158] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:06:33 2022] GET /identity/v3/users/d875999786464e41be733abcac2aa6d9 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:33.259898 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1607f-a758-46f8-b9dd-d84b58beda5d None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:33.357378 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1607f-a758-46f8-b9dd-d84b58beda5d None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:33.390725 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95afb1-8759-45bb-b476-329f5dc10aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:33.391317 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95afb1-8759-45bb-b476-329f5dc10aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:33.391594 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95afb1-8759-45bb-b476-329f5dc10aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:33.391867 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95afb1-8759-45bb-b476-329f5dc10aa5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:33.414781 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:33.458089 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf95afb1-8759-45bb-b476-329f5dc10aa5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:33.468194 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf95afb1-8759-45bb-b476-329f5dc10aa5 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:33.553353 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 582/1159] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:06:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:06:33.559158 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825fc90f-8cbd-4126-a513-f15a5e56c91e None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:33.657946 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825fc90f-8cbd-4126-a513-f15a5e56c91e None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:33.691117 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eeb700-74ab-4af0-a27f-996b368272f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:33.691730 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eeb700-74ab-4af0-a27f-996b368272f9 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:33.692007 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eeb700-74ab-4af0-a27f-996b368272f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:33.692279 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eeb700-74ab-4af0-a27f-996b368272f9 None admin] PATH_INFO: `/v3/projects/e459822e48564585b7cdfc73c31b8fd5` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:33.693377 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eeb700-74ab-4af0-a27f-996b368272f9 None admin] RBAC: Authorizing `identity:get_project(project_id=e459822e48564585b7cdfc73c31b8fd5)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:33.694816 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eeb700-74ab-4af0-a27f-996b368272f9 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:33.696429 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 578/1160] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:06:33 2022] GET /identity/v3/projects/e459822e48564585b7cdfc73c31b8fd5 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:33.702497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95afb1-8759-45bb-b476-329f5dc10aa5 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:33.757539 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:33.802261 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95afb1-8759-45bb-b476-329f5dc10aa5 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:33.835583 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb972c0-f0cc-406e-9ed8-e5e2f2669d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:33.836176 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb972c0-f0cc-406e-9ed8-e5e2f2669d5d None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:33.836450 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb972c0-f0cc-406e-9ed8-e5e2f2669d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:33.836718 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb972c0-f0cc-406e-9ed8-e5e2f2669d5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:33.837440 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb972c0-f0cc-406e-9ed8-e5e2f2669d5d None admin] RBAC: Adding query filter params (role.id=edc551338adb4ae88bdafc591ad69582, scope.project.id=e459822e48564585b7cdfc73c31b8fd5, user.id=d875999786464e41be733abcac2aa6d9) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:33.837737 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb972c0-f0cc-406e-9ed8-e5e2f2669d5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:33.839174 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb972c0-f0cc-406e-9ed8-e5e2f2669d5d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:33.844774 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 583/1161] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:06:33 2022] GET /identity/v3/role_assignments?user.id=d875999786464e41be733abcac2aa6d9&scope.project.id=e459822e48564585b7cdfc73c31b8fd5&role.id=edc551338adb4ae88bdafc591ad69582 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:35.729478 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520abecf-c6f7-470e-9599-c224bd866922 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:35.730009 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520abecf-c6f7-470e-9599-c224bd866922 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:35.730009 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520abecf-c6f7-470e-9599-c224bd866922 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:35.731385 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 579/1162] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:06:35.737131 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272042bb-0902-4c18-9af0-9724b6c8903a None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:35.737556 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272042bb-0902-4c18-9af0-9724b6c8903a None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:35.737677 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272042bb-0902-4c18-9af0-9724b6c8903a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:35.755850 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-272042bb-0902-4c18-9af0-9724b6c8903a None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:35.757033 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-272042bb-0902-4c18-9af0-9724b6c8903a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:35.822483 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 584/1163] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:06:36.090370 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520abecf-c6f7-470e-9599-c224bd866922 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:36.157733 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:36.190380 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520abecf-c6f7-470e-9599-c224bd866922 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:36.223156 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1d667-b542-4765-8db1-41797b6e6480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:36.223748 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1d667-b542-4765-8db1-41797b6e6480 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:36.224023 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1d667-b542-4765-8db1-41797b6e6480 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:36.224546 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1d667-b542-4765-8db1-41797b6e6480 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:36.288371 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da1d667-b542-4765-8db1-41797b6e6480 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:36.289820 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da1d667-b542-4765-8db1-41797b6e6480 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:36.353280 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:36.386203 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 580/1164] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:06:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:06:36.392755 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272042bb-0902-4c18-9af0-9724b6c8903a None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:36.439614 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:36.489174 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272042bb-0902-4c18-9af0-9724b6c8903a None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:36.521823 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4c3a7-28b8-47c8-9390-7e811054f6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:36.522434 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4c3a7-28b8-47c8-9390-7e811054f6a6 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:36.522740 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4c3a7-28b8-47c8-9390-7e811054f6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:36.523007 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4c3a7-28b8-47c8-9390-7e811054f6a6 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:36.529432 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4c3a7-28b8-47c8-9390-7e811054f6a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:36.530891 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4c3a7-28b8-47c8-9390-7e811054f6a6 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:36.542930 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-68b4c3a7-28b8-47c8-9390-7e811054f6a6 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 31 19:06:36.542930 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:06:36.542930 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 31 19:06:36.542930 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 31 19:06:36.542930 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:06:36.542930 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:06:36.542930 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:06:36.542930 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:06:36.542930 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 31 19:06:36.542930 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:06:36.542930 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:06:36.542930 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:06:36.542930 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:06:36.542930 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:06:36.542930 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:06:36.542930 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:06:36.542930 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:06:36.544119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:06:36.544119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:06:36.544119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:06:36.544119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:06:36.544119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:06:36.544119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:06:36.544119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:06:36.544119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:06:36.544119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:06:36.544119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:06:36.544119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:06:36.544119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:06:36.544119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:06:36.544119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:06:36.544119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:06:36.544119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:06:36.545274 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:06:36.545274 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:06:36.545274 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:06:36.545274 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:06:36.545274 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:06:36.545274 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:06:36.545274 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:06:36.545274 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:06:36.545274 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:06:36.545274 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:06:36.545274 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 31 19:06:36.545274 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:06:36.545274 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 31 19:06:36.545274 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:06:36.546604 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 585/1165] 10.222.0.79 () {56 vars in 1117 bytes} [Wed Aug 31 19:06:36 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:06:36.549876 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1d667-b542-4765-8db1-41797b6e6480 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:36.646977 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1d667-b542-4765-8db1-41797b6e6480 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:36.679536 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6715978-1991-4d75-aea0-2abd625993d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:36.680130 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6715978-1991-4d75-aea0-2abd625993d0 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:36.680409 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6715978-1991-4d75-aea0-2abd625993d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:36.680681 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6715978-1991-4d75-aea0-2abd625993d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:36.681346 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6715978-1991-4d75-aea0-2abd625993d0 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:36.681647 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6715978-1991-4d75-aea0-2abd625993d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:36.683046 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6715978-1991-4d75-aea0-2abd625993d0 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:36.690653 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 581/1166] 10.222.0.79 () {56 vars in 1115 bytes} [Wed Aug 31 19:06:36 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:38.583974 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca46f1-3468-4643-866e-a49814d5acfe None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:38.584488 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca46f1-3468-4643-866e-a49814d5acfe None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:38.584488 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca46f1-3468-4643-866e-a49814d5acfe None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:38.585824 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 586/1167] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:06:38.591200 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8dc92-600a-44bb-b990-d4f2f36515d5 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:38.591617 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8dc92-600a-44bb-b990-d4f2f36515d5 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:38.591759 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8dc92-600a-44bb-b990-d4f2f36515d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:38.609976 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-90b8dc92-600a-44bb-b990-d4f2f36515d5 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:38.611451 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-90b8dc92-600a-44bb-b990-d4f2f36515d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:38.637466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:38.677917 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 582/1168] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:06:38.952934 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca46f1-3468-4643-866e-a49814d5acfe None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:39.051240 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca46f1-3468-4643-866e-a49814d5acfe None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:39.060322 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:39.085312 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db83b9c3-c964-45cb-af29-2ff2c5dce0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:39.085910 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83b9c3-c964-45cb-af29-2ff2c5dce0db None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:39.086188 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83b9c3-c964-45cb-af29-2ff2c5dce0db None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:39.086479 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83b9c3-c964-45cb-af29-2ff2c5dce0db None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:39.087154 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db83b9c3-c964-45cb-af29-2ff2c5dce0db None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:39.088494 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db83b9c3-c964-45cb-af29-2ff2c5dce0db None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:39.104402 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 587/1169] 10.222.0.79 () {60 vars in 1138 bytes} [Wed Aug 31 19:06:38 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:06:41.027310 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b86cb5-585d-456a-bd6f-98a77579ee9c None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:41.027959 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b86cb5-585d-456a-bd6f-98a77579ee9c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:41.027959 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b86cb5-585d-456a-bd6f-98a77579ee9c None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:41.029366 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 583/1170] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:06:41.034781 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97884b9-52f9-4487-ba1a-491f18319516 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:41.035199 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97884b9-52f9-4487-ba1a-491f18319516 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:41.035320 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97884b9-52f9-4487-ba1a-491f18319516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:41.053015 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-b97884b9-52f9-4487-ba1a-491f18319516 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:41.054175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-b97884b9-52f9-4487-ba1a-491f18319516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:41.119386 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 588/1171] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:06:41.396870 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b86cb5-585d-456a-bd6f-98a77579ee9c None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:41.505752 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b86cb5-585d-456a-bd6f-98a77579ee9c None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:41.540991 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786db156-3f93-401d-ad89-8e56ab0ed777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:41.541631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786db156-3f93-401d-ad89-8e56ab0ed777 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:41.541910 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786db156-3f93-401d-ad89-8e56ab0ed777 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:41.542183 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786db156-3f93-401d-ad89-8e56ab0ed777 None admin] PATH_INFO: `/v3/domains/7c13b95a174d48a6814bae47b8c0961d` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:41.555449 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786db156-3f93-401d-ad89-8e56ab0ed777 None admin] RBAC: Authorizing `identity:get_domain(domain_id=7c13b95a174d48a6814bae47b8c0961d)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:41.556908 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786db156-3f93-401d-ad89-8e56ab0ed777 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:41.558606 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 584/1172] 10.222.0.79 () {56 vars in 1183 bytes} [Wed Aug 31 19:06:41 2022] GET /identity/v3/domains/7c13b95a174d48a6814bae47b8c0961d => generated 267 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:41.565187 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97884b9-52f9-4487-ba1a-491f18319516 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:41.662205 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:41.666124 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97884b9-52f9-4487-ba1a-491f18319516 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:41.700614 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de213b-de2a-4a32-8105-f7c9e1294b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:41.701244 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de213b-de2a-4a32-8105-f7c9e1294b3c None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:41.701521 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de213b-de2a-4a32-8105-f7c9e1294b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:41.701790 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de213b-de2a-4a32-8105-f7c9e1294b3c None admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:41.702443 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de213b-de2a-4a32-8105-f7c9e1294b3c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:41.703989 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de213b-de2a-4a32-8105-f7c9e1294b3c None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:41.730473 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 589/1173] 10.222.0.79 () {60 vars in 1141 bytes} [Wed Aug 31 19:06:41 2022] POST /identity/v3/projects => generated 361 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:06:43.717747 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d64d8-0f67-42a7-97b0-c9a73178f1a3 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:43.718292 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d64d8-0f67-42a7-97b0-c9a73178f1a3 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:43.718292 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d64d8-0f67-42a7-97b0-c9a73178f1a3 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:43.719656 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 585/1174] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:06:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:06:43.725090 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89077e37-a53c-4064-8bd7-fa36b6b12069 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:43.725517 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89077e37-a53c-4064-8bd7-fa36b6b12069 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:43.725617 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89077e37-a53c-4064-8bd7-fa36b6b12069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:43.744228 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-89077e37-a53c-4064-8bd7-fa36b6b12069 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:43.745401 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-89077e37-a53c-4064-8bd7-fa36b6b12069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:43.811222 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 590/1175] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:06:44.079649 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d64d8-0f67-42a7-97b0-c9a73178f1a3 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:44.104896 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:44.187734 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d64d8-0f67-42a7-97b0-c9a73178f1a3 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:44.226604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e64c319-991f-4e16-922f-60a3693beaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:44.227240 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64c319-991f-4e16-922f-60a3693beaea None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:44.227526 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64c319-991f-4e16-922f-60a3693beaea None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:44.227830 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64c319-991f-4e16-922f-60a3693beaea None admin] PATH_INFO: `/v3/domains/7c13b95a174d48a6814bae47b8c0961d` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:44.229031 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e64c319-991f-4e16-922f-60a3693beaea None admin] RBAC: Authorizing `identity:get_domain(domain_id=7c13b95a174d48a6814bae47b8c0961d)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:44.230486 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e64c319-991f-4e16-922f-60a3693beaea None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:44.232085 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 586/1176] 10.222.0.79 () {56 vars in 1183 bytes} [Wed Aug 31 19:06:44 2022] GET /identity/v3/domains/7c13b95a174d48a6814bae47b8c0961d => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:44.238649 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89077e37-a53c-4064-8bd7-fa36b6b12069 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:44.315253 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:44.336243 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89077e37-a53c-4064-8bd7-fa36b6b12069 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:44.369527 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385daf1-e08d-480c-959d-fdf97c39b58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:44.370126 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385daf1-e08d-480c-959d-fdf97c39b58b None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:44.370402 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385daf1-e08d-480c-959d-fdf97c39b58b None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:44.370700 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385daf1-e08d-480c-959d-fdf97c39b58b None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:44.371359 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a385daf1-e08d-480c-959d-fdf97c39b58b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:44.372834 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a385daf1-e08d-480c-959d-fdf97c39b58b None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:44.397397 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 591/1177] 10.222.0.79 () {60 vars in 1132 bytes} [Wed Aug 31 19:06:44 2022] POST /identity/v3/users => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:06:46.329803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e7004-6454-47d2-b7a8-7ab939484cdd None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:46.330344 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e7004-6454-47d2-b7a8-7ab939484cdd None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:46.330344 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e7004-6454-47d2-b7a8-7ab939484cdd None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:46.331710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 587/1178] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:06:46.337060 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e695da-cd5d-43ee-84f1-11372843a05b None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:46.337531 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e695da-cd5d-43ee-84f1-11372843a05b None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:46.337689 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e695da-cd5d-43ee-84f1-11372843a05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:46.355804 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-70e695da-cd5d-43ee-84f1-11372843a05b None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:46.356983 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-70e695da-cd5d-43ee-84f1-11372843a05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:46.424841 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 592/1179] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:06:46.728673 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e7004-6454-47d2-b7a8-7ab939484cdd None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:46.819586 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:46.830219 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e7004-6454-47d2-b7a8-7ab939484cdd None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:46.865150 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a1ef3-50fd-4ea6-8575-ccf40619d0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:46.865769 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a1ef3-50fd-4ea6-8575-ccf40619d0a9 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:46.866049 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a1ef3-50fd-4ea6-8575-ccf40619d0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:46.866316 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a1ef3-50fd-4ea6-8575-ccf40619d0a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:46.876272 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a1ef3-50fd-4ea6-8575-ccf40619d0a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:06:46.880982 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-f06a1ef3-50fd-4ea6-8575-ccf40619d0a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:06:46.880982 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:06:46.880982 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:06:46.880982 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:06:46.880982 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:06:46.880982 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:06:46.880982 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:06:46.880982 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:06:46.880982 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:06:46.880982 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:06:46.880982 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:06:46.880982 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:06:46.880982 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:06:46.880982 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:06:46.880982 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:06:46.880982 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:06:46.882124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:06:46.882124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:06:46.882124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:06:46.882124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:06:46.882124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:06:46.882124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:06:46.882124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:06:46.882124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:06:46.882124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:06:46.882124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:06:46.882124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:06:46.882124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:06:46.882124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:06:46.882124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:06:46.882124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:06:46.882124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:06:46.883248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:06:46.883248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:06:46.883248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:06:46.883248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:06:46.883248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:06:46.883248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:06:46.883248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:06:46.883248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:06:46.883248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:06:46.883248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:06:46.883248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:06:46.883248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:06:46.883248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 588/1180] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 19:06:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:06:46.888873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e695da-cd5d-43ee-84f1-11372843a05b None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:46.951799 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:46.986970 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e695da-cd5d-43ee-84f1-11372843a05b None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:47.019455 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce6f17-07cf-451d-b74a-4708d3a19d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:47.020055 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce6f17-07cf-451d-b74a-4708d3a19d0c None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:47.020333 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce6f17-07cf-451d-b74a-4708d3a19d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:47.020604 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce6f17-07cf-451d-b74a-4708d3a19d0c None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:47.021265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce6f17-07cf-451d-b74a-4708d3a19d0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:47.021564 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce6f17-07cf-451d-b74a-4708d3a19d0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:47.022985 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce6f17-07cf-451d-b74a-4708d3a19d0c None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:47.031326 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 593/1181] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:06:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:47.037130 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a1ef3-50fd-4ea6-8575-ccf40619d0a9 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:47.138452 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a1ef3-50fd-4ea6-8575-ccf40619d0a9 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:47.172070 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b6042-6135-4f82-857c-8f185226d8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:47.172894 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b6042-6135-4f82-857c-8f185226d8b3 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:47.173024 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b6042-6135-4f82-857c-8f185226d8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:47.173222 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b6042-6135-4f82-857c-8f185226d8b3 None admin] PATH_INFO: `/v3/users/1b67c7b5f79841a4b1002ec15f34c004` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:47.185846 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b6042-6135-4f82-857c-8f185226d8b3 None admin] RBAC: Authorizing `identity:get_user(user_id=1b67c7b5f79841a4b1002ec15f34c004)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:47.187311 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b6042-6135-4f82-857c-8f185226d8b3 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:47.188927 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 589/1182] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:06:47 2022] GET /identity/v3/users/1b67c7b5f79841a4b1002ec15f34c004 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:47.195020 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce6f17-07cf-451d-b74a-4708d3a19d0c None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:47.294846 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce6f17-07cf-451d-b74a-4708d3a19d0c None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:47.328668 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:47.336989 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600e21c-bc89-438f-aa15-8de252877c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:47.337590 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600e21c-bc89-438f-aa15-8de252877c42 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:47.338135 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600e21c-bc89-438f-aa15-8de252877c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:47.338135 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600e21c-bc89-438f-aa15-8de252877c42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:47.404726 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2600e21c-bc89-438f-aa15-8de252877c42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:47.406156 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2600e21c-bc89-438f-aa15-8de252877c42 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:47.499588 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 594/1183] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:06:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:06:47.505622 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b6042-6135-4f82-857c-8f185226d8b3 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:47.516644 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:47.606860 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b6042-6135-4f82-857c-8f185226d8b3 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:47.640745 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ecfeb-bf0a-4b54-b2b8-63d42e0486cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:47.641369 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ecfeb-bf0a-4b54-b2b8-63d42e0486cb None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:47.641646 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ecfeb-bf0a-4b54-b2b8-63d42e0486cb None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:47.641918 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ecfeb-bf0a-4b54-b2b8-63d42e0486cb None admin] PATH_INFO: `/v3/projects/5bf97e7ccd6e400ab1d7bd270aa0a20e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:47.643043 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ecfeb-bf0a-4b54-b2b8-63d42e0486cb None admin] RBAC: Authorizing `identity:get_project(project_id=5bf97e7ccd6e400ab1d7bd270aa0a20e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:47.644471 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ecfeb-bf0a-4b54-b2b8-63d42e0486cb None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:47.646105 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 590/1184] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:06:47 2022] GET /identity/v3/projects/5bf97e7ccd6e400ab1d7bd270aa0a20e => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:47.652281 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600e21c-bc89-438f-aa15-8de252877c42 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:47.678817 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:47.755563 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600e21c-bc89-438f-aa15-8de252877c42 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:47.788958 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31d56d-2848-45c7-bf0b-a9403a9cc912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:47.789541 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31d56d-2848-45c7-bf0b-a9403a9cc912 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:47.789816 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31d56d-2848-45c7-bf0b-a9403a9cc912 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:47.790080 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31d56d-2848-45c7-bf0b-a9403a9cc912 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:47.790824 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31d56d-2848-45c7-bf0b-a9403a9cc912 None admin] RBAC: Adding query filter params (role.id=edc551338adb4ae88bdafc591ad69582, scope.project.id=5bf97e7ccd6e400ab1d7bd270aa0a20e, user.id=1b67c7b5f79841a4b1002ec15f34c004) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:47.791125 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31d56d-2848-45c7-bf0b-a9403a9cc912 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:47.792519 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31d56d-2848-45c7-bf0b-a9403a9cc912 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:47.798190 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 595/1185] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:06:47 2022] GET /identity/v3/role_assignments?user.id=1b67c7b5f79841a4b1002ec15f34c004&scope.project.id=5bf97e7ccd6e400ab1d7bd270aa0a20e&role.id=edc551338adb4ae88bdafc591ad69582 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:49.680193 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da4733-c76e-4508-8f0e-28ffa4adc47d None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:49.680757 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da4733-c76e-4508-8f0e-28ffa4adc47d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:49.680757 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da4733-c76e-4508-8f0e-28ffa4adc47d None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:49.682048 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 591/1186] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:06:49.687338 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d9a10-46b5-4a64-bafb-f08ec4940dc4 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:49.687733 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d9a10-46b5-4a64-bafb-f08ec4940dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:49.687879 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d9a10-46b5-4a64-bafb-f08ec4940dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:49.707905 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-068d9a10-46b5-4a64-bafb-f08ec4940dc4 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:49.709304 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-068d9a10-46b5-4a64-bafb-f08ec4940dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:49.777403 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 596/1187] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:06:50.047444 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da4733-c76e-4508-8f0e-28ffa4adc47d None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:50.139357 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:50.162093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da4733-c76e-4508-8f0e-28ffa4adc47d None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:50.196666 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34b008-ba5d-4e1f-8168-4146b66ce1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:50.197287 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34b008-ba5d-4e1f-8168-4146b66ce1e0 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:50.197564 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34b008-ba5d-4e1f-8168-4146b66ce1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:50.197833 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34b008-ba5d-4e1f-8168-4146b66ce1e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:50.207904 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b34b008-ba5d-4e1f-8168-4146b66ce1e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:06:50.212628 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-2b34b008-ba5d-4e1f-8168-4146b66ce1e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:06:50.212628 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:06:50.212628 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:06:50.212628 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:06:50.212628 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:06:50.212628 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:06:50.212628 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:06:50.212628 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:06:50.212628 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:06:50.212628 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:06:50.212628 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:06:50.212628 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:06:50.212628 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:06:50.212628 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:06:50.212628 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:06:50.212628 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:06:50.213886 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:06:50.213886 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:06:50.213886 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:06:50.213886 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:06:50.213886 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:06:50.213886 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:06:50.213886 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:06:50.213886 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:06:50.213886 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:06:50.213886 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:06:50.213886 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:06:50.213886 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:06:50.213886 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:06:50.213886 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:06:50.213886 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:06:50.213886 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:06:50.215028 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:06:50.215028 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:06:50.215028 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:06:50.215028 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:06:50.215028 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:06:50.215028 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:06:50.215028 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:06:50.215028 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:06:50.215028 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:06:50.215028 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:06:50.215028 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:06:50.215028 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:06:50.215028 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 592/1188] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 19:06:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:06:50.219984 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d9a10-46b5-4a64-bafb-f08ec4940dc4 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:50.243773 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:50.329682 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d9a10-46b5-4a64-bafb-f08ec4940dc4 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:50.366487 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328b93d-f5ff-46cf-8262-dfdefc7a0cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:50.366487 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328b93d-f5ff-46cf-8262-dfdefc7a0cd4 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:50.366487 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328b93d-f5ff-46cf-8262-dfdefc7a0cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:50.366487 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328b93d-f5ff-46cf-8262-dfdefc7a0cd4 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:50.366950 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b328b93d-f5ff-46cf-8262-dfdefc7a0cd4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:50.366950 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b328b93d-f5ff-46cf-8262-dfdefc7a0cd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:50.367119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b328b93d-f5ff-46cf-8262-dfdefc7a0cd4 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:50.379071 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 597/1189] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:06:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:50.385168 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34b008-ba5d-4e1f-8168-4146b66ce1e0 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:50.488302 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34b008-ba5d-4e1f-8168-4146b66ce1e0 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:50.522239 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899e5b8-bc91-48ef-b81b-a5c7c02af3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:50.522883 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899e5b8-bc91-48ef-b81b-a5c7c02af3fb None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:50.523164 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899e5b8-bc91-48ef-b81b-a5c7c02af3fb None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:50.523437 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899e5b8-bc91-48ef-b81b-a5c7c02af3fb None admin] PATH_INFO: `/v3/users/1b67c7b5f79841a4b1002ec15f34c004` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:50.524552 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b899e5b8-bc91-48ef-b81b-a5c7c02af3fb None admin] RBAC: Authorizing `identity:get_user(user_id=1b67c7b5f79841a4b1002ec15f34c004)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:50.525984 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b899e5b8-bc91-48ef-b81b-a5c7c02af3fb None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:50.527619 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 593/1190] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:06:50 2022] GET /identity/v3/users/1b67c7b5f79841a4b1002ec15f34c004 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:06:50.534390 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328b93d-f5ff-46cf-8262-dfdefc7a0cd4 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:50.617748 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:50.633436 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328b93d-f5ff-46cf-8262-dfdefc7a0cd4 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:50.670442 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753f860-1ecb-4592-8892-86ec5c04b02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:50.671088 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753f860-1ecb-4592-8892-86ec5c04b02e None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:50.671974 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753f860-1ecb-4592-8892-86ec5c04b02e None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:50.672239 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753f860-1ecb-4592-8892-86ec5c04b02e None admin] PATH_INFO: `/v3/projects/5bf97e7ccd6e400ab1d7bd270aa0a20e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:50.673334 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753f860-1ecb-4592-8892-86ec5c04b02e None admin] RBAC: Authorizing `identity:get_project(project_id=5bf97e7ccd6e400ab1d7bd270aa0a20e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:50.674773 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753f860-1ecb-4592-8892-86ec5c04b02e None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:50.676390 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 598/1191] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:06:50 2022] GET /identity/v3/projects/5bf97e7ccd6e400ab1d7bd270aa0a20e => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:50.682883 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899e5b8-bc91-48ef-b81b-a5c7c02af3fb None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:50.686654 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:50.786930 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899e5b8-bc91-48ef-b81b-a5c7c02af3fb None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:50.821248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05bdef2-a702-424f-a030-1c5fbb5c43cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:50.821905 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bdef2-a702-424f-a030-1c5fbb5c43cf None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:50.822183 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bdef2-a702-424f-a030-1c5fbb5c43cf None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:50.822476 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bdef2-a702-424f-a030-1c5fbb5c43cf None admin] PATH_INFO: `/v3/projects/5bf97e7ccd6e400ab1d7bd270aa0a20e/users/1b67c7b5f79841a4b1002ec15f34c004/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:50.824428 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05bdef2-a702-424f-a030-1c5fbb5c43cf None admin] RBAC: Authorizing `identity:create_grant(project_id=5bf97e7ccd6e400ab1d7bd270aa0a20e, user_id=1b67c7b5f79841a4b1002ec15f34c004, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:50.825858 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05bdef2-a702-424f-a030-1c5fbb5c43cf None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:50.839108 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 594/1192] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 19:06:50 2022] PUT /identity/v3/projects/5bf97e7ccd6e400ab1d7bd270aa0a20e/users/1b67c7b5f79841a4b1002ec15f34c004/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:06:52.736290 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ecddb-3249-4db2-9ca7-4e07bdb8a945 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:52.736820 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ecddb-3249-4db2-9ca7-4e07bdb8a945 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:52.736820 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ecddb-3249-4db2-9ca7-4e07bdb8a945 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:52.738168 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 599/1193] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:06:52.743617 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4f95f-b5e9-4481-acec-f5c318f75253 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:52.744037 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4f95f-b5e9-4481-acec-f5c318f75253 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:52.744162 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4f95f-b5e9-4481-acec-f5c318f75253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:52.762394 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-81b4f95f-b5e9-4481-acec-f5c318f75253 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:06:52.763602 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-81b4f95f-b5e9-4481-acec-f5c318f75253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:06:52.822168 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:52.833169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 595/1194] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:06:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:06:53.096981 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ecddb-3249-4db2-9ca7-4e07bdb8a945 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:53.197056 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ecddb-3249-4db2-9ca7-4e07bdb8a945 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:53.229843 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab5ac1-5b11-4b67-935c-02f700d6a965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:53.230491 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab5ac1-5b11-4b67-935c-02f700d6a965 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:53.230764 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab5ac1-5b11-4b67-935c-02f700d6a965 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:53.231032 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab5ac1-5b11-4b67-935c-02f700d6a965 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:53.243192 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab5ac1-5b11-4b67-935c-02f700d6a965 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:06:53.247936 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-03ab5ac1-5b11-4b67-935c-02f700d6a965 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:06:53.247936 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:06:53.247936 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:06:53.247936 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:06:53.247936 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:06:53.247936 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:06:53.247936 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:06:53.247936 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:06:53.247936 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:06:53.247936 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:06:53.247936 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:06:53.247936 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:06:53.247936 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:06:53.247936 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:06:53.247936 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:06:53.247936 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:06:53.248990 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:06:53.248990 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:06:53.248990 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:06:53.248990 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:06:53.248990 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:06:53.248990 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:06:53.248990 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:06:53.248990 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:06:53.248990 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:06:53.248990 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:06:53.248990 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:06:53.248990 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:06:53.248990 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:06:53.248990 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:06:53.248990 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:06:53.248990 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:06:53.250855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:06:53.250855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:06:53.250855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:06:53.250855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:06:53.250855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:06:53.250855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:06:53.250855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:06:53.250855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:06:53.250855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:06:53.250855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:06:53.250855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:06:53.250855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:06:53.250855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 600/1195] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 19:06:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:06:53.255784 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4f95f-b5e9-4481-acec-f5c318f75253 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:53.366050 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4f95f-b5e9-4481-acec-f5c318f75253 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:53.400642 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385a2e2-36f3-4995-8177-0a1aae02d727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:53.401287 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385a2e2-36f3-4995-8177-0a1aae02d727 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:53.401569 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385a2e2-36f3-4995-8177-0a1aae02d727 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:53.401838 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385a2e2-36f3-4995-8177-0a1aae02d727 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:53.402543 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385a2e2-36f3-4995-8177-0a1aae02d727 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:53.402849 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385a2e2-36f3-4995-8177-0a1aae02d727 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:53.404219 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385a2e2-36f3-4995-8177-0a1aae02d727 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:53.412709 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 596/1196] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:06:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:53.418734 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab5ac1-5b11-4b67-935c-02f700d6a965 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:53.434991 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:53.519500 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab5ac1-5b11-4b67-935c-02f700d6a965 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:53.556428 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c845617-93a6-4902-9298-a33752a46d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:53.557069 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c845617-93a6-4902-9298-a33752a46d21 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:53.557348 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c845617-93a6-4902-9298-a33752a46d21 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:53.557620 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c845617-93a6-4902-9298-a33752a46d21 None admin] PATH_INFO: `/v3/users/1b67c7b5f79841a4b1002ec15f34c004` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:53.558765 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c845617-93a6-4902-9298-a33752a46d21 None admin] RBAC: Authorizing `identity:get_user(user_id=1b67c7b5f79841a4b1002ec15f34c004)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:53.560185 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c845617-93a6-4902-9298-a33752a46d21 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:53.561851 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 601/1197] 10.222.0.79 () {56 vars in 1177 bytes} [Wed Aug 31 19:06:53 2022] GET /identity/v3/users/1b67c7b5f79841a4b1002ec15f34c004 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:53.567909 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385a2e2-36f3-4995-8177-0a1aae02d727 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:53.624068 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:53.669556 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385a2e2-36f3-4995-8177-0a1aae02d727 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:53.704003 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b00177-befa-4608-8584-038abf3a5414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:53.704612 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b00177-befa-4608-8584-038abf3a5414 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:53.704889 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b00177-befa-4608-8584-038abf3a5414 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:53.705162 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b00177-befa-4608-8584-038abf3a5414 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:53.777561 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b00177-befa-4608-8584-038abf3a5414 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:53.779055 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b00177-befa-4608-8584-038abf3a5414 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:53.840066 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:53.884896 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 597/1198] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:06:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:06:53.891660 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c845617-93a6-4902-9298-a33752a46d21 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:53.982633 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:06:54.003482 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c845617-93a6-4902-9298-a33752a46d21 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:54.043671 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea85f93c-04ab-4897-948d-ba2202f182ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:54.044298 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85f93c-04ab-4897-948d-ba2202f182ca None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:54.044582 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85f93c-04ab-4897-948d-ba2202f182ca None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:54.044853 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85f93c-04ab-4897-948d-ba2202f182ca None admin] PATH_INFO: `/v3/projects/5bf97e7ccd6e400ab1d7bd270aa0a20e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:54.046052 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea85f93c-04ab-4897-948d-ba2202f182ca None admin] RBAC: Authorizing `identity:get_project(project_id=5bf97e7ccd6e400ab1d7bd270aa0a20e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:54.047548 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea85f93c-04ab-4897-948d-ba2202f182ca None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:54.049213 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 602/1199] 10.222.0.79 () {56 vars in 1186 bytes} [Wed Aug 31 19:06:53 2022] GET /identity/v3/projects/5bf97e7ccd6e400ab1d7bd270aa0a20e => generated 361 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:06:54.055680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b00177-befa-4608-8584-038abf3a5414 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:06:54.167310 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b00177-befa-4608-8584-038abf3a5414 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:06:54.203247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a12e0-b86e-4325-9bf0-af7e80859895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:06:54.203850 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a12e0-b86e-4325-9bf0-af7e80859895 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:06:54.204130 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a12e0-b86e-4325-9bf0-af7e80859895 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:06:54.204405 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a12e0-b86e-4325-9bf0-af7e80859895 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:06:54.205135 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a12e0-b86e-4325-9bf0-af7e80859895 None admin] RBAC: Adding query filter params (role.id=edc551338adb4ae88bdafc591ad69582, scope.project.id=5bf97e7ccd6e400ab1d7bd270aa0a20e, user.id=1b67c7b5f79841a4b1002ec15f34c004) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:06:54.205445 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a12e0-b86e-4325-9bf0-af7e80859895 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:06:54.206908 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a12e0-b86e-4325-9bf0-af7e80859895 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:06:54.212640 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 598/1200] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:06:54 2022] GET /identity/v3/role_assignments?user.id=1b67c7b5f79841a4b1002ec15f34c004&scope.project.id=5bf97e7ccd6e400ab1d7bd270aa0a20e&role.id=edc551338adb4ae88bdafc591ad69582 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:04.038744 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=26 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:04.209957 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=90 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:50.289274 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03b50c-c369-46de-9a23-67d317b407d2 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:50.290035 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03b50c-c369-46de-9a23-67d317b407d2 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:50.290035 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03b50c-c369-46de-9a23-67d317b407d2 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:50.291587 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 603/1201] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:50.297401 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a384e3-e058-434f-9733-26d06558ce37 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:50.297887 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a384e3-e058-434f-9733-26d06558ce37 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:50.297997 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a384e3-e058-434f-9733-26d06558ce37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:50.319530 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-03a384e3-e058-434f-9733-26d06558ce37 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:50.320709 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-03a384e3-e058-434f-9733-26d06558ce37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:50.417730 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 599/1202] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:07:50.689302 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a03b50c-c369-46de-9a23-67d317b407d2 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:50.828630 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a03b50c-c369-46de-9a23-67d317b407d2 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:50.871800 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f96550-76a5-4bc3-af76-faee9e0a5e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:50.872438 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f96550-76a5-4bc3-af76-faee9e0a5e16 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:50.872748 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f96550-76a5-4bc3-af76-faee9e0a5e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:50.872978 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f96550-76a5-4bc3-af76-faee9e0a5e16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:50.885343 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f96550-76a5-4bc3-af76-faee9e0a5e16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:50.890155 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f96550-76a5-4bc3-af76-faee9e0a5e16 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:50.905822 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-02f96550-76a5-4bc3-af76-faee9e0a5e16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:50.905822 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:50.905822 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:50.905822 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:50.905822 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:50.905822 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:50.905822 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:50.905822 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:50.905822 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:50.905822 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:50.905822 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:50.905822 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:50.905822 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:07:50.905822 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:07:50.905822 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:07:50.905822 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:07:50.907324 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:50.907324 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:50.907324 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:50.907324 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:50.907324 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:50.907324 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:50.907324 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:50.907324 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:50.907324 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:50.907324 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:50.907324 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:50.907324 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:50.907324 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:50.907324 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:50.907324 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:50.907324 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:50.907324 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:07:50.908825 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:07:50.908825 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:50.908825 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:07:50.908825 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 604/1203] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:50.913018 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a384e3-e058-434f-9733-26d06558ce37 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:51.043006 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a384e3-e058-434f-9733-26d06558ce37 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:51.090030 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:51.098541 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3005b7-ff42-4f7c-9acb-ef9ec51a2aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:51.099730 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3005b7-ff42-4f7c-9acb-ef9ec51a2aae None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:51.100077 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3005b7-ff42-4f7c-9acb-ef9ec51a2aae None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:51.100416 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3005b7-ff42-4f7c-9acb-ef9ec51a2aae None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:51.101141 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3005b7-ff42-4f7c-9acb-ef9ec51a2aae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:51.101512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3005b7-ff42-4f7c-9acb-ef9ec51a2aae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:51.103177 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3005b7-ff42-4f7c-9acb-ef9ec51a2aae None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:51.119159 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 600/1204] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:51.127178 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f96550-76a5-4bc3-af76-faee9e0a5e16 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:51.199430 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:51.264180 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f96550-76a5-4bc3-af76-faee9e0a5e16 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:51.311607 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197208c-baf0-4da1-b385-1a604452f645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:51.312904 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197208c-baf0-4da1-b385-1a604452f645 None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:51.313377 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197208c-baf0-4da1-b385-1a604452f645 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:51.313828 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197208c-baf0-4da1-b385-1a604452f645 None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:51.314693 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a197208c-baf0-4da1-b385-1a604452f645 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:51.316327 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a197208c-baf0-4da1-b385-1a604452f645 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:51.348859 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 605/1205] 10.222.0.79 () {60 vars in 1132 bytes} [Wed Aug 31 19:07:51 2022] POST /identity/v3/users => generated 251 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:07:53.501414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69b896-78a5-4b91-8f97-f8fcde1af22e None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:53.501414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69b896-78a5-4b91-8f97-f8fcde1af22e None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:53.501414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69b896-78a5-4b91-8f97-f8fcde1af22e None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:53.503005 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 601/1206] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:07:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:53.509417 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69149f1-b097-48bc-b51e-be4beea5a7c2 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:53.509921 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69149f1-b097-48bc-b51e-be4beea5a7c2 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:53.510033 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69149f1-b097-48bc-b51e-be4beea5a7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:53.535428 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-f69149f1-b097-48bc-b51e-be4beea5a7c2 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:53.536817 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f69149f1-b097-48bc-b51e-be4beea5a7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:53.611592 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 606/1207] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:07:53.897357 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d69b896-78a5-4b91-8f97-f8fcde1af22e None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:54.017596 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d69b896-78a5-4b91-8f97-f8fcde1af22e None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:54.055890 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242be39-c463-43e3-9bf7-d6bb2c9f452a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:54.058844 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242be39-c463-43e3-9bf7-d6bb2c9f452a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:54.059162 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242be39-c463-43e3-9bf7-d6bb2c9f452a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:54.059470 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242be39-c463-43e3-9bf7-d6bb2c9f452a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:54.071189 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242be39-c463-43e3-9bf7-d6bb2c9f452a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:54.076506 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-b242be39-c463-43e3-9bf7-d6bb2c9f452a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:07:54.076506 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:54.076506 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:54.076506 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:54.076506 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:54.076506 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:54.076506 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:54.076506 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:54.076506 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:54.076506 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:54.076506 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:54.076506 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:54.076506 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:54.076506 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:54.076506 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:54.076506 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:54.077980 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:54.077980 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:54.077980 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:54.077980 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:54.077980 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:54.077980 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:54.077980 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:54.077980 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:54.077980 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:54.077980 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:54.077980 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:54.077980 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:54.077980 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:54.077980 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:54.077980 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:54.077980 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:54.078883 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:54.078883 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:54.078883 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:54.078883 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:54.078883 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:54.078883 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:54.078883 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:54.078883 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:54.078883 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:54.078883 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:54.078883 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:07:54.078883 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:07:54.078883 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 602/1208] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 19:07:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:54.083933 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69149f1-b097-48bc-b51e-be4beea5a7c2 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:54.126984 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:54.192693 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69149f1-b097-48bc-b51e-be4beea5a7c2 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:54.233817 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30040f-24e3-402b-afd4-e77ed26d63dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:54.234833 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30040f-24e3-402b-afd4-e77ed26d63dc None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:54.235292 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30040f-24e3-402b-afd4-e77ed26d63dc None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:54.235587 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30040f-24e3-402b-afd4-e77ed26d63dc None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:54.236340 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30040f-24e3-402b-afd4-e77ed26d63dc None admin] RBAC: Adding query filter params (name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:54.236649 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30040f-24e3-402b-afd4-e77ed26d63dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:54.238145 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30040f-24e3-402b-afd4-e77ed26d63dc None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:54.252388 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 607/1209] 10.222.0.79 () {56 vars in 1103 bytes} [Wed Aug 31 19:07:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:54.254949 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242be39-c463-43e3-9bf7-d6bb2c9f452a None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:54.312725 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:54.372840 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242be39-c463-43e3-9bf7-d6bb2c9f452a None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:54.413214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c537b4-df6c-40b3-a4b9-3bb9a85d5872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:54.413972 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c537b4-df6c-40b3-a4b9-3bb9a85d5872 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:54.414282 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c537b4-df6c-40b3-a4b9-3bb9a85d5872 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:54.414396 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c537b4-df6c-40b3-a4b9-3bb9a85d5872 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:54.425816 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c537b4-df6c-40b3-a4b9-3bb9a85d5872 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:54.427457 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c537b4-df6c-40b3-a4b9-3bb9a85d5872 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:54.444927 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-d9c537b4-df6c-40b3-a4b9-3bb9a85d5872 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:54.444927 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:54.444927 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:54.444927 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:54.444927 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:54.444927 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:54.444927 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:54.444927 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:54.444927 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:54.444927 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:54.444927 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:54.444927 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:54.444927 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:07:54.444927 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:07:54.444927 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:07:54.444927 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:07:54.446436 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:54.446436 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:54.446436 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:54.446436 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:54.446436 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:54.446436 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:54.446436 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:54.446436 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:54.446436 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:54.446436 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:54.446436 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:54.446436 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:54.446436 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:54.446436 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:54.446436 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:54.446436 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:54.446436 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:07:54.447572 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:07:54.447572 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:54.447572 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:07:54.450696 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 603/1210] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:54.452807 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30040f-24e3-402b-afd4-e77ed26d63dc None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:54.562238 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:54.566034 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30040f-24e3-402b-afd4-e77ed26d63dc None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:54.610837 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445462b0-27b3-4456-8b0b-bbe9dbad8a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:54.612084 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445462b0-27b3-4456-8b0b-bbe9dbad8a1f None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:54.612191 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445462b0-27b3-4456-8b0b-bbe9dbad8a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:54.612600 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445462b0-27b3-4456-8b0b-bbe9dbad8a1f None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:54.613555 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445462b0-27b3-4456-8b0b-bbe9dbad8a1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:54.613994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445462b0-27b3-4456-8b0b-bbe9dbad8a1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:54.615534 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445462b0-27b3-4456-8b0b-bbe9dbad8a1f None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:54.629454 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 608/1211] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:07:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:54.636120 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c537b4-df6c-40b3-a4b9-3bb9a85d5872 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:54.766810 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c537b4-df6c-40b3-a4b9-3bb9a85d5872 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:54.769265 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:54.819654 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dbcc8b-c5b0-457a-9d4b-3f7c0fb9b7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:54.820296 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbcc8b-c5b0-457a-9d4b-3f7c0fb9b7a7 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:54.820572 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbcc8b-c5b0-457a-9d4b-3f7c0fb9b7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:54.820886 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbcc8b-c5b0-457a-9d4b-3f7c0fb9b7a7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:54.831549 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dbcc8b-c5b0-457a-9d4b-3f7c0fb9b7a7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:54.833345 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dbcc8b-c5b0-457a-9d4b-3f7c0fb9b7a7 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:54.848941 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-a7dbcc8b-c5b0-457a-9d4b-3f7c0fb9b7a7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 19:07:54.848941 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:54.848941 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:54.848941 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:54.848941 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:54.848941 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:54.848941 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:54.848941 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:54.848941 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:54.848941 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:54.848941 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:54.848941 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:54.848941 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:07:54.848941 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:07:54.848941 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:07:54.848941 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:07:54.850309 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:54.850309 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:54.850309 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:07:54.850309 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:07:54.850309 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:07:54.850309 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:07:54.850309 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:54.850309 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:54.850309 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:54.850309 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:54.850309 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:54.850309 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:54.850309 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:54.850309 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:54.850309 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:54.850309 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:54.850309 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:54.850309 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:54.851317 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:54.851317 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:54.851317 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:07:54.851317 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:07:54.851317 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:07:54.851317 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:07:54.851317 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:07:54.851317 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:07:54.851317 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 19:07:54.851317 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:07:54.851317 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 604/1212] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:54.860204 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445462b0-27b3-4456-8b0b-bbe9dbad8a1f None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:54.991459 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445462b0-27b3-4456-8b0b-bbe9dbad8a1f None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:55.035496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add7bbe-87a9-4388-853f-352540716707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:55.035496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add7bbe-87a9-4388-853f-352540716707 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:55.035496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add7bbe-87a9-4388-853f-352540716707 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:55.035496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add7bbe-87a9-4388-853f-352540716707 None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:55.036761 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add7bbe-87a9-4388-853f-352540716707 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:55.037139 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add7bbe-87a9-4388-853f-352540716707 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:55.038775 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add7bbe-87a9-4388-853f-352540716707 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:55.063629 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 609/1213] 10.222.0.79 () {56 vars in 1143 bytes} [Wed Aug 31 19:07:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:55.065132 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dbcc8b-c5b0-457a-9d4b-3f7c0fb9b7a7 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:55.200077 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dbcc8b-c5b0-457a-9d4b-3f7c0fb9b7a7 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:55.238192 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e0062-8458-4a2b-845f-544feee7fc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:55.238834 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e0062-8458-4a2b-845f-544feee7fc17 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:55.239109 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e0062-8458-4a2b-845f-544feee7fc17 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:55.239542 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e0062-8458-4a2b-845f-544feee7fc17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:55.283615 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:55.336777 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e0062-8458-4a2b-845f-544feee7fc17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:55.338297 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e0062-8458-4a2b-845f-544feee7fc17 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:55.458077 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 605/1214] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:07:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:07:55.464127 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add7bbe-87a9-4388-853f-352540716707 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:55.488595 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:55.583577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add7bbe-87a9-4388-853f-352540716707 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:55.621829 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50365260-7008-4d61-b003-4060c8cce494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:55.622377 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50365260-7008-4d61-b003-4060c8cce494 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:55.622684 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50365260-7008-4d61-b003-4060c8cce494 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:55.622949 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50365260-7008-4d61-b003-4060c8cce494 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:55.634074 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50365260-7008-4d61-b003-4060c8cce494 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:55.635992 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50365260-7008-4d61-b003-4060c8cce494 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:55.656224 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-50365260-7008-4d61-b003-4060c8cce494 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:55.656224 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:55.656224 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:55.656224 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:55.656224 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:55.656224 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:55.656224 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:55.656224 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:55.656224 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:55.656224 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:55.656224 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:55.656224 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:55.656224 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:07:55.656224 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:07:55.656224 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:07:55.656224 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:07:55.657249 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:55.657249 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:55.657249 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:55.657249 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:55.657249 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:55.657249 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:55.657249 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:55.657249 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:55.657249 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:55.657249 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:55.657249 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:55.657249 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:55.657249 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:55.657249 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:55.657249 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:55.657249 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:55.657249 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:07:55.663051 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:07:55.663051 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:55.663051 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:07:55.663051 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 610/1215] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 19:07:55.664371 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e0062-8458-4a2b-845f-544feee7fc17 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:55.739202 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:55.783579 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e0062-8458-4a2b-845f-544feee7fc17 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:55.820864 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c804ae0-748c-4115-bcd3-4dfc9f81edaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:55.821473 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c804ae0-748c-4115-bcd3-4dfc9f81edaa None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:55.821769 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c804ae0-748c-4115-bcd3-4dfc9f81edaa None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:55.822029 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c804ae0-748c-4115-bcd3-4dfc9f81edaa None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:55.822742 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c804ae0-748c-4115-bcd3-4dfc9f81edaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:55.823040 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c804ae0-748c-4115-bcd3-4dfc9f81edaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:55.824408 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c804ae0-748c-4115-bcd3-4dfc9f81edaa None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:55.836502 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 606/1216] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:55.842328 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50365260-7008-4d61-b003-4060c8cce494 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:55.923203 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:55.963125 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50365260-7008-4d61-b003-4060c8cce494 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:56.000623 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd033d2-7015-410e-80ea-6a7c31bd1a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:56.001504 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd033d2-7015-410e-80ea-6a7c31bd1a8e None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:56.001850 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd033d2-7015-410e-80ea-6a7c31bd1a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:56.002333 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd033d2-7015-410e-80ea-6a7c31bd1a8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:56.009940 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd033d2-7015-410e-80ea-6a7c31bd1a8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:56.011417 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd033d2-7015-410e-80ea-6a7c31bd1a8e None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:56.024660 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-ccd033d2-7015-410e-80ea-6a7c31bd1a8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:07:56.024660 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:56.024660 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:56.024660 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:56.024660 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:56.024660 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:56.024660 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:56.024660 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:56.024660 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:56.024660 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:56.024660 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:56.024660 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:56.024660 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:07:56.024660 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:07:56.024660 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:07:56.025680 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:07:56.025680 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:56.025680 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:56.025680 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:56.025680 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:56.025680 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:56.025680 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:56.025680 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:56.025680 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:56.025680 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:56.025680 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:56.025680 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:56.025680 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:56.025680 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:56.025680 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:56.025680 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:56.025680 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:56.026614 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:07:56.026614 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:07:56.026614 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:07:56.026614 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:07:56.026614 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:07:56.026614 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:07:56.026614 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:07:56.026614 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:07:56.026614 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 611/1217] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:07:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:56.038831 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c804ae0-748c-4115-bcd3-4dfc9f81edaa None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:56.154410 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c804ae0-748c-4115-bcd3-4dfc9f81edaa None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:56.181090 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:56.197233 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189bcd10-8b5b-4d02-92c7-de7483c19818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:56.197995 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189bcd10-8b5b-4d02-92c7-de7483c19818 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:56.198278 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189bcd10-8b5b-4d02-92c7-de7483c19818 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:56.198588 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189bcd10-8b5b-4d02-92c7-de7483c19818 None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:56.199457 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189bcd10-8b5b-4d02-92c7-de7483c19818 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:56.199800 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189bcd10-8b5b-4d02-92c7-de7483c19818 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:56.202342 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189bcd10-8b5b-4d02-92c7-de7483c19818 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:56.220375 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 607/1218] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 19:07:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:56.227019 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd033d2-7015-410e-80ea-6a7c31bd1a8e None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:56.352171 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd033d2-7015-410e-80ea-6a7c31bd1a8e None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:56.391078 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:56.402445 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286f03a-d7cf-4e7b-afe9-cd341de38fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:56.403631 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286f03a-d7cf-4e7b-afe9-cd341de38fb6 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:56.405892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286f03a-d7cf-4e7b-afe9-cd341de38fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:56.405892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286f03a-d7cf-4e7b-afe9-cd341de38fb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:56.405892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d286f03a-d7cf-4e7b-afe9-cd341de38fb6 None admin] RBAC: Adding query filter params (role.id=0230e2e79da94067a82374ceada29d3f, scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507, user.id=ece00ea631594381bf1c27cfc2ece6f1) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:56.405892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d286f03a-d7cf-4e7b-afe9-cd341de38fb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:56.407543 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d286f03a-d7cf-4e7b-afe9-cd341de38fb6 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:56.414806 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 612/1219] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:07:56 2022] GET /identity/v3/role_assignments?user.id=ece00ea631594381bf1c27cfc2ece6f1&scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507&role.id=0230e2e79da94067a82374ceada29d3f => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:58.394869 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3025e-4e45-412a-8b0e-78ffce7d5bae None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:58.395412 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3025e-4e45-412a-8b0e-78ffce7d5bae None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:58.395412 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3025e-4e45-412a-8b0e-78ffce7d5bae None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:58.396914 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 608/1220] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:07:58.402728 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08865c05-68fb-4a8e-b1be-cfaa46714ab4 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:58.403254 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08865c05-68fb-4a8e-b1be-cfaa46714ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:58.403380 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08865c05-68fb-4a8e-b1be-cfaa46714ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:58.424930 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-08865c05-68fb-4a8e-b1be-cfaa46714ab4 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:07:58.426240 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-08865c05-68fb-4a8e-b1be-cfaa46714ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:07:58.504456 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 613/1221] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:07:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:07:58.782682 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3025e-4e45-412a-8b0e-78ffce7d5bae None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:58.887926 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3025e-4e45-412a-8b0e-78ffce7d5bae None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:58.924103 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71075282-962d-4a63-a0b9-257d11752f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:58.924755 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71075282-962d-4a63-a0b9-257d11752f05 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:58.925029 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71075282-962d-4a63-a0b9-257d11752f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:58.925301 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71075282-962d-4a63-a0b9-257d11752f05 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:58.937043 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71075282-962d-4a63-a0b9-257d11752f05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:07:58.943512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-71075282-962d-4a63-a0b9-257d11752f05 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:07:58.943512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:58.943512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:58.943512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:58.943512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:58.943512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:58.943512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:58.943512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:58.943512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:58.943512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:58.943512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:58.943512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:58.943512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:07:58.943512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:07:58.943512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:07:58.943512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:07:58.944704 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:07:58.944704 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:07:58.944704 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:07:58.944704 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:07:58.944704 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:58.944704 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:58.944704 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:58.944704 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:58.944704 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:58.944704 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:58.944704 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:58.944704 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:58.944704 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:58.944704 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:58.944704 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:58.944704 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:58.947529 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:58.947529 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:58.947529 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:58.947529 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:58.947529 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:07:58.947529 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:07:58.947529 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:07:58.947529 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:07:58.947529 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:07:58.947529 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:07:58.947529 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:07:58.947529 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:07:58.947529 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 609/1222] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 19:07:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:58.950982 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08865c05-68fb-4a8e-b1be-cfaa46714ab4 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:59.058869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08865c05-68fb-4a8e-b1be-cfaa46714ab4 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:59.083880 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:59.097856 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b29f40-9d06-4dd8-b2dd-1e6c76531edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:59.098699 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b29f40-9d06-4dd8-b2dd-1e6c76531edf None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:59.099003 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b29f40-9d06-4dd8-b2dd-1e6c76531edf None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:59.099364 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b29f40-9d06-4dd8-b2dd-1e6c76531edf None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:59.100303 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b29f40-9d06-4dd8-b2dd-1e6c76531edf None admin] RBAC: Adding query filter params (name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:59.100645 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b29f40-9d06-4dd8-b2dd-1e6c76531edf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:59.102441 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b29f40-9d06-4dd8-b2dd-1e6c76531edf None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:59.112021 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 614/1223] 10.222.0.79 () {56 vars in 1103 bytes} [Wed Aug 31 19:07:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:07:59.117814 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71075282-962d-4a63-a0b9-257d11752f05 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:59.168395 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:59.227421 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71075282-962d-4a63-a0b9-257d11752f05 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:59.261709 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29bd6e6-2bf9-4cc2-99ad-c07fb4aaccfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:59.262335 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29bd6e6-2bf9-4cc2-99ad-c07fb4aaccfe None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:59.262641 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29bd6e6-2bf9-4cc2-99ad-c07fb4aaccfe None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:59.262970 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29bd6e6-2bf9-4cc2-99ad-c07fb4aaccfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:59.273642 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29bd6e6-2bf9-4cc2-99ad-c07fb4aaccfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:59.275123 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29bd6e6-2bf9-4cc2-99ad-c07fb4aaccfe None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:59.290419 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-d29bd6e6-2bf9-4cc2-99ad-c07fb4aaccfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:59.290419 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:59.290419 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:59.290419 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:59.290419 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:59.290419 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:59.290419 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:59.290419 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:59.290419 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:59.290419 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:59.290419 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:59.290419 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:59.290419 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:07:59.290419 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:07:59.290419 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:07:59.290419 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:07:59.292146 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:59.292146 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:59.292146 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:59.292146 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:59.292146 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:59.292146 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:59.292146 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:59.292146 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:59.292146 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:59.292146 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:59.292146 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:59.292146 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:59.292146 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:59.292146 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:59.292146 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:59.292146 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:59.292146 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:07:59.293329 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:07:59.293329 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:07:59.293329 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:07:59.296524 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 610/1224] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:59.297553 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b29f40-9d06-4dd8-b2dd-1e6c76531edf None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:59.409202 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b29f40-9d06-4dd8-b2dd-1e6c76531edf None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:59.450884 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579a069-ddd3-49b1-b041-2a2bb72adb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:59.451616 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579a069-ddd3-49b1-b041-2a2bb72adb35 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:59.452138 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579a069-ddd3-49b1-b041-2a2bb72adb35 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:59.452465 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579a069-ddd3-49b1-b041-2a2bb72adb35 None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:59.453351 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a579a069-ddd3-49b1-b041-2a2bb72adb35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:59.453657 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a579a069-ddd3-49b1-b041-2a2bb72adb35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:59.455180 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a579a069-ddd3-49b1-b041-2a2bb72adb35 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:59.473788 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 615/1225] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:59.475189 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29bd6e6-2bf9-4cc2-99ad-c07fb4aaccfe None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:59.580456 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:59.588147 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29bd6e6-2bf9-4cc2-99ad-c07fb4aaccfe None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:59.630267 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88682869-571b-4ab5-9076-ec1f876e5c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:59.631128 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88682869-571b-4ab5-9076-ec1f876e5c4f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:59.631445 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88682869-571b-4ab5-9076-ec1f876e5c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:59.631776 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88682869-571b-4ab5-9076-ec1f876e5c4f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:59.641015 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88682869-571b-4ab5-9076-ec1f876e5c4f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:59.642994 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88682869-571b-4ab5-9076-ec1f876e5c4f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:59.657777 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-88682869-571b-4ab5-9076-ec1f876e5c4f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 19:07:59.657777 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:07:59.657777 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:07:59.657777 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:07:59.657777 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:07:59.657777 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:07:59.657777 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:07:59.657777 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:07:59.657777 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:07:59.657777 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:07:59.657777 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:07:59.657777 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:07:59.657777 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:07:59.657777 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:07:59.657777 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:07:59.657777 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:07:59.659162 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:07:59.659162 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:07:59.659162 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:07:59.659162 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:07:59.659162 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:07:59.659162 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:07:59.659162 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:07:59.659162 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:07:59.659162 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:07:59.659162 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:07:59.659162 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:07:59.659162 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:07:59.659162 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:07:59.659162 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:07:59.659162 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:07:59.659162 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:07:59.659162 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:07:59.659162 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:07:59.660188 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:07:59.660188 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:07:59.660188 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:07:59.660188 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:07:59.660188 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:07:59.660188 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:07:59.660188 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:07:59.660188 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:07:59.660188 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 19:07:59.660188 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:07:59.660188 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 611/1226] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:07:59.665229 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579a069-ddd3-49b1-b041-2a2bb72adb35 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:59.727040 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:07:59.784384 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579a069-ddd3-49b1-b041-2a2bb72adb35 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:07:59.820708 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fe647-53e8-4667-b53d-13369237a1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:07:59.821330 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fe647-53e8-4667-b53d-13369237a1cf None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:07:59.821607 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fe647-53e8-4667-b53d-13369237a1cf None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:07:59.821875 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fe647-53e8-4667-b53d-13369237a1cf None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:07:59.822638 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fe647-53e8-4667-b53d-13369237a1cf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:07:59.822938 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fe647-53e8-4667-b53d-13369237a1cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:07:59.824343 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fe647-53e8-4667-b53d-13369237a1cf None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:07:59.842910 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 616/1227] 10.222.0.79 () {56 vars in 1143 bytes} [Wed Aug 31 19:07:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:07:59.849097 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88682869-571b-4ab5-9076-ec1f876e5c4f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:07:59.973966 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88682869-571b-4ab5-9076-ec1f876e5c4f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:00.014974 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5edad-6b25-49d1-8243-d0260c5952c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:00.015583 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5edad-6b25-49d1-8243-d0260c5952c0 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:00.015859 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5edad-6b25-49d1-8243-d0260c5952c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:00.016131 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5edad-6b25-49d1-8243-d0260c5952c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:00.028024 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5edad-6b25-49d1-8243-d0260c5952c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:00.029464 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5edad-6b25-49d1-8243-d0260c5952c0 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:00.043605 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-01d5edad-6b25-49d1-8243-d0260c5952c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:00.043605 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:00.043605 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:00.043605 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:00.043605 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:00.043605 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:00.043605 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:00.043605 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:00.043605 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:00.043605 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:00.043605 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:00.043605 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:00.043605 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:00.043605 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:00.043605 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:00.043605 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:00.044888 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:00.044888 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:00.044888 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:00.044888 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:00.044888 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:00.044888 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:00.044888 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:00.044888 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:00.044888 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:00.044888 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:00.044888 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:00.044888 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:00.044888 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:00.044888 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:00.044888 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:00.044888 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:00.044888 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:00.047047 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:00.047047 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:00.047047 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:08:00.051612 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 612/1228] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:07:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:00.051740 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fe647-53e8-4667-b53d-13369237a1cf None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:00.164973 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fe647-53e8-4667-b53d-13369237a1cf None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:00.167400 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:00.205571 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc5088-4834-4532-b440-786f119fbf63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:00.206179 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc5088-4834-4532-b440-786f119fbf63 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:00.206513 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc5088-4834-4532-b440-786f119fbf63 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:00.206794 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc5088-4834-4532-b440-786f119fbf63 None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:00.207610 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc5088-4834-4532-b440-786f119fbf63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:00.208087 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc5088-4834-4532-b440-786f119fbf63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:00.209729 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc5088-4834-4532-b440-786f119fbf63 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:00.230259 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 617/1229] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:00.231281 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5edad-6b25-49d1-8243-d0260c5952c0 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:00.242937 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:00.340814 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5edad-6b25-49d1-8243-d0260c5952c0 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:00.381473 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c4dd7-6a49-4e29-b189-19afde3fe522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:00.382096 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c4dd7-6a49-4e29-b189-19afde3fe522 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:00.382447 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c4dd7-6a49-4e29-b189-19afde3fe522 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:00.382675 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c4dd7-6a49-4e29-b189-19afde3fe522 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:00.389521 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c4dd7-6a49-4e29-b189-19afde3fe522 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:00.391068 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c4dd7-6a49-4e29-b189-19afde3fe522 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:00.402618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-654c4dd7-6a49-4e29-b189-19afde3fe522 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:00.402618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:00.402618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:00.402618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:00.402618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:00.402618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:00.402618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:00.402618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:00.402618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:00.402618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:00.402618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:00.402618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:00.402618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:00.402618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:00.402618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:00.403627 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:00.403627 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:00.403627 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:00.403627 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:00.403627 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:00.403627 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:00.403627 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:00.403627 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:00.403627 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:00.403627 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:00.403627 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:00.403627 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:00.403627 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:00.403627 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:00.403627 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:00.403627 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:00.403627 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:00.404539 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:00.404539 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:00.404539 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:00.404539 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:00.404539 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:00.404539 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:00.404539 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:00.404539 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:08:00.404539 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 613/1230] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:00.411156 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc5088-4834-4532-b440-786f119fbf63 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:00.527250 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc5088-4834-4532-b440-786f119fbf63 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:00.568113 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1863984-242c-4f72-95ec-5a5452348297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:00.568735 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1863984-242c-4f72-95ec-5a5452348297 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:00.569011 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1863984-242c-4f72-95ec-5a5452348297 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:00.569282 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1863984-242c-4f72-95ec-5a5452348297 None admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:00.569977 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1863984-242c-4f72-95ec-5a5452348297 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:00.570281 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1863984-242c-4f72-95ec-5a5452348297 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:00.571748 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1863984-242c-4f72-95ec-5a5452348297 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:00.590399 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 618/1231] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:00.597650 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c4dd7-6a49-4e29-b189-19afde3fe522 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:00.672862 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:00.712739 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c4dd7-6a49-4e29-b189-19afde3fe522 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:00.751742 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeeedbd-98d4-4cba-8ac6-4cccb72db07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:00.752413 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeeedbd-98d4-4cba-8ac6-4cccb72db07b None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:00.752695 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeeedbd-98d4-4cba-8ac6-4cccb72db07b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:00.752973 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeeedbd-98d4-4cba-8ac6-4cccb72db07b None admin] PATH_INFO: `/v3/projects/f9e550ea75dd4245bd9c2bcd6322c507/users/ece00ea631594381bf1c27cfc2ece6f1/roles/0230e2e79da94067a82374ceada29d3f` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:00.770507 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeeedbd-98d4-4cba-8ac6-4cccb72db07b None admin] RBAC: Authorizing `identity:create_grant(project_id=f9e550ea75dd4245bd9c2bcd6322c507, user_id=ece00ea631594381bf1c27cfc2ece6f1, role_id=0230e2e79da94067a82374ceada29d3f)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:00.772421 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeeedbd-98d4-4cba-8ac6-4cccb72db07b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:00.786537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 614/1232] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 19:08:00 2022] PUT /identity/v3/projects/f9e550ea75dd4245bd9c2bcd6322c507/users/ece00ea631594381bf1c27cfc2ece6f1/roles/0230e2e79da94067a82374ceada29d3f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:08:02.825544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae10e2a-be10-4c49-a8aa-1696940361a0 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:02.826093 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae10e2a-be10-4c49-a8aa-1696940361a0 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:02.826093 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae10e2a-be10-4c49-a8aa-1696940361a0 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:02.828400 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 619/1233] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:08:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:02.835005 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f55e1f-a0af-48c4-8b3b-a5a1287c9adf None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:02.835483 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f55e1f-a0af-48c4-8b3b-a5a1287c9adf None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:02.835573 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f55e1f-a0af-48c4-8b3b-a5a1287c9adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:02.856101 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-a6f55e1f-a0af-48c4-8b3b-a5a1287c9adf None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:02.857384 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a6f55e1f-a0af-48c4-8b3b-a5a1287c9adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:02.939985 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 615/1234] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 19:08:03.254131 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae10e2a-be10-4c49-a8aa-1696940361a0 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:03.282389 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:03.368356 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae10e2a-be10-4c49-a8aa-1696940361a0 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:03.409513 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064e10b-1fac-40d6-a461-52c92a4d5c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:03.410233 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064e10b-1fac-40d6-a461-52c92a4d5c0e None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:03.410580 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064e10b-1fac-40d6-a461-52c92a4d5c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:03.410898 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064e10b-1fac-40d6-a461-52c92a4d5c0e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:03.423122 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c064e10b-1fac-40d6-a461-52c92a4d5c0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:03.429653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-c064e10b-1fac-40d6-a461-52c92a4d5c0e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:03.429653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:03.429653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:03.429653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:03.429653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:03.429653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:03.429653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:03.429653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:03.429653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:03.429653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:03.429653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:03.429653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:03.429653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:03.429653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:03.429653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:03.429653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:03.431111 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:03.431111 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:03.431111 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:03.431111 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:03.431111 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:03.431111 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:03.431111 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:03.431111 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:03.431111 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:03.431111 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:03.431111 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:03.431111 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:03.431111 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:03.431111 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:03.431111 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:03.431111 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:03.432270 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:03.432270 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:03.432270 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:03.432270 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:03.432270 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:03.432270 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:03.432270 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:03.432270 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:03.432270 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:03.432270 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:03.432270 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 19:08:03.432270 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:08:03.432270 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 620/1235] 10.222.0.79 () {56 vars in 1102 bytes} [Wed Aug 31 19:08:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:03.437391 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f55e1f-a0af-48c4-8b3b-a5a1287c9adf None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:03.487574 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:03.549159 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f55e1f-a0af-48c4-8b3b-a5a1287c9adf None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:03.584982 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7231348-5987-465b-a3e3-938b5320e59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:03.585592 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7231348-5987-465b-a3e3-938b5320e59d None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:03.585871 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7231348-5987-465b-a3e3-938b5320e59d None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:03.586147 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7231348-5987-465b-a3e3-938b5320e59d None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:03.586846 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7231348-5987-465b-a3e3-938b5320e59d None admin] RBAC: Adding query filter params (name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:03.587162 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7231348-5987-465b-a3e3-938b5320e59d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:03.588539 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7231348-5987-465b-a3e3-938b5320e59d None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:03.602740 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 616/1236] 10.222.0.79 () {56 vars in 1103 bytes} [Wed Aug 31 19:08:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:03.604189 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064e10b-1fac-40d6-a461-52c92a4d5c0e None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:03.704329 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:03.723080 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064e10b-1fac-40d6-a461-52c92a4d5c0e None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:03.761308 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf1aa3-7fa1-4f52-9d1e-a2f66db3f91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:03.761926 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf1aa3-7fa1-4f52-9d1e-a2f66db3f91a None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:03.762204 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf1aa3-7fa1-4f52-9d1e-a2f66db3f91a None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:03.762485 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf1aa3-7fa1-4f52-9d1e-a2f66db3f91a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:03.773524 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf1aa3-7fa1-4f52-9d1e-a2f66db3f91a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:03.775074 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf1aa3-7fa1-4f52-9d1e-a2f66db3f91a None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:03.792233 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-04cf1aa3-7fa1-4f52-9d1e-a2f66db3f91a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:03.792233 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:03.792233 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:03.792233 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:03.792233 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:03.792233 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:03.792233 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:03.792233 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:03.792233 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:03.792233 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:03.792233 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:03.792233 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:03.792233 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:03.792233 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:03.792233 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:03.792233 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:03.793502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:03.793502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:03.793502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:03.793502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:03.793502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:03.793502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:03.793502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:03.793502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:03.793502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:03.793502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:03.793502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:03.793502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:03.793502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:03.793502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:03.793502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:03.793502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:03.793502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:03.794926 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:03.794926 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:03.794926 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:08:03.799925 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 621/1237] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:03.801368 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7231348-5987-465b-a3e3-938b5320e59d None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:03.922253 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7231348-5987-465b-a3e3-938b5320e59d None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:03.937364 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:03.973014 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b91f3-1e1d-4894-8db9-c5dfe4485770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:03.973661 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b91f3-1e1d-4894-8db9-c5dfe4485770 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:03.973906 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b91f3-1e1d-4894-8db9-c5dfe4485770 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:03.974171 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b91f3-1e1d-4894-8db9-c5dfe4485770 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:03.974841 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b91f3-1e1d-4894-8db9-c5dfe4485770 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:03.975247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b91f3-1e1d-4894-8db9-c5dfe4485770 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:03.976657 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b91f3-1e1d-4894-8db9-c5dfe4485770 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:03.992177 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 617/1238] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:03.998834 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf1aa3-7fa1-4f52-9d1e-a2f66db3f91a None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:04.119284 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf1aa3-7fa1-4f52-9d1e-a2f66db3f91a None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:04.159564 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db381310-acbf-4bfe-8ea6-eda57209679d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:04.160194 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db381310-acbf-4bfe-8ea6-eda57209679d None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:04.160473 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db381310-acbf-4bfe-8ea6-eda57209679d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:04.160745 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db381310-acbf-4bfe-8ea6-eda57209679d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:04.163503 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:04.168657 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db381310-acbf-4bfe-8ea6-eda57209679d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:04.170274 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db381310-acbf-4bfe-8ea6-eda57209679d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:04.181873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-db381310-acbf-4bfe-8ea6-eda57209679d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 19:08:04.181873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:04.181873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:04.181873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:04.181873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:04.181873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:04.181873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:04.181873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:04.181873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:04.181873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:04.181873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:04.181873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:04.181873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:04.181873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:04.181873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:04.181873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:04.183153 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:04.183153 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:04.183153 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:04.183153 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:04.183153 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:04.183153 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:04.183153 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:04.183153 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:04.183153 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:04.183153 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:04.183153 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:04.183153 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:04.183153 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:04.183153 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:04.183153 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:04.183153 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:04.183153 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:04.183153 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:04.184174 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:04.184174 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:04.184174 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:04.184174 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:04.184174 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:04.184174 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:04.184174 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:04.184174 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:04.184174 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 19:08:04.184174 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:08:04.184174 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 622/1239] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:04.189123 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b91f3-1e1d-4894-8db9-c5dfe4485770 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:04.297700 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b91f3-1e1d-4894-8db9-c5dfe4485770 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:04.336116 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d8213-1073-44c1-a45b-5e864530f460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:04.336727 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d8213-1073-44c1-a45b-5e864530f460 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:04.337002 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d8213-1073-44c1-a45b-5e864530f460 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:04.337268 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d8213-1073-44c1-a45b-5e864530f460 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:04.337998 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d8213-1073-44c1-a45b-5e864530f460 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:04.338298 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d8213-1073-44c1-a45b-5e864530f460 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:04.339738 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d8213-1073-44c1-a45b-5e864530f460 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:04.358175 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 618/1240] 10.222.0.79 () {56 vars in 1143 bytes} [Wed Aug 31 19:08:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:04.363857 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db381310-acbf-4bfe-8ea6-eda57209679d None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:04.476506 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db381310-acbf-4bfe-8ea6-eda57209679d None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:04.511581 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbcc90-3d00-4a36-9545-a5053b2236eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:04.512206 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbcc90-3d00-4a36-9545-a5053b2236eb None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:04.512481 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbcc90-3d00-4a36-9545-a5053b2236eb None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:04.512754 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbcc90-3d00-4a36-9545-a5053b2236eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:04.584904 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:04.593403 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbcc90-3d00-4a36-9545-a5053b2236eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:04.595099 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbcc90-3d00-4a36-9545-a5053b2236eb None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:04.710322 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 623/1241] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:08:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:08:04.716356 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d8213-1073-44c1-a45b-5e864530f460 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:04.745254 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:04.826094 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d8213-1073-44c1-a45b-5e864530f460 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:04.862632 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de1ce9-5a04-4592-bb5d-e62db3315375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:04.863257 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de1ce9-5a04-4592-bb5d-e62db3315375 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:04.863535 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de1ce9-5a04-4592-bb5d-e62db3315375 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:04.863801 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de1ce9-5a04-4592-bb5d-e62db3315375 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:04.878630 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de1ce9-5a04-4592-bb5d-e62db3315375 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:04.880420 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de1ce9-5a04-4592-bb5d-e62db3315375 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:04.898924 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-92de1ce9-5a04-4592-bb5d-e62db3315375 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:04.898924 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:04.898924 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:04.898924 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:04.898924 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:04.898924 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:04.898924 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:04.898924 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:04.898924 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:04.898924 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:04.898924 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:04.898924 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:04.898924 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:04.898924 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:04.898924 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:04.898924 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:04.900214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:04.900214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:04.900214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:04.900214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:04.900214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:04.900214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:04.900214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:04.900214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:04.900214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:04.900214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:04.900214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:04.900214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:04.900214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:04.900214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:04.900214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:04.900214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:04.900214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:04.901374 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:04.901374 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:04.901374 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:08:04.901374 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 619/1242] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:04.907676 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbcc90-3d00-4a36-9545-a5053b2236eb None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:05.008867 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:05.015911 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbcc90-3d00-4a36-9545-a5053b2236eb None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:05.052295 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80923d77-3318-467e-8c3e-b08fcec01051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:05.052915 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80923d77-3318-467e-8c3e-b08fcec01051 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:05.053197 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80923d77-3318-467e-8c3e-b08fcec01051 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:05.053459 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80923d77-3318-467e-8c3e-b08fcec01051 None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:05.054139 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80923d77-3318-467e-8c3e-b08fcec01051 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:05.054414 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80923d77-3318-467e-8c3e-b08fcec01051 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:05.055825 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80923d77-3318-467e-8c3e-b08fcec01051 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:05.068839 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 624/1243] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:05.074707 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de1ce9-5a04-4592-bb5d-e62db3315375 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:05.161477 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:05.184295 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de1ce9-5a04-4592-bb5d-e62db3315375 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:05.222233 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4a93a-f9f3-48f3-99c7-ae265920c2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:05.223005 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4a93a-f9f3-48f3-99c7-ae265920c2f4 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:05.223319 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4a93a-f9f3-48f3-99c7-ae265920c2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:05.223658 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4a93a-f9f3-48f3-99c7-ae265920c2f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:05.231806 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad4a93a-f9f3-48f3-99c7-ae265920c2f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:05.233976 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad4a93a-f9f3-48f3-99c7-ae265920c2f4 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:05.246374 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-cad4a93a-f9f3-48f3-99c7-ae265920c2f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:05.246374 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:05.246374 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:05.246374 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:05.246374 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:05.246374 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:05.246374 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:05.246374 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:05.246374 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:05.246374 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:05.246374 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:05.246374 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:05.246374 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:05.246374 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:05.246374 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:05.247466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:05.247466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:05.247466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:05.247466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:05.247466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:05.247466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:05.247466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:05.247466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:05.247466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:05.247466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:05.247466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:05.247466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:05.247466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:05.247466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:05.247466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:05.247466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:05.247466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:05.249646 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:05.249646 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:05.249646 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:05.249646 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:05.249646 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:05.249646 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:05.249646 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:05.249646 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:08:05.249646 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 620/1244] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:05.255039 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80923d77-3318-467e-8c3e-b08fcec01051 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:05.369965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80923d77-3318-467e-8c3e-b08fcec01051 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:05.409196 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b8c3f-4890-458c-abe5-8b01d9ea7b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:05.409808 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b8c3f-4890-458c-abe5-8b01d9ea7b57 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:05.410089 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b8c3f-4890-458c-abe5-8b01d9ea7b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:05.410362 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b8c3f-4890-458c-abe5-8b01d9ea7b57 None admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:05.411091 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b8c3f-4890-458c-abe5-8b01d9ea7b57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:05.411393 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b8c3f-4890-458c-abe5-8b01d9ea7b57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:05.412881 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b8c3f-4890-458c-abe5-8b01d9ea7b57 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:05.427320 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 625/1245] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:05.433376 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4a93a-f9f3-48f3-99c7-ae265920c2f4 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:05.551622 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4a93a-f9f3-48f3-99c7-ae265920c2f4 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:05.591478 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dadeb4-cb2a-40e2-b8eb-152d53874397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:05.591793 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dadeb4-cb2a-40e2-b8eb-152d53874397 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:05.591983 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dadeb4-cb2a-40e2-b8eb-152d53874397 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:05.592342 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dadeb4-cb2a-40e2-b8eb-152d53874397 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:05.593065 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dadeb4-cb2a-40e2-b8eb-152d53874397 None admin] RBAC: Adding query filter params (role.id=0230e2e79da94067a82374ceada29d3f, scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507, user.id=ece00ea631594381bf1c27cfc2ece6f1) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:05.593397 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dadeb4-cb2a-40e2-b8eb-152d53874397 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:05.594860 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dadeb4-cb2a-40e2-b8eb-152d53874397 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:05.600938 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 621/1246] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:08:05 2022] GET /identity/v3/role_assignments?user.id=ece00ea631594381bf1c27cfc2ece6f1&scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507&role.id=0230e2e79da94067a82374ceada29d3f => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:07.699526 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef5f80-90f5-4b40-b5c9-4b0ae5194166 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:07.700060 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef5f80-90f5-4b40-b5c9-4b0ae5194166 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:07.700060 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef5f80-90f5-4b40-b5c9-4b0ae5194166 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:07.701417 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 626/1247] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:08:07.706872 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be7dd5-6b1f-41a6-9388-59697a56ea14 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:07.707364 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be7dd5-6b1f-41a6-9388-59697a56ea14 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:07.707510 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be7dd5-6b1f-41a6-9388-59697a56ea14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:07.713653 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:07.732395 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-86be7dd5-6b1f-41a6-9388-59697a56ea14 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:07.734253 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-86be7dd5-6b1f-41a6-9388-59697a56ea14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:07.819321 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 622/1248] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:08:08.128180 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef5f80-90f5-4b40-b5c9-4b0ae5194166 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:08.150307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:08.270015 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef5f80-90f5-4b40-b5c9-4b0ae5194166 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:08.312484 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268658a-8c1e-4770-b79d-2affacf3dffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:08.313117 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268658a-8c1e-4770-b79d-2affacf3dffb None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:08.313403 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268658a-8c1e-4770-b79d-2affacf3dffb None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:08.313665 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268658a-8c1e-4770-b79d-2affacf3dffb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:08.328701 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268658a-8c1e-4770-b79d-2affacf3dffb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:08.335562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-2268658a-8c1e-4770-b79d-2affacf3dffb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:08:08.335562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:08.335562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:08.335562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:08.335562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:08.335562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:08.335562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:08.335562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:08.335562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:08.335562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:08.335562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:08.335562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:08.335562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:08.335562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:08.335562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:08.335562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:08.336664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:08.336664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:08.336664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:08.336664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:08.336664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:08.336664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:08.336664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:08.336664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:08.336664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:08.336664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:08.336664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:08.336664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:08.336664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:08.336664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:08.336664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:08.336664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:08.337498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:08.337498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:08.337498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:08.337498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:08.337498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:08.337498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:08.337498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:08.337498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:08.337498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:08.337498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:08.337498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:08:08.337498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:08:08.337498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 627/1249] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 19:08:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:08.343209 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be7dd5-6b1f-41a6-9388-59697a56ea14 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:08.475509 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be7dd5-6b1f-41a6-9388-59697a56ea14 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:08.517976 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:08.524544 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bedae0-c43c-4175-baaa-22015f0ec3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:08.524544 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bedae0-c43c-4175-baaa-22015f0ec3f5 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:08.525386 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bedae0-c43c-4175-baaa-22015f0ec3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:08.525661 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bedae0-c43c-4175-baaa-22015f0ec3f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:08.526334 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bedae0-c43c-4175-baaa-22015f0ec3f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:08.526666 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bedae0-c43c-4175-baaa-22015f0ec3f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:08.528044 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bedae0-c43c-4175-baaa-22015f0ec3f5 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:08.542202 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 623/1250] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:08:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:08.549911 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268658a-8c1e-4770-b79d-2affacf3dffb None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:08.655771 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:08.686744 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268658a-8c1e-4770-b79d-2affacf3dffb None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:08.735855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644f4fa-5e2a-455c-b0f1-98d4ebd3df6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:08.736884 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644f4fa-5e2a-455c-b0f1-98d4ebd3df6f None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:08.736884 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644f4fa-5e2a-455c-b0f1-98d4ebd3df6f None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:08.737240 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644f4fa-5e2a-455c-b0f1-98d4ebd3df6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:08.749953 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644f4fa-5e2a-455c-b0f1-98d4ebd3df6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:08.751674 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644f4fa-5e2a-455c-b0f1-98d4ebd3df6f None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:08.772036 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-5644f4fa-5e2a-455c-b0f1-98d4ebd3df6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:08.772036 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:08.772036 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:08.772036 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:08.772036 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:08.772036 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:08.772036 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:08.772036 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:08.772036 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:08.772036 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:08.772036 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:08.772036 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:08.772036 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:08.772036 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:08.772036 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:08.772036 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:08.773265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:08.773265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:08.773265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:08.773265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:08.773265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:08.773265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:08.773265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:08.773265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:08.773265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:08.773265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:08.773265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:08.773265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:08.773265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:08.773265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:08.773265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:08.773265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:08.773265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:08.774377 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:08.774377 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:08.774377 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:08:08.774377 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 628/1251] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:08.780049 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bedae0-c43c-4175-baaa-22015f0ec3f5 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:08.907291 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bedae0-c43c-4175-baaa-22015f0ec3f5 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:08.953505 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e994149-bedb-4f93-bc11-83e83f8df58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:08.954216 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e994149-bedb-4f93-bc11-83e83f8df58e None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:08.954540 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e994149-bedb-4f93-bc11-83e83f8df58e None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:08.954840 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e994149-bedb-4f93-bc11-83e83f8df58e None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:08.955559 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e994149-bedb-4f93-bc11-83e83f8df58e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:08.955899 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e994149-bedb-4f93-bc11-83e83f8df58e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:08.957635 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e994149-bedb-4f93-bc11-83e83f8df58e None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:08.976713 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 624/1252] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:08.982817 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644f4fa-5e2a-455c-b0f1-98d4ebd3df6f None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:09.089396 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644f4fa-5e2a-455c-b0f1-98d4ebd3df6f None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:09.119113 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:09.128064 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a14a9-4bb7-419c-b00d-54484dac17cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:09.128748 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a14a9-4bb7-419c-b00d-54484dac17cd None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:09.129021 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a14a9-4bb7-419c-b00d-54484dac17cd None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:09.129289 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a14a9-4bb7-419c-b00d-54484dac17cd None admin] PATH_INFO: `/v3/users/placement` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:09.137804 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a14a9-4bb7-419c-b00d-54484dac17cd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:09.140944 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a14a9-4bb7-419c-b00d-54484dac17cd None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:09.153662 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-ba9a14a9-4bb7-419c-b00d-54484dac17cd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 19:08:09.153662 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:09.153662 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:09.153662 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:09.153662 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:09.153662 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:09.153662 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:09.153662 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:09.153662 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:09.153662 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:09.153662 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:09.153662 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:09.153662 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:09.153662 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:09.153662 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:09.153662 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:09.155679 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:09.155679 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:09.155679 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:09.155679 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:09.155679 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:09.155679 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:09.155679 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:09.155679 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:09.155679 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:09.155679 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:09.155679 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:09.155679 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:09.155679 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:09.155679 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:09.155679 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:09.155679 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:09.155679 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:09.155679 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:09.156643 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:09.156643 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:09.156643 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:09.156643 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:09.156643 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:09.156643 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:09.156643 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:09.156643 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:09.156643 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 19:08:09.156643 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:08:09.156643 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 629/1253] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:09.161566 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e994149-bedb-4f93-bc11-83e83f8df58e None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:09.224956 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:09.286813 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e994149-bedb-4f93-bc11-83e83f8df58e None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:09.326856 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b32b3f-d2f7-472c-910c-8d59d80b23a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:09.327843 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b32b3f-d2f7-472c-910c-8d59d80b23a8 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:09.328116 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b32b3f-d2f7-472c-910c-8d59d80b23a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:09.328390 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b32b3f-d2f7-472c-910c-8d59d80b23a8 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:09.329170 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b32b3f-d2f7-472c-910c-8d59d80b23a8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:09.329487 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b32b3f-d2f7-472c-910c-8d59d80b23a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:09.331049 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b32b3f-d2f7-472c-910c-8d59d80b23a8 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:09.350265 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 625/1254] 10.222.0.79 () {56 vars in 1143 bytes} [Wed Aug 31 19:08:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:09.356558 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a14a9-4bb7-419c-b00d-54484dac17cd None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:09.477855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a14a9-4bb7-419c-b00d-54484dac17cd None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:09.517352 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74adf26f-1a2c-4657-ba9c-c4b7979603e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:09.517965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74adf26f-1a2c-4657-ba9c-c4b7979603e8 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:09.518252 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74adf26f-1a2c-4657-ba9c-c4b7979603e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:09.518556 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74adf26f-1a2c-4657-ba9c-c4b7979603e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:09.591685 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:09.605802 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74adf26f-1a2c-4657-ba9c-c4b7979603e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:09.609941 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74adf26f-1a2c-4657-ba9c-c4b7979603e8 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:09.718382 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 630/1255] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:08:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:08:09.719814 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b32b3f-d2f7-472c-910c-8d59d80b23a8 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:09.822623 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b32b3f-d2f7-472c-910c-8d59d80b23a8 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:09.837206 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:09.861744 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887320c-ed45-49f3-b1dd-7ddedf77cb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:09.862286 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887320c-ed45-49f3-b1dd-7ddedf77cb2b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:09.862587 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887320c-ed45-49f3-b1dd-7ddedf77cb2b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:09.862858 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887320c-ed45-49f3-b1dd-7ddedf77cb2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:09.873003 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9887320c-ed45-49f3-b1dd-7ddedf77cb2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:09.875059 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9887320c-ed45-49f3-b1dd-7ddedf77cb2b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:09.889525 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-9887320c-ed45-49f3-b1dd-7ddedf77cb2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:09.889525 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:09.889525 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:09.889525 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:09.889525 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:09.889525 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:09.889525 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:09.889525 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:09.889525 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:09.889525 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:09.889525 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:09.889525 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:09.889525 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:09.889525 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:09.889525 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:09.889525 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:09.890955 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:09.890955 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:09.890955 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:09.890955 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:09.890955 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:09.890955 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:09.890955 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:09.890955 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:09.890955 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:09.890955 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:09.890955 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:09.890955 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:09.890955 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:09.890955 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:09.890955 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:09.890955 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:09.890955 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:09.892246 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:09.892246 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:09.892246 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:08:09.892246 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 626/1256] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:09.896772 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74adf26f-1a2c-4657-ba9c-c4b7979603e8 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:09.994251 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:10.006947 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74adf26f-1a2c-4657-ba9c-c4b7979603e8 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:10.042443 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d6c91-0fe6-442a-9344-103d3cb05e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:10.043065 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d6c91-0fe6-442a-9344-103d3cb05e30 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:10.043340 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d6c91-0fe6-442a-9344-103d3cb05e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:10.043610 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d6c91-0fe6-442a-9344-103d3cb05e30 None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:10.044241 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07d6c91-0fe6-442a-9344-103d3cb05e30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:10.044544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07d6c91-0fe6-442a-9344-103d3cb05e30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:10.046550 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07d6c91-0fe6-442a-9344-103d3cb05e30 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:10.057845 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 631/1257] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:10.063951 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887320c-ed45-49f3-b1dd-7ddedf77cb2b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:10.180390 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887320c-ed45-49f3-b1dd-7ddedf77cb2b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:10.226397 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc9969-2644-48aa-9b4e-76b76b531beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:10.227288 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc9969-2644-48aa-9b4e-76b76b531beb None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:10.227692 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc9969-2644-48aa-9b4e-76b76b531beb None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:10.228062 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc9969-2644-48aa-9b4e-76b76b531beb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:10.235258 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc9969-2644-48aa-9b4e-76b76b531beb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:10.236835 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc9969-2644-48aa-9b4e-76b76b531beb None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:10.252352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-20bc9969-2644-48aa-9b4e-76b76b531beb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:10.252352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:10.252352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:10.252352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:10.252352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:10.252352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:10.252352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:10.252352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:10.252352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:10.252352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:10.252352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:10.252352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:10.252352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:10.252352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:10.252352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:10.253486 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:10.253486 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:10.253486 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:10.253486 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:10.253486 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:10.253486 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:10.253486 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:10.253486 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:10.253486 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:10.253486 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:10.253486 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:10.253486 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:10.253486 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:10.253486 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:10.253486 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:10.253486 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:10.253486 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:10.254603 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:10.254603 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:10.254603 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:10.254603 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:10.254603 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:10.254603 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:10.254603 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:10.254603 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:08:10.254603 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 627/1258] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:10.259807 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d6c91-0fe6-442a-9344-103d3cb05e30 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:10.384502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d6c91-0fe6-442a-9344-103d3cb05e30 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:10.427231 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a0239-17f7-4a8f-bb74-95388695ff00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:10.427852 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a0239-17f7-4a8f-bb74-95388695ff00 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:10.428129 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a0239-17f7-4a8f-bb74-95388695ff00 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:10.428401 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a0239-17f7-4a8f-bb74-95388695ff00 None admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:10.429178 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a0239-17f7-4a8f-bb74-95388695ff00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:10.429612 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a0239-17f7-4a8f-bb74-95388695ff00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:10.431633 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a0239-17f7-4a8f-bb74-95388695ff00 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:10.446250 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 632/1259] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:10.452563 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc9969-2644-48aa-9b4e-76b76b531beb None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:10.479662 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:10.562768 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc9969-2644-48aa-9b4e-76b76b531beb None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:10.598618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4511c-2a08-483e-b88b-587992e69cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:10.599226 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4511c-2a08-483e-b88b-587992e69cbd None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:10.599502 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4511c-2a08-483e-b88b-587992e69cbd None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:10.599769 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4511c-2a08-483e-b88b-587992e69cbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:10.600499 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4511c-2a08-483e-b88b-587992e69cbd None admin] RBAC: Adding query filter params (role.id=edc551338adb4ae88bdafc591ad69582, scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507, user.id=ece00ea631594381bf1c27cfc2ece6f1) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:10.600800 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4511c-2a08-483e-b88b-587992e69cbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:10.602228 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4511c-2a08-483e-b88b-587992e69cbd None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:10.608533 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 628/1260] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:08:10 2022] GET /identity/v3/role_assignments?user.id=ece00ea631594381bf1c27cfc2ece6f1&scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507&role.id=edc551338adb4ae88bdafc591ad69582 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:12.510350 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4775a-82a3-459c-a681-8320307f4052 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:12.510921 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4775a-82a3-459c-a681-8320307f4052 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:12.510921 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4775a-82a3-459c-a681-8320307f4052 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:12.512341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 633/1261] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:12.518069 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86562e77-65b5-4100-96a4-d07f3c284eae None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:12.518514 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86562e77-65b5-4100-96a4-d07f3c284eae None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:12.518646 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86562e77-65b5-4100-96a4-d07f3c284eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:12.536625 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-86562e77-65b5-4100-96a4-d07f3c284eae None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:12.538092 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-86562e77-65b5-4100-96a4-d07f3c284eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:12.604402 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 629/1262] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:08:12.875551 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4775a-82a3-459c-a681-8320307f4052 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:12.886343 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:12.986844 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4775a-82a3-459c-a681-8320307f4052 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:13.019999 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80566c46-4eb8-4a52-8b3e-276d784ff1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:13.020616 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80566c46-4eb8-4a52-8b3e-276d784ff1d4 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:13.020891 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80566c46-4eb8-4a52-8b3e-276d784ff1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:13.021160 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80566c46-4eb8-4a52-8b3e-276d784ff1d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:13.030802 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80566c46-4eb8-4a52-8b3e-276d784ff1d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:13.035475 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-80566c46-4eb8-4a52-8b3e-276d784ff1d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:08:13.035475 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:13.035475 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:13.035475 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:13.035475 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:13.035475 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:13.035475 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:13.035475 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:13.035475 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:13.035475 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:13.035475 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:13.035475 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:13.035475 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:13.035475 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:13.035475 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:13.035475 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:13.036577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:13.036577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:13.036577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:13.036577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:13.036577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:13.036577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:13.036577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:13.036577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:13.036577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:13.036577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:13.036577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:13.036577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:13.036577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:13.036577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:13.036577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:13.036577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:13.037842 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:13.037842 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:13.037842 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:13.037842 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:13.037842 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:13.037842 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:13.037842 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:13.037842 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:13.037842 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:13.037842 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:13.037842 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:08:13.037842 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:08:13.037842 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 634/1263] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 19:08:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:13.042602 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86562e77-65b5-4100-96a4-d07f3c284eae None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:13.061189 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:13.141621 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86562e77-65b5-4100-96a4-d07f3c284eae None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:13.173890 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2923ee3-e69a-4fa3-96cb-107adababafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:13.174501 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2923ee3-e69a-4fa3-96cb-107adababafa None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:13.174779 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2923ee3-e69a-4fa3-96cb-107adababafa None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:13.175045 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2923ee3-e69a-4fa3-96cb-107adababafa None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:13.175697 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2923ee3-e69a-4fa3-96cb-107adababafa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:13.175991 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2923ee3-e69a-4fa3-96cb-107adababafa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:13.177335 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2923ee3-e69a-4fa3-96cb-107adababafa None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:13.185012 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 630/1264] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:08:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:13.191320 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80566c46-4eb8-4a52-8b3e-276d784ff1d4 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:13.255817 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:13.288060 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80566c46-4eb8-4a52-8b3e-276d784ff1d4 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:13.320860 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f24a8f-8ba4-40e0-815f-e8ecb4cfae51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:13.321473 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f24a8f-8ba4-40e0-815f-e8ecb4cfae51 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:13.321750 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f24a8f-8ba4-40e0-815f-e8ecb4cfae51 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:13.322020 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f24a8f-8ba4-40e0-815f-e8ecb4cfae51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:13.332220 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f24a8f-8ba4-40e0-815f-e8ecb4cfae51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:13.333640 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f24a8f-8ba4-40e0-815f-e8ecb4cfae51 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:13.347953 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-e7f24a8f-8ba4-40e0-815f-e8ecb4cfae51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:13.347953 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:13.347953 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:13.347953 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:13.347953 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:13.347953 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:13.347953 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:13.347953 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:13.347953 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:13.347953 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:13.347953 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:13.347953 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:13.347953 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:13.347953 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:13.347953 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:13.347953 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:13.349132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:13.349132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:13.349132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:13.349132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:13.349132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:13.349132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:13.349132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:13.349132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:13.349132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:13.349132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:13.349132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:13.349132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:13.349132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:13.349132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:13.349132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:13.349132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:13.349132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:13.350344 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:13.350344 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:13.350344 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:08:13.350344 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 635/1265] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:13.354744 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2923ee3-e69a-4fa3-96cb-107adababafa None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:13.433874 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:13.453604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2923ee3-e69a-4fa3-96cb-107adababafa None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:13.486268 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c480a9-2525-410c-b7fa-e6e1207323f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:13.486876 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c480a9-2525-410c-b7fa-e6e1207323f1 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:13.487153 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c480a9-2525-410c-b7fa-e6e1207323f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:13.487420 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c480a9-2525-410c-b7fa-e6e1207323f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:13.488051 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c480a9-2525-410c-b7fa-e6e1207323f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:13.488345 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c480a9-2525-410c-b7fa-e6e1207323f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:13.489686 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c480a9-2525-410c-b7fa-e6e1207323f1 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:13.501093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 631/1266] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:13.506777 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f24a8f-8ba4-40e0-815f-e8ecb4cfae51 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:13.605465 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f24a8f-8ba4-40e0-815f-e8ecb4cfae51 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:13.624271 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:13.639521 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dac5cd-8040-4b1f-842a-11110e2c0231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:13.640142 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dac5cd-8040-4b1f-842a-11110e2c0231 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:13.640420 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dac5cd-8040-4b1f-842a-11110e2c0231 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:13.640691 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dac5cd-8040-4b1f-842a-11110e2c0231 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:13.647907 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dac5cd-8040-4b1f-842a-11110e2c0231 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:13.649336 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dac5cd-8040-4b1f-842a-11110e2c0231 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:13.660960 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-a4dac5cd-8040-4b1f-842a-11110e2c0231 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 19:08:13.660960 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:13.660960 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:13.660960 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:13.660960 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:13.660960 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:13.660960 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:13.660960 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:13.660960 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:13.660960 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:13.660960 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:13.660960 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:13.660960 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:13.660960 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:13.660960 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:13.660960 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:13.662169 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:13.662169 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:13.662169 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:13.662169 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:13.662169 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:13.662169 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:13.662169 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:13.662169 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:13.662169 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:13.662169 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:13.662169 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:13.662169 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:13.662169 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:13.662169 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:13.662169 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:13.662169 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:13.662169 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:13.662169 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:13.663540 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:13.663540 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:13.663540 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:13.663540 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:13.663540 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:13.663540 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:13.663540 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:13.663540 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:13.663540 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 19:08:13.663540 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:08:13.663540 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 636/1267] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:13.668019 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c480a9-2525-410c-b7fa-e6e1207323f1 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:13.765782 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c480a9-2525-410c-b7fa-e6e1207323f1 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:13.798761 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432dd9d7-3ff9-42db-b7cd-67be45381a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:13.799356 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432dd9d7-3ff9-42db-b7cd-67be45381a93 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:13.799638 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432dd9d7-3ff9-42db-b7cd-67be45381a93 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:13.799911 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432dd9d7-3ff9-42db-b7cd-67be45381a93 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:13.800638 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432dd9d7-3ff9-42db-b7cd-67be45381a93 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:13.800942 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432dd9d7-3ff9-42db-b7cd-67be45381a93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:13.802358 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432dd9d7-3ff9-42db-b7cd-67be45381a93 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:13.811386 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:13.819946 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 632/1268] 10.222.0.79 () {56 vars in 1143 bytes} [Wed Aug 31 19:08:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:13.825747 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dac5cd-8040-4b1f-842a-11110e2c0231 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:13.932931 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dac5cd-8040-4b1f-842a-11110e2c0231 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:13.970190 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480694a2-f3f2-488c-ada3-677b004d3c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:13.970838 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480694a2-f3f2-488c-ada3-677b004d3c13 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:13.971118 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480694a2-f3f2-488c-ada3-677b004d3c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:13.971643 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480694a2-f3f2-488c-ada3-677b004d3c13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:13.981770 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480694a2-f3f2-488c-ada3-677b004d3c13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:13.983245 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480694a2-f3f2-488c-ada3-677b004d3c13 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:13.996833 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-480694a2-f3f2-488c-ada3-677b004d3c13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:13.996833 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:13.996833 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:13.996833 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:13.996833 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:13.996833 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:13.996833 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:13.996833 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:13.996833 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:13.996833 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:13.996833 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:13.996833 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:13.996833 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:13.996833 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:13.996833 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:13.996833 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:13.998479 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:13.998479 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:13.998479 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:13.998479 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:13.998479 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:13.998479 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:13.998479 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:13.998479 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:13.998479 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:13.998479 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:13.998479 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:13.998479 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:13.998479 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:13.998479 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:13.998479 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:13.998479 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:13.998479 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:13.999418 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:13.999418 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:13.999418 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:08:13.999418 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 637/1269] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:14.004314 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432dd9d7-3ff9-42db-b7cd-67be45381a93 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:14.099804 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432dd9d7-3ff9-42db-b7cd-67be45381a93 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:14.133687 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a09e26-ac11-4143-842e-ce2a92515af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:14.134284 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a09e26-ac11-4143-842e-ce2a92515af0 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:14.134593 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a09e26-ac11-4143-842e-ce2a92515af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:14.134874 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a09e26-ac11-4143-842e-ce2a92515af0 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:14.135518 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a09e26-ac11-4143-842e-ce2a92515af0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:14.135819 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a09e26-ac11-4143-842e-ce2a92515af0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:14.137179 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a09e26-ac11-4143-842e-ce2a92515af0 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:14.148165 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 633/1270] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:14.154989 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480694a2-f3f2-488c-ada3-677b004d3c13 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:14.186865 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:14.252843 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480694a2-f3f2-488c-ada3-677b004d3c13 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:14.292596 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d61d9-2141-4a7f-9160-1b0b0eb63d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:14.293210 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d61d9-2141-4a7f-9160-1b0b0eb63d01 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:14.293485 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d61d9-2141-4a7f-9160-1b0b0eb63d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:14.293752 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d61d9-2141-4a7f-9160-1b0b0eb63d01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:14.300832 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d61d9-2141-4a7f-9160-1b0b0eb63d01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:14.302254 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d61d9-2141-4a7f-9160-1b0b0eb63d01 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:14.313778 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-064d61d9-2141-4a7f-9160-1b0b0eb63d01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:14.313778 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:14.313778 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:14.313778 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:14.313778 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:14.313778 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:14.313778 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:14.313778 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:14.313778 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:14.313778 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:14.313778 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:14.313778 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:14.313778 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:14.313778 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:14.313778 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:14.315313 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:14.315313 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:14.315313 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:14.315313 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:14.315313 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:14.315313 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:14.315313 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:14.315313 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:14.315313 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:14.315313 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:14.315313 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:14.315313 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:14.315313 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:14.315313 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:14.315313 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:14.315313 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:14.315313 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:14.316272 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:14.316272 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:14.316272 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:14.316272 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:14.316272 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:14.316272 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:14.316272 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:14.316272 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:08:14.316272 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 638/1271] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:14.320855 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a09e26-ac11-4143-842e-ce2a92515af0 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:14.378194 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:14.418478 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a09e26-ac11-4143-842e-ce2a92515af0 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:14.451508 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026c981-12f6-49c9-91cf-e0e424a2ab4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:14.452096 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026c981-12f6-49c9-91cf-e0e424a2ab4c None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:14.452372 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026c981-12f6-49c9-91cf-e0e424a2ab4c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:14.452642 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026c981-12f6-49c9-91cf-e0e424a2ab4c None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:14.453326 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d026c981-12f6-49c9-91cf-e0e424a2ab4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:14.453628 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d026c981-12f6-49c9-91cf-e0e424a2ab4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:14.455082 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d026c981-12f6-49c9-91cf-e0e424a2ab4c None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:14.467108 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 634/1272] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:14.473368 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d61d9-2141-4a7f-9160-1b0b0eb63d01 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:14.565498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:14.574159 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d61d9-2141-4a7f-9160-1b0b0eb63d01 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:14.608277 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c80839e-f413-4c56-9825-c65a3e11469d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:14.608940 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80839e-f413-4c56-9825-c65a3e11469d None admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:14.609189 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80839e-f413-4c56-9825-c65a3e11469d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:14.609460 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80839e-f413-4c56-9825-c65a3e11469d None admin] PATH_INFO: `/v3/projects/f9e550ea75dd4245bd9c2bcd6322c507/users/ece00ea631594381bf1c27cfc2ece6f1/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:14.611371 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c80839e-f413-4c56-9825-c65a3e11469d None admin] RBAC: Authorizing `identity:create_grant(project_id=f9e550ea75dd4245bd9c2bcd6322c507, user_id=ece00ea631594381bf1c27cfc2ece6f1, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:14.612784 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c80839e-f413-4c56-9825-c65a3e11469d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:14.626039 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 639/1273] 10.222.0.79 () {58 vars in 1439 bytes} [Wed Aug 31 19:08:14 2022] PUT /identity/v3/projects/f9e550ea75dd4245bd9c2bcd6322c507/users/ece00ea631594381bf1c27cfc2ece6f1/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:08:16.530680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e1bf6-f442-4583-a763-2affc0da0083 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:16.531211 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e1bf6-f442-4583-a763-2affc0da0083 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:16.531211 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e1bf6-f442-4583-a763-2affc0da0083 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:16.532571 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 635/1274] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:08:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:16.537946 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f33031-9be3-439c-9eda-d0676bdc417d None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:16.538371 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f33031-9be3-439c-9eda-d0676bdc417d None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:16.538977 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f33031-9be3-439c-9eda-d0676bdc417d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:16.556601 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-90f33031-9be3-439c-9eda-d0676bdc417d None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:16.557768 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-90f33031-9be3-439c-9eda-d0676bdc417d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:16.625781 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 640/1275] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:08:16.895049 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e1bf6-f442-4583-a763-2affc0da0083 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:17.014055 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e1bf6-f442-4583-a763-2affc0da0083 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:17.030612 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:17.046750 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e35c8-5c49-4e2a-a54f-29be90d6e99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:17.047364 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e35c8-5c49-4e2a-a54f-29be90d6e99d None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:17.047640 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e35c8-5c49-4e2a-a54f-29be90d6e99d None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:17.047907 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e35c8-5c49-4e2a-a54f-29be90d6e99d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:17.057555 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e35c8-5c49-4e2a-a54f-29be90d6e99d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 19:08:17.062840 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-1c0e35c8-5c49-4e2a-a54f-29be90d6e99d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:08:17.062840 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:17.062840 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:17.062840 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:17.062840 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:17.062840 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:17.062840 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:17.062840 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:17.062840 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:17.062840 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:17.062840 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:17.062840 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:17.062840 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 19:08:17.062840 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 19:08:17.062840 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 19:08:17.062840 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 19:08:17.063995 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 19:08:17.063995 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 19:08:17.063995 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 19:08:17.063995 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 19:08:17.063995 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:17.063995 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:17.063995 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:17.063995 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:17.063995 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:17.063995 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:17.063995 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:17.063995 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:17.063995 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:17.063995 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:17.063995 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:17.063995 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:17.064924 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:17.064924 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:17.064924 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:17.064924 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:17.064924 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 19:08:17.064924 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 19:08:17.064924 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 19:08:17.064924 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 19:08:17.064924 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 19:08:17.064924 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 19:08:17.064924 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 19:08:17.064924 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:08:17.064924 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 636/1276] 10.222.0.79 () {56 vars in 1096 bytes} [Wed Aug 31 19:08:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:17.070032 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f33031-9be3-439c-9eda-d0676bdc417d None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:17.149791 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:17.167934 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f33031-9be3-439c-9eda-d0676bdc417d None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:17.201842 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef4ccc-e38f-4ec2-a3de-65323094f4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:17.202496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef4ccc-e38f-4ec2-a3de-65323094f4d1 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:17.202768 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef4ccc-e38f-4ec2-a3de-65323094f4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:17.203033 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef4ccc-e38f-4ec2-a3de-65323094f4d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:17.203689 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef4ccc-e38f-4ec2-a3de-65323094f4d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:17.203983 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef4ccc-e38f-4ec2-a3de-65323094f4d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:17.205330 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef4ccc-e38f-4ec2-a3de-65323094f4d1 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:17.213174 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 641/1277] 10.222.0.79 () {56 vars in 1099 bytes} [Wed Aug 31 19:08:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:17.219266 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e35c8-5c49-4e2a-a54f-29be90d6e99d None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:17.318863 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e35c8-5c49-4e2a-a54f-29be90d6e99d None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:17.352058 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a425c-8ef2-495b-a3d6-a1be2bda4a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:17.352673 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a425c-8ef2-495b-a3d6-a1be2bda4a4f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:17.352950 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a425c-8ef2-495b-a3d6-a1be2bda4a4f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:17.353223 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a425c-8ef2-495b-a3d6-a1be2bda4a4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:17.366735 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a425c-8ef2-495b-a3d6-a1be2bda4a4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:17.368186 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a425c-8ef2-495b-a3d6-a1be2bda4a4f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:17.387838 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-1a5a425c-8ef2-495b-a3d6-a1be2bda4a4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:17.387838 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:17.387838 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:17.387838 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:17.387838 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:17.387838 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:17.387838 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:17.387838 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:17.387838 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:17.387838 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:17.387838 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:17.387838 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:17.387838 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:17.387838 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:17.387838 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:17.387838 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:17.389025 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:17.389025 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:17.389025 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:17.389025 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:17.389025 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:17.389025 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:17.389025 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:17.389025 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:17.389025 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:17.389025 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:17.389025 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:17.389025 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:17.389025 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:17.389025 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:17.389025 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:17.389025 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:17.389025 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:17.390164 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:17.390164 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:17.390164 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:08:17.390376 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 637/1278] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:17.396306 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef4ccc-e38f-4ec2-a3de-65323094f4d1 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:17.499025 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef4ccc-e38f-4ec2-a3de-65323094f4d1 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:17.531581 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986c657-701d-40b0-8872-d4f982addb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:17.532191 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986c657-701d-40b0-8872-d4f982addb44 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:17.532465 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986c657-701d-40b0-8872-d4f982addb44 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:17.532738 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986c657-701d-40b0-8872-d4f982addb44 None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:17.533379 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986c657-701d-40b0-8872-d4f982addb44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:17.533678 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986c657-701d-40b0-8872-d4f982addb44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:17.535113 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986c657-701d-40b0-8872-d4f982addb44 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:17.547607 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 642/1279] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:08:17.553174 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a425c-8ef2-495b-a3d6-a1be2bda4a4f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:17.583202 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:17.651079 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a425c-8ef2-495b-a3d6-a1be2bda4a4f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:17.684365 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338cbd44-c4a5-4c0b-96fd-f05161e57b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:17.684981 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cbd44-c4a5-4c0b-96fd-f05161e57b0b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:17.685279 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cbd44-c4a5-4c0b-96fd-f05161e57b0b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:17.685552 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cbd44-c4a5-4c0b-96fd-f05161e57b0b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:17.692731 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338cbd44-c4a5-4c0b-96fd-f05161e57b0b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:17.694145 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338cbd44-c4a5-4c0b-96fd-f05161e57b0b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:17.704970 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-338cbd44-c4a5-4c0b-96fd-f05161e57b0b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 19:08:17.704970 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:17.704970 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:17.704970 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:17.704970 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:17.704970 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:17.704970 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:17.704970 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:17.704970 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:17.704970 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:17.704970 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:17.704970 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:17.704970 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 19:08:17.704970 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 19:08:17.704970 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 19:08:17.704970 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 19:08:17.706074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:17.706074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:17.706074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 19:08:17.706074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:17.706074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 19:08:17.706074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 19:08:17.706074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:17.706074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:17.706074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:17.706074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:17.706074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:17.706074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:17.706074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:17.706074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:17.706074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:17.706074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:17.706074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:17.706074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:17.707074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:17.707074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:17.707074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 19:08:17.707074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 19:08:17.707074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 19:08:17.707074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 19:08:17.707074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 19:08:17.707074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 19:08:17.707074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 19:08:17.707074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:08:17.707074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 638/1280] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:17.711872 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986c657-701d-40b0-8872-d4f982addb44 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:17.715842 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:17.809677 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986c657-701d-40b0-8872-d4f982addb44 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:17.842558 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f1542-1521-4a81-b2ec-20a268f2c7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:17.843146 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f1542-1521-4a81-b2ec-20a268f2c7ab None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:17.843424 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f1542-1521-4a81-b2ec-20a268f2c7ab None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:17.843690 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f1542-1521-4a81-b2ec-20a268f2c7ab None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:17.844404 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630f1542-1521-4a81-b2ec-20a268f2c7ab None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:17.844709 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630f1542-1521-4a81-b2ec-20a268f2c7ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:17.846107 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630f1542-1521-4a81-b2ec-20a268f2c7ab None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:17.862606 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 643/1281] 10.222.0.79 () {56 vars in 1143 bytes} [Wed Aug 31 19:08:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:17.868345 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338cbd44-c4a5-4c0b-96fd-f05161e57b0b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:17.962898 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:17.972842 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338cbd44-c4a5-4c0b-96fd-f05161e57b0b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:18.004511 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e951bc-2fed-4b4a-b412-c50b07addc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:18.005100 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e951bc-2fed-4b4a-b412-c50b07addc5b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:18.005373 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e951bc-2fed-4b4a-b412-c50b07addc5b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:18.005644 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e951bc-2fed-4b4a-b412-c50b07addc5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:18.069143 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e951bc-2fed-4b4a-b412-c50b07addc5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:18.070530 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e951bc-2fed-4b4a-b412-c50b07addc5b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:18.155716 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:18.166007 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 639/1282] 10.222.0.79 () {58 vars in 1282 bytes} [Wed Aug 31 19:08:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 19:08:18.172315 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f1542-1521-4a81-b2ec-20a268f2c7ab None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:18.234392 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:18.271593 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f1542-1521-4a81-b2ec-20a268f2c7ab None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:18.304613 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558790a2-6663-4929-8616-a6089f8fafdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:18.305229 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558790a2-6663-4929-8616-a6089f8fafdf None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:18.305506 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558790a2-6663-4929-8616-a6089f8fafdf None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:18.305775 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558790a2-6663-4929-8616-a6089f8fafdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:18.315429 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558790a2-6663-4929-8616-a6089f8fafdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:18.316994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558790a2-6663-4929-8616-a6089f8fafdf None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:18.331433 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-558790a2-6663-4929-8616-a6089f8fafdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:18.331433 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:18.331433 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:18.331433 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:18.331433 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:18.331433 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:18.331433 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:18.331433 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:18.331433 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:18.331433 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:18.331433 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:18.331433 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:18.331433 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 19:08:18.331433 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 19:08:18.331433 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 19:08:18.331433 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 19:08:18.332643 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:18.332643 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:18.332643 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:18.332643 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:18.332643 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:18.332643 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:18.332643 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:18.332643 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:18.332643 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:18.332643 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:18.332643 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:18.332643 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:18.332643 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:18.332643 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:18.332643 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:18.332643 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:18.332643 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 19:08:18.333936 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 19:08:18.333936 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 19:08:18.333936 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:08:18.333936 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 644/1283] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:08:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:18.338383 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e951bc-2fed-4b4a-b412-c50b07addc5b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:18.435174 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e951bc-2fed-4b4a-b412-c50b07addc5b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:18.469874 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c27586-6907-416c-b573-f921d2a827b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:18.470491 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c27586-6907-416c-b573-f921d2a827b7 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:18.470781 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c27586-6907-416c-b573-f921d2a827b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:18.471055 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c27586-6907-416c-b573-f921d2a827b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:18.471955 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c27586-6907-416c-b573-f921d2a827b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:18.472255 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c27586-6907-416c-b573-f921d2a827b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:18.473607 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c27586-6907-416c-b573-f921d2a827b7 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:18.485120 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 640/1284] 10.222.0.79 () {56 vars in 1109 bytes} [Wed Aug 31 19:08:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:18.490827 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558790a2-6663-4929-8616-a6089f8fafdf None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:18.589969 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558790a2-6663-4929-8616-a6089f8fafdf None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:18.603937 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:18.624636 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188a1a9-0eb2-416c-841d-9b88e9d8bb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:18.625257 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188a1a9-0eb2-416c-841d-9b88e9d8bb26 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:18.625537 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188a1a9-0eb2-416c-841d-9b88e9d8bb26 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:18.625810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188a1a9-0eb2-416c-841d-9b88e9d8bb26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:18.632282 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c188a1a9-0eb2-416c-841d-9b88e9d8bb26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:18.633714 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c188a1a9-0eb2-416c-841d-9b88e9d8bb26 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:18.645296 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-c188a1a9-0eb2-416c-841d-9b88e9d8bb26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:18.645296 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:18.645296 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:18.645296 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:18.645296 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:18.645296 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:18.645296 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:18.645296 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:18.645296 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:18.645296 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:18.645296 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:18.645296 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:18.645296 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 19:08:18.645296 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 19:08:18.645296 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 19:08:18.646345 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 19:08:18.646345 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:18.646345 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:18.646345 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:18.646345 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:18.646345 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:18.646345 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:18.646345 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:18.646345 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:18.646345 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:18.646345 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:18.646345 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:18.646345 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:18.646345 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:18.646345 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:18.646345 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:18.646345 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:18.647535 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 19:08:18.647535 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 19:08:18.647535 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 19:08:18.647535 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 19:08:18.647535 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 19:08:18.647535 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 19:08:18.647535 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 19:08:18.647535 dv-cinder-852210-6-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Aug 31 19:08:18.647535 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 645/1285] 10.222.0.79 () {56 vars in 1111 bytes} [Wed Aug 31 19:08:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:18.652325 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c27586-6907-416c-b573-f921d2a827b7 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:18.700283 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:18.749317 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c27586-6907-416c-b573-f921d2a827b7 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:18.782013 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4e582-72d4-4afc-a330-7553007ecc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:18.782633 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4e582-72d4-4afc-a330-7553007ecc15 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:18.782911 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4e582-72d4-4afc-a330-7553007ecc15 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:18.783179 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4e582-72d4-4afc-a330-7553007ecc15 None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:18.783856 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec4e582-72d4-4afc-a330-7553007ecc15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:18.784154 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec4e582-72d4-4afc-a330-7553007ecc15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:18.785563 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec4e582-72d4-4afc-a330-7553007ecc15 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:18.797199 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 641/1286] 10.222.0.79 () {56 vars in 1148 bytes} [Wed Aug 31 19:08:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:18.803352 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188a1a9-0eb2-416c-841d-9b88e9d8bb26 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:18.902284 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188a1a9-0eb2-416c-841d-9b88e9d8bb26 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:18.937561 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d87f19-fe2f-449b-8b3c-161c69e15236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:18.938152 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d87f19-fe2f-449b-8b3c-161c69e15236 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:18.938430 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d87f19-fe2f-449b-8b3c-161c69e15236 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:18.938818 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d87f19-fe2f-449b-8b3c-161c69e15236 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:18.939542 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d87f19-fe2f-449b-8b3c-161c69e15236 None admin] RBAC: Adding query filter params (role.id=edc551338adb4ae88bdafc591ad69582, scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507, user.id=ece00ea631594381bf1c27cfc2ece6f1) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:18.939849 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d87f19-fe2f-449b-8b3c-161c69e15236 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:18.941264 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d87f19-fe2f-449b-8b3c-161c69e15236 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:18.946908 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 646/1287] 10.222.0.79 () {56 vars in 1374 bytes} [Wed Aug 31 19:08:18 2022] GET /identity/v3/role_assignments?user.id=ece00ea631594381bf1c27cfc2ece6f1&scope.project.id=f9e550ea75dd4245bd9c2bcd6322c507&role.id=edc551338adb4ae88bdafc591ad69582 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:20.852848 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed4202-0b04-406f-b598-1f06cc227f15 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:20.853402 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed4202-0b04-406f-b598-1f06cc227f15 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:20.853402 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed4202-0b04-406f-b598-1f06cc227f15 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:20.854771 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 642/1288] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:20.860615 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b68a89-3724-4b38-bb8a-7bc70ff8dbdc None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:20.861044 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b68a89-3724-4b38-bb8a-7bc70ff8dbdc None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:20.861146 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b68a89-3724-4b38-bb8a-7bc70ff8dbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:20.879554 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-09b68a89-3724-4b38-bb8a-7bc70ff8dbdc None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:20.880729 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-09b68a89-3724-4b38-bb8a-7bc70ff8dbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:20.912165 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:20.949474 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 647/1289] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:08:21.218599 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed4202-0b04-406f-b598-1f06cc227f15 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:21.316712 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed4202-0b04-406f-b598-1f06cc227f15 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:21.326871 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:21.350817 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f518eb-5a6a-4c02-a642-c5ad56f6f64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:21.351437 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f518eb-5a6a-4c02-a642-c5ad56f6f64b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:21.351717 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f518eb-5a6a-4c02-a642-c5ad56f6f64b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:21.351991 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f518eb-5a6a-4c02-a642-c5ad56f6f64b None admin] PATH_INFO: `/v3/services/placement` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:21.352567 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f518eb-5a6a-4c02-a642-c5ad56f6f64b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:21.353922 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f518eb-5a6a-4c02-a642-c5ad56f6f64b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:21.363478 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-28f518eb-5a6a-4c02-a642-c5ad56f6f64b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 19:08:21.363478 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:21.363478 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:08:21.363478 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:08:21.363478 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:08:21.363478 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:08:21.363478 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:08:21.363478 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:21.363478 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 19:08:21.363478 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:08:21.363478 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:08:21.363478 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:08:21.363478 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:21.363478 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:21.363478 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:21.363478 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:21.363478 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:21.364706 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:21.364706 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:21.364706 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:21.364706 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:21.364706 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:21.364706 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:21.364706 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:08:21.364706 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:08:21.364706 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:08:21.364706 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:08:21.364706 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:21.364706 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:21.364706 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:21.364706 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:21.364706 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:21.364706 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:21.365749 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:21.365749 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:21.365749 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:21.365749 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:21.365749 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:21.365749 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:21.365749 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:21.365749 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:21.365749 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:21.365749 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:21.365749 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:08:21.365749 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:21.365749 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 19:08:21.365749 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:08:21.365749 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 643/1290] 10.222.0.79 () {56 vars in 1117 bytes} [Wed Aug 31 19:08:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:21.370682 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b68a89-3724-4b38-bb8a-7bc70ff8dbdc None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:21.465872 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b68a89-3724-4b38-bb8a-7bc70ff8dbdc None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:21.499704 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5abd4-a82d-4805-bbfa-82769be5c93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:21.500240 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5abd4-a82d-4805-bbfa-82769be5c93e None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:21.500520 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5abd4-a82d-4805-bbfa-82769be5c93e None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:21.500793 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5abd4-a82d-4805-bbfa-82769be5c93e None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:21.501416 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a5abd4-a82d-4805-bbfa-82769be5c93e None admin] RBAC: Adding query filter params (name=placement) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:21.501715 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a5abd4-a82d-4805-bbfa-82769be5c93e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:21.503099 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a5abd4-a82d-4805-bbfa-82769be5c93e None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:21.507743 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 648/1291] 10.222.0.79 () {56 vars in 1116 bytes} [Wed Aug 31 19:08:21 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:21.513437 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f518eb-5a6a-4c02-a642-c5ad56f6f64b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:21.611140 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f518eb-5a6a-4c02-a642-c5ad56f6f64b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:21.643011 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82a6bd-0bff-4b10-a34d-42d47baad639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:21.643603 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82a6bd-0bff-4b10-a34d-42d47baad639 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:21.643878 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82a6bd-0bff-4b10-a34d-42d47baad639 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:21.644146 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82a6bd-0bff-4b10-a34d-42d47baad639 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:21.644769 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e82a6bd-0bff-4b10-a34d-42d47baad639 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:21.645062 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e82a6bd-0bff-4b10-a34d-42d47baad639 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:21.646408 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e82a6bd-0bff-4b10-a34d-42d47baad639 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:21.650682 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 644/1292] 10.222.0.79 () {56 vars in 1116 bytes} [Wed Aug 31 19:08:21 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:23.539126 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a17b16-92b8-496f-8a5a-1866ab7ec125 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:23.539520 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a17b16-92b8-496f-8a5a-1866ab7ec125 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:23.539663 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a17b16-92b8-496f-8a5a-1866ab7ec125 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:23.540999 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 649/1293] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:23.546306 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe43db-e29f-4cb2-b941-b41f1ee60fbd None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:23.546769 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe43db-e29f-4cb2-b941-b41f1ee60fbd None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:23.546876 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe43db-e29f-4cb2-b941-b41f1ee60fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:23.565273 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-3efe43db-e29f-4cb2-b941-b41f1ee60fbd None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:23.566450 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3efe43db-e29f-4cb2-b941-b41f1ee60fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:23.595634 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:23.632334 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 645/1294] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:08:23.901642 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a17b16-92b8-496f-8a5a-1866ab7ec125 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:23.942341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:24.017217 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a17b16-92b8-496f-8a5a-1866ab7ec125 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:24.050041 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb287cb6-91d8-49fb-908b-52557d04b9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:24.050664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb287cb6-91d8-49fb-908b-52557d04b9bc None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:24.050946 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb287cb6-91d8-49fb-908b-52557d04b9bc None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:24.051219 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb287cb6-91d8-49fb-908b-52557d04b9bc None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:24.051854 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb287cb6-91d8-49fb-908b-52557d04b9bc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:24.053200 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb287cb6-91d8-49fb-908b-52557d04b9bc None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:24.067776 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 650/1295] 10.222.0.79 () {60 vars in 1141 bytes} [Wed Aug 31 19:08:23 2022] POST /identity/v3/services => generated 246 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:08:25.952017 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cff46-34a2-42ee-9eda-8676fb4b1c91 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:25.952557 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cff46-34a2-42ee-9eda-8676fb4b1c91 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:25.952557 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cff46-34a2-42ee-9eda-8676fb4b1c91 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:25.953917 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 646/1296] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:25.958921 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ec840-d03f-4b95-b547-47de3243ce66 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:25.959361 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ec840-d03f-4b95-b547-47de3243ce66 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:25.959456 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ec840-d03f-4b95-b547-47de3243ce66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:25.978033 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-231ec840-d03f-4b95-b547-47de3243ce66 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:25.979244 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-231ec840-d03f-4b95-b547-47de3243ce66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:26.050688 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 651/1297] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:25 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:08:26.312673 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8cff46-34a2-42ee-9eda-8676fb4b1c91 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:26.412307 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8cff46-34a2-42ee-9eda-8676fb4b1c91 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:26.445417 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26062f29-1707-46ca-82b3-4e953d85873b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:26.446033 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26062f29-1707-46ca-82b3-4e953d85873b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:26.446307 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26062f29-1707-46ca-82b3-4e953d85873b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:26.446603 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26062f29-1707-46ca-82b3-4e953d85873b None admin] PATH_INFO: `/v3/services/placement` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:26.447179 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26062f29-1707-46ca-82b3-4e953d85873b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:26.448520 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26062f29-1707-46ca-82b3-4e953d85873b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:26.457685 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-26062f29-1707-46ca-82b3-4e953d85873b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 19:08:26.457685 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:26.457685 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:08:26.457685 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:08:26.457685 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:08:26.457685 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:08:26.457685 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:08:26.457685 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:26.457685 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 19:08:26.457685 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:08:26.457685 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:08:26.457685 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:08:26.457685 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:26.457685 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:26.457685 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:26.457685 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:26.457685 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:26.458894 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:26.458894 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:26.458894 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:26.458894 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:26.458894 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:26.458894 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:26.458894 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:08:26.458894 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:08:26.458894 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:08:26.458894 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:08:26.458894 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:26.458894 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:26.458894 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:26.458894 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:26.458894 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:26.458894 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:26.459742 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:26.459742 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:26.459742 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:26.459742 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:26.459742 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:26.459742 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:26.459742 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:26.459742 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:26.459742 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:26.459742 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:26.459742 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:08:26.459742 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:26.459742 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 19:08:26.459742 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:08:26.459742 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 647/1298] 10.222.0.79 () {56 vars in 1117 bytes} [Wed Aug 31 19:08:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:26.464960 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ec840-d03f-4b95-b547-47de3243ce66 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:26.483567 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:26.563949 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ec840-d03f-4b95-b547-47de3243ce66 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:26.597244 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b27aa3-cefd-4922-b4ed-86d980e98791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:26.597849 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b27aa3-cefd-4922-b4ed-86d980e98791 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:26.598128 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b27aa3-cefd-4922-b4ed-86d980e98791 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:26.598401 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b27aa3-cefd-4922-b4ed-86d980e98791 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:26.599065 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b27aa3-cefd-4922-b4ed-86d980e98791 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:26.599367 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b27aa3-cefd-4922-b4ed-86d980e98791 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:26.600738 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b27aa3-cefd-4922-b4ed-86d980e98791 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:26.605882 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 652/1299] 10.222.0.79 () {56 vars in 1116 bytes} [Wed Aug 31 19:08:26 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:26.611943 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26062f29-1707-46ca-82b3-4e953d85873b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:26.644475 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:26.711743 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26062f29-1707-46ca-82b3-4e953d85873b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:26.743423 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e80e9a-55d9-432f-93ba-b45243c2fea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:26.744016 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e80e9a-55d9-432f-93ba-b45243c2fea4 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:26.744292 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e80e9a-55d9-432f-93ba-b45243c2fea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:26.744560 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e80e9a-55d9-432f-93ba-b45243c2fea4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:26.745250 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e80e9a-55d9-432f-93ba-b45243c2fea4 None admin] RBAC: Adding query filter params (interface=public, service_id=3ee72a24f52f4457aebe98aabdc81e8c, region_id=RegionOne) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:26.745550 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e80e9a-55d9-432f-93ba-b45243c2fea4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:26.746933 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e80e9a-55d9-432f-93ba-b45243c2fea4 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:26.752248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 648/1300] 10.222.0.79 () {56 vars in 1251 bytes} [Wed Aug 31 19:08:26 2022] GET /identity/v3/endpoints?service_id=3ee72a24f52f4457aebe98aabdc81e8c&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:26.757828 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b27aa3-cefd-4922-b4ed-86d980e98791 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:26.836266 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:26.854303 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b27aa3-cefd-4922-b4ed-86d980e98791 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:26.887808 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144d7d0-4b29-4c7f-a369-69902ac8b9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:26.888392 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144d7d0-4b29-4c7f-a369-69902ac8b9f6 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:26.888665 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144d7d0-4b29-4c7f-a369-69902ac8b9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:26.888932 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144d7d0-4b29-4c7f-a369-69902ac8b9f6 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:26.889523 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144d7d0-4b29-4c7f-a369-69902ac8b9f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:26.890886 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144d7d0-4b29-4c7f-a369-69902ac8b9f6 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:26.897490 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 653/1301] 10.222.0.79 () {56 vars in 1087 bytes} [Wed Aug 31 19:08:26 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:08:28.775126 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b3381-9685-4ff0-8849-3bc9f6305f15 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:28.775677 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b3381-9685-4ff0-8849-3bc9f6305f15 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:28.775677 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b3381-9685-4ff0-8849-3bc9f6305f15 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:28.776998 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 649/1302] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:08:28.783674 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e9830-9c5a-4ff1-9c04-489d24a4c224 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:28.784114 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e9830-9c5a-4ff1-9c04-489d24a4c224 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:28.784223 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e9830-9c5a-4ff1-9c04-489d24a4c224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:28.801947 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-da2e9830-9c5a-4ff1-9c04-489d24a4c224 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:08:28.803079 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-da2e9830-9c5a-4ff1-9c04-489d24a4c224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:08:28.866291 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 654/1303] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:08:28 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 19:08:29.155417 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b3381-9685-4ff0-8849-3bc9f6305f15 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:29.249903 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:29.257015 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b3381-9685-4ff0-8849-3bc9f6305f15 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:29.289384 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6caaa-3a27-4319-ad22-9ddf9426079a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:29.290001 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6caaa-3a27-4319-ad22-9ddf9426079a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:29.290275 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6caaa-3a27-4319-ad22-9ddf9426079a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:29.290574 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6caaa-3a27-4319-ad22-9ddf9426079a None admin] PATH_INFO: `/v3/services/placement` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:29.291141 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f6caaa-3a27-4319-ad22-9ddf9426079a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:29.292486 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f6caaa-3a27-4319-ad22-9ddf9426079a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:29.301434 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-d9f6caaa-3a27-4319-ad22-9ddf9426079a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 19:08:29.301434 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:29.301434 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 19:08:29.301434 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 19:08:29.301434 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 19:08:29.301434 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 19:08:29.301434 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 19:08:29.301434 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:29.301434 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 19:08:29.301434 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:08:29.301434 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 19:08:29.301434 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:08:29.301434 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 19:08:29.301434 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 19:08:29.301434 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 19:08:29.301434 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 19:08:29.301434 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 19:08:29.302732 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 19:08:29.302732 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 19:08:29.302732 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 19:08:29.302732 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 19:08:29.302732 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 19:08:29.302732 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 19:08:29.302732 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 19:08:29.302732 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 19:08:29.302732 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 19:08:29.302732 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 19:08:29.302732 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 19:08:29.302732 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 19:08:29.302732 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 19:08:29.302732 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 19:08:29.302732 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 19:08:29.302732 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 19:08:29.303853 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 19:08:29.303853 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Aug 31 19:08:29.303853 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 19:08:29.303853 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Aug 31 19:08:29.303853 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 19:08:29.303853 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 19:08:29.303853 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 19:08:29.303853 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Aug 31 19:08:29.303853 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 19:08:29.303853 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Aug 31 19:08:29.303853 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 19:08:29.303853 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 19:08:29.303853 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 19:08:29.303853 dv-cinder-852210-6-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Aug 31 19:08:29.303853 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 650/1304] 10.222.0.79 () {56 vars in 1117 bytes} [Wed Aug 31 19:08:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 19:08:29.308547 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e9830-9c5a-4ff1-9c04-489d24a4c224 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:29.382756 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:29.407467 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e9830-9c5a-4ff1-9c04-489d24a4c224 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:29.440946 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a6f7b-b9b9-43de-b162-57e3f56c6213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:29.441543 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a6f7b-b9b9-43de-b162-57e3f56c6213 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:29.441821 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a6f7b-b9b9-43de-b162-57e3f56c6213 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:29.442092 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a6f7b-b9b9-43de-b162-57e3f56c6213 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:29.442757 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a6f7b-b9b9-43de-b162-57e3f56c6213 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:08:29.443055 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a6f7b-b9b9-43de-b162-57e3f56c6213 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:29.444400 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a6f7b-b9b9-43de-b162-57e3f56c6213 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:29.449320 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 655/1305] 10.222.0.79 () {56 vars in 1116 bytes} [Wed Aug 31 19:08:29 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:08:29.455086 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6caaa-3a27-4319-ad22-9ddf9426079a None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:08:29.552263 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6caaa-3a27-4319-ad22-9ddf9426079a None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:08:29.583858 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57495ea2-b15d-4943-bcdd-1c59a3b72ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:08:29.584450 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57495ea2-b15d-4943-bcdd-1c59a3b72ba0 None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:08:29.584726 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57495ea2-b15d-4943-bcdd-1c59a3b72ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:08:29.584996 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57495ea2-b15d-4943-bcdd-1c59a3b72ba0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:08:29.585662 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57495ea2-b15d-4943-bcdd-1c59a3b72ba0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:08:29.587052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57495ea2-b15d-4943-bcdd-1c59a3b72ba0 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:08:29.606315 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 651/1306] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:08:29 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:08:39.449449 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=30 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:08:39.602215 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:32.858351 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd34ac3-479c-4fdf-96ba-0008f3db4280 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:32.858351 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd34ac3-479c-4fdf-96ba-0008f3db4280 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:32.858351 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd34ac3-479c-4fdf-96ba-0008f3db4280 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:32.859902 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 656/1307] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:09:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:32.865743 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86568f2-f591-46ae-9504-5f86de7b862f None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:32.866189 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86568f2-f591-46ae-9504-5f86de7b862f None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:32.866493 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86568f2-f591-46ae-9504-5f86de7b862f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:33.002642 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-f86568f2-f591-46ae-9504-5f86de7b862f None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:33.004242 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f86568f2-f591-46ae-9504-5f86de7b862f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:33.117468 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 652/1308] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:09:33.414940 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce71547-420e-40ce-843e-d90d04d08d43 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:33.415456 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce71547-420e-40ce-843e-d90d04d08d43 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:33.415832 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce71547-420e-40ce-843e-d90d04d08d43 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:33.417937 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 657/1309] 10.222.0.79 () {54 vars in 965 bytes} [Wed Aug 31 19:09:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:33.424038 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a618cd8-967e-4407-b8a5-73d9249edc70 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:33.424438 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a618cd8-967e-4407-b8a5-73d9249edc70 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:33.424816 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a618cd8-967e-4407-b8a5-73d9249edc70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:33.517908 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-3a618cd8-967e-4407-b8a5-73d9249edc70 None None] MFA Rules not processed for user `a91998a2818444a595adc06f1f481fe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:33.519374 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3a618cd8-967e-4407-b8a5-73d9249edc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:33.548220 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:33.614930 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 653/1310] 10.222.0.79 () {58 vars in 1062 bytes} [Wed Aug 31 19:09:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:09:33.624397 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce71547-420e-40ce-843e-d90d04d08d43 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:33.626071 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-0ce71547-420e-40ce-843e-d90d04d08d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:33.751701 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce71547-420e-40ce-843e-d90d04d08d43 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:33.828492 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb35cd-d91e-4b75-b62c-3cae92801d09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:33.829104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb35cd-d91e-4b75-b62c-3cae92801d09 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:33.829381 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb35cd-d91e-4b75-b62c-3cae92801d09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:33.829651 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb35cd-d91e-4b75-b62c-3cae92801d09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:33.831259 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-c3eb35cd-d91e-4b75-b62c-3cae92801d09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:33.890949 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:33.949620 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb35cd-d91e-4b75-b62c-3cae92801d09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:33.951110 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb35cd-d91e-4b75-b62c-3cae92801d09 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:33.971370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 658/1311] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:09:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:09:36.167073 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3df475-28f0-46aa-83b3-3992eadbd3a2 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:36.167597 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3df475-28f0-46aa-83b3-3992eadbd3a2 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:36.167677 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3df475-28f0-46aa-83b3-3992eadbd3a2 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:36.169116 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 654/1312] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:36.174079 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49767fad-7f2e-4395-9b1c-665eafd3378d None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:36.174500 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49767fad-7f2e-4395-9b1c-665eafd3378d None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:36.174717 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49767fad-7f2e-4395-9b1c-665eafd3378d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:36.273355 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-49767fad-7f2e-4395-9b1c-665eafd3378d None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:36.274787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-49767fad-7f2e-4395-9b1c-665eafd3378d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:36.383550 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 659/1313] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:09:36.671515 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3df475-28f0-46aa-83b3-3992eadbd3a2 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:36.673053 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8d3df475-28f0-46aa-83b3-3992eadbd3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:36.778107 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3df475-28f0-46aa-83b3-3992eadbd3a2 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:36.850954 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:36.854658 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc181010-fe5e-41c1-95a3-969414b0882a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:36.855291 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc181010-fe5e-41c1-95a3-969414b0882a service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:36.855848 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc181010-fe5e-41c1-95a3-969414b0882a service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:36.856122 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc181010-fe5e-41c1-95a3-969414b0882a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:36.857977 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-dc181010-fe5e-41c1-95a3-969414b0882a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:36.968890 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc181010-fe5e-41c1-95a3-969414b0882a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:36.970325 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc181010-fe5e-41c1-95a3-969414b0882a service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:36.988897 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 655/1314] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:09:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:09:39.181039 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c893bf-e406-432b-bdbf-14ad83d0a876 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:39.182098 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c893bf-e406-432b-bdbf-14ad83d0a876 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:39.182098 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c893bf-e406-432b-bdbf-14ad83d0a876 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:39.183421 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 660/1315] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:09:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:39.188442 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032a06c-08f3-42ed-a916-2dc3016e2bf9 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:39.188872 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032a06c-08f3-42ed-a916-2dc3016e2bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:39.188969 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032a06c-08f3-42ed-a916-2dc3016e2bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:39.256349 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-6032a06c-08f3-42ed-a916-2dc3016e2bf9 None None] MFA Rules not processed for user `c9ec217226154f31b80930cdc63bd156`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:39.257581 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6032a06c-08f3-42ed-a916-2dc3016e2bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:39.309177 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:39.351946 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 656/1316] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:39 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:09:39.634163 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c893bf-e406-432b-bdbf-14ad83d0a876 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:39.635748 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-64c893bf-e406-432b-bdbf-14ad83d0a876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:39.645581 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:39.739256 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c893bf-e406-432b-bdbf-14ad83d0a876 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:39.810747 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f49cf-e0d3-4ddb-ba3e-bc29eeacfb50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:39.811275 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f49cf-e0d3-4ddb-ba3e-bc29eeacfb50 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:39.811553 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f49cf-e0d3-4ddb-ba3e-bc29eeacfb50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:39.811824 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f49cf-e0d3-4ddb-ba3e-bc29eeacfb50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:39.813423 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-c52f49cf-e0d3-4ddb-ba3e-bc29eeacfb50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:39.876849 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:39.924673 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f49cf-e0d3-4ddb-ba3e-bc29eeacfb50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:39.926103 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f49cf-e0d3-4ddb-ba3e-bc29eeacfb50 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:39.944204 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 661/1317] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:09:39 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:09:42.381518 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41e552-41aa-4e40-8536-b119b919be2d None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:42.382054 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41e552-41aa-4e40-8536-b119b919be2d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:42.382054 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41e552-41aa-4e40-8536-b119b919be2d None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:42.383452 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 657/1318] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:42.388613 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a541a-7a61-42b6-9f85-f2124c326660 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:42.389066 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a541a-7a61-42b6-9f85-f2124c326660 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:42.389180 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a541a-7a61-42b6-9f85-f2124c326660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:42.454130 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-1d2a541a-7a61-42b6-9f85-f2124c326660 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:42.455364 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1d2a541a-7a61-42b6-9f85-f2124c326660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:42.550022 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 662/1319] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:09:42.828359 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f41e552-41aa-4e40-8536-b119b919be2d None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:42.829888 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6f41e552-41aa-4e40-8536-b119b919be2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:42.932008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f41e552-41aa-4e40-8536-b119b919be2d None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:43.003616 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f34226-35e7-4389-88b4-52c8f589a955 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:43.004224 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f34226-35e7-4389-88b4-52c8f589a955 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:43.004500 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f34226-35e7-4389-88b4-52c8f589a955 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:43.004770 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f34226-35e7-4389-88b4-52c8f589a955 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:43.006351 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c2f34226-35e7-4389-88b4-52c8f589a955 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:43.014266 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:43.113139 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f34226-35e7-4389-88b4-52c8f589a955 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:43.114596 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f34226-35e7-4389-88b4-52c8f589a955 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:43.131927 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 658/1320] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:09:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:09:45.704986 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344da5f5-b875-4131-876d-dd4a36ec609f None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:45.705577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344da5f5-b875-4131-876d-dd4a36ec609f None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:45.705577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344da5f5-b875-4131-876d-dd4a36ec609f None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:45.706920 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 663/1321] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:09:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:45.712247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d714eed-31bb-42d8-a738-17cbad9efcdd None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:45.713742 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d714eed-31bb-42d8-a738-17cbad9efcdd None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:45.714044 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d714eed-31bb-42d8-a738-17cbad9efcdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:45.781294 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-2d714eed-31bb-42d8-a738-17cbad9efcdd None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:45.782540 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2d714eed-31bb-42d8-a738-17cbad9efcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:45.844176 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:45.885309 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 659/1322] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:09:46.176163 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344da5f5-b875-4131-876d-dd4a36ec609f None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:46.177699 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-344da5f5-b875-4131-876d-dd4a36ec609f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:46.196987 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:46.283089 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344da5f5-b875-4131-876d-dd4a36ec609f None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:46.357641 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c11fc2-dfe9-4ce1-82ba-7f880093a994 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:46.358252 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c11fc2-dfe9-4ce1-82ba-7f880093a994 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:46.358597 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c11fc2-dfe9-4ce1-82ba-7f880093a994 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:46.358872 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c11fc2-dfe9-4ce1-82ba-7f880093a994 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:46.360471 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-20c11fc2-dfe9-4ce1-82ba-7f880093a994 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:46.431201 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:46.469357 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c11fc2-dfe9-4ce1-82ba-7f880093a994 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:46.470823 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c11fc2-dfe9-4ce1-82ba-7f880093a994 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:46.489716 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 664/1323] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:09:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:09:48.480755 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08210d3e-46cb-4c4b-a05b-5efdb6f50e44 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:48.481267 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08210d3e-46cb-4c4b-a05b-5efdb6f50e44 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:48.481267 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08210d3e-46cb-4c4b-a05b-5efdb6f50e44 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:48.482673 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 660/1324] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:48.487917 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bee07-5643-4ab4-9899-a628e2a18cbc None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:48.488334 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bee07-5643-4ab4-9899-a628e2a18cbc None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:48.488463 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bee07-5643-4ab4-9899-a628e2a18cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:48.555969 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-cd3bee07-5643-4ab4-9899-a628e2a18cbc None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:48.557183 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-cd3bee07-5643-4ab4-9899-a628e2a18cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:48.651403 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 665/1325] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:09:48.929317 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08210d3e-46cb-4c4b-a05b-5efdb6f50e44 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:48.930867 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-08210d3e-46cb-4c4b-a05b-5efdb6f50e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:49.042385 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08210d3e-46cb-4c4b-a05b-5efdb6f50e44 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:49.116065 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb397e-cc3d-4e20-90a4-52e56fd37fc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:49.116898 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb397e-cc3d-4e20-90a4-52e56fd37fc0 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:49.117032 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb397e-cc3d-4e20-90a4-52e56fd37fc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:49.117211 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb397e-cc3d-4e20-90a4-52e56fd37fc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:49.118869 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a3eb397e-cc3d-4e20-90a4-52e56fd37fc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:49.136842 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:49.234341 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eb397e-cc3d-4e20-90a4-52e56fd37fc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:49.235820 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eb397e-cc3d-4e20-90a4-52e56fd37fc0 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:49.254369 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 661/1326] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:09:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:09:51.226200 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081eff84-abf6-4404-bd5c-2fd5a74affe9 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:51.226821 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081eff84-abf6-4404-bd5c-2fd5a74affe9 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:51.226821 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081eff84-abf6-4404-bd5c-2fd5a74affe9 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:51.228141 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 666/1327] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:51.234024 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205ca1b-37a2-4ab1-88f5-bcfaf34bc8b1 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:51.234602 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205ca1b-37a2-4ab1-88f5-bcfaf34bc8b1 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:51.234602 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205ca1b-37a2-4ab1-88f5-bcfaf34bc8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:51.300991 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-3205ca1b-37a2-4ab1-88f5-bcfaf34bc8b1 None None] MFA Rules not processed for user `c9ec217226154f31b80930cdc63bd156`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:51.302181 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3205ca1b-37a2-4ab1-88f5-bcfaf34bc8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:51.371083 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:51.408129 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 662/1328] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:51 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:09:51.696230 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081eff84-abf6-4404-bd5c-2fd5a74affe9 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:51.698329 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-081eff84-abf6-4404-bd5c-2fd5a74affe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:51.734165 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:51.807241 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081eff84-abf6-4404-bd5c-2fd5a74affe9 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:51.880100 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e753f44-d6c2-42c3-8b17-f46944ee1289 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:51.880642 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e753f44-d6c2-42c3-8b17-f46944ee1289 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:51.880914 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e753f44-d6c2-42c3-8b17-f46944ee1289 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:51.881181 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e753f44-d6c2-42c3-8b17-f46944ee1289 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:51.882845 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1e753f44-d6c2-42c3-8b17-f46944ee1289 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:51.958119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:51.990909 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e753f44-d6c2-42c3-8b17-f46944ee1289 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:51.992355 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e753f44-d6c2-42c3-8b17-f46944ee1289 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:52.010902 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 667/1329] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:09:51 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:09:54.164148 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fe21f-3b24-496a-a74f-da6199a895f9 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:54.164720 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fe21f-3b24-496a-a74f-da6199a895f9 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:54.164720 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fe21f-3b24-496a-a74f-da6199a895f9 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:54.166773 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 663/1330] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:09:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:54.171914 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b318b5-dcfe-4d6f-94e4-6f8cc3273d2b None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:54.172369 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b318b5-dcfe-4d6f-94e4-6f8cc3273d2b None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:54.172481 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b318b5-dcfe-4d6f-94e4-6f8cc3273d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:54.238694 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-f2b318b5-dcfe-4d6f-94e4-6f8cc3273d2b None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:54.239890 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f2b318b5-dcfe-4d6f-94e4-6f8cc3273d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:54.338173 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 668/1331] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:09:54.619113 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531fe21f-3b24-496a-a74f-da6199a895f9 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:54.620647 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-531fe21f-3b24-496a-a74f-da6199a895f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:54.724570 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531fe21f-3b24-496a-a74f-da6199a895f9 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:54.796000 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2ac73-648e-4786-aa10-4b6cf565d326 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:54.796596 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2ac73-648e-4786-aa10-4b6cf565d326 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:54.796871 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2ac73-648e-4786-aa10-4b6cf565d326 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:54.797148 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2ac73-648e-4786-aa10-4b6cf565d326 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:54.798735 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8ed2ac73-648e-4786-aa10-4b6cf565d326 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:54.825508 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:54.906134 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2ac73-648e-4786-aa10-4b6cf565d326 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:54.907822 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2ac73-648e-4786-aa10-4b6cf565d326 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:54.925996 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 664/1332] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:09:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:09:56.849152 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e8b15-3e75-47bd-b19a-05cd5a878133 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:56.849717 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e8b15-3e75-47bd-b19a-05cd5a878133 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:56.849717 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e8b15-3e75-47bd-b19a-05cd5a878133 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:56.851063 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 669/1333] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:56.856777 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1a96d-1e1e-40a3-8fc6-27f397b7aa82 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:56.857224 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1a96d-1e1e-40a3-8fc6-27f397b7aa82 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:56.857340 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1a96d-1e1e-40a3-8fc6-27f397b7aa82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:56.925757 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-24b1a96d-1e1e-40a3-8fc6-27f397b7aa82 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:56.926985 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-24b1a96d-1e1e-40a3-8fc6-27f397b7aa82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:57.000492 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:57.022798 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 665/1334] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:09:57.306858 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e8b15-3e75-47bd-b19a-05cd5a878133 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:09:57.308404 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1d4e8b15-3e75-47bd-b19a-05cd5a878133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:57.349606 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:57.414640 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e8b15-3e75-47bd-b19a-05cd5a878133 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:09:57.487875 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925a182-5e28-41e0-9a2e-d923c0508734 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:09:57.488522 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925a182-5e28-41e0-9a2e-d923c0508734 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:57.488796 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925a182-5e28-41e0-9a2e-d923c0508734 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:57.489065 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925a182-5e28-41e0-9a2e-d923c0508734 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:57.490716 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-5925a182-5e28-41e0-9a2e-d923c0508734 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:09:57.573713 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:09:57.599350 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925a182-5e28-41e0-9a2e-d923c0508734 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:09:57.600773 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925a182-5e28-41e0-9a2e-d923c0508734 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:09:57.618246 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 670/1335] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:09:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:09:59.859820 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba9017-e442-4245-a717-66caae887c24 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:59.860375 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba9017-e442-4245-a717-66caae887c24 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:59.860375 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba9017-e442-4245-a717-66caae887c24 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:59.861713 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 666/1336] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:09:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:09:59.866741 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8383358-7ece-40fd-9817-3458182b2276 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:09:59.867160 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8383358-7ece-40fd-9817-3458182b2276 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:09:59.867295 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8383358-7ece-40fd-9817-3458182b2276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:09:59.935410 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-f8383358-7ece-40fd-9817-3458182b2276 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:09:59.936614 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f8383358-7ece-40fd-9817-3458182b2276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:00.033976 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 671/1337] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:09:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:10:00.315172 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba9017-e442-4245-a717-66caae887c24 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:00.316703 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-acba9017-e442-4245-a717-66caae887c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:00.419607 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba9017-e442-4245-a717-66caae887c24 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:00.491610 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a84b4e-4014-4f5a-9e6c-b36c9f410e13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:00.492216 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a84b4e-4014-4f5a-9e6c-b36c9f410e13 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:00.492494 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a84b4e-4014-4f5a-9e6c-b36c9f410e13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:00.492764 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a84b4e-4014-4f5a-9e6c-b36c9f410e13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:00.494388 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-61a84b4e-4014-4f5a-9e6c-b36c9f410e13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:00.531162 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:00.604886 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a84b4e-4014-4f5a-9e6c-b36c9f410e13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:00.606414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a84b4e-4014-4f5a-9e6c-b36c9f410e13 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:00.624995 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 667/1338] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:10:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:10:04.439830 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3ebbd-d201-40d8-868c-dd58ffc03a58 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:04.440435 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3ebbd-d201-40d8-868c-dd58ffc03a58 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:04.440435 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3ebbd-d201-40d8-868c-dd58ffc03a58 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:04.441678 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 672/1339] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:10:04.447275 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632f7f6-6810-49c0-9400-ef1e4c943a14 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:04.447707 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632f7f6-6810-49c0-9400-ef1e4c943a14 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:04.447962 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632f7f6-6810-49c0-9400-ef1e4c943a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:04.515555 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-d632f7f6-6810-49c0-9400-ef1e4c943a14 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:10:04.516763 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d632f7f6-6810-49c0-9400-ef1e4c943a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:04.609461 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:04.622394 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 668/1340] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:10:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:10:04.922021 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcaad50-a013-4678-bc36-c014ca34057c None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:04.922291 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcaad50-a013-4678-bc36-c014ca34057c None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:04.922658 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcaad50-a013-4678-bc36-c014ca34057c None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:04.924002 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 673/1341] 10.222.0.79 () {54 vars in 965 bytes} [Wed Aug 31 19:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:10:04.930575 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcd7db-072d-4346-84d4-ee34f627ec7c None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:04.930860 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcd7db-072d-4346-84d4-ee34f627ec7c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:04.931132 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcd7db-072d-4346-84d4-ee34f627ec7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:05.013158 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-9ebcd7db-072d-4346-84d4-ee34f627ec7c None None] MFA Rules not processed for user `a91998a2818444a595adc06f1f481fe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:10:05.014385 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9ebcd7db-072d-4346-84d4-ee34f627ec7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:05.093305 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 669/1342] 10.222.0.79 () {58 vars in 1062 bytes} [Wed Aug 31 19:10:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:10:05.102609 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcaad50-a013-4678-bc36-c014ca34057c None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:05.104188 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-6fcaad50-a013-4678-bc36-c014ca34057c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:05.160410 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:05.219340 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcaad50-a013-4678-bc36-c014ca34057c None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:05.295456 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d663afe8-1ad2-488f-9313-30adeb66c9ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:05.296079 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663afe8-1ad2-488f-9313-30adeb66c9ef service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:05.296352 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663afe8-1ad2-488f-9313-30adeb66c9ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:05.296621 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663afe8-1ad2-488f-9313-30adeb66c9ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:05.298226 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d663afe8-1ad2-488f-9313-30adeb66c9ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:05.396377 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:05.413634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d663afe8-1ad2-488f-9313-30adeb66c9ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:05.415047 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d663afe8-1ad2-488f-9313-30adeb66c9ef service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:05.433740 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 674/1343] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:10:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:10:08.542401 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660148f-348d-4b33-b846-91498da15693 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:08.542828 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660148f-348d-4b33-b846-91498da15693 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:08.542991 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660148f-348d-4b33-b846-91498da15693 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:08.544393 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 670/1344] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:10:08.549602 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbe748-481e-4165-8bf1-1f53c19ab6d9 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:08.550021 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbe748-481e-4165-8bf1-1f53c19ab6d9 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:08.550152 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbe748-481e-4165-8bf1-1f53c19ab6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:08.616209 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-c0cbe748-481e-4165-8bf1-1f53c19ab6d9 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:10:08.617393 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-c0cbe748-481e-4165-8bf1-1f53c19ab6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:08.717903 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 675/1345] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:10:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:10:08.997186 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5660148f-348d-4b33-b846-91498da15693 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:08.998978 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5660148f-348d-4b33-b846-91498da15693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:09.088718 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:09.107099 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5660148f-348d-4b33-b846-91498da15693 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:09.198722 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf32183-a09e-44d6-841c-9222d451b85c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:09.199329 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf32183-a09e-44d6-841c-9222d451b85c service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:09.199610 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf32183-a09e-44d6-841c-9222d451b85c service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:09.199884 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf32183-a09e-44d6-841c-9222d451b85c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:09.201468 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0bf32183-a09e-44d6-841c-9222d451b85c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:09.321467 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf32183-a09e-44d6-841c-9222d451b85c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:09.322967 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf32183-a09e-44d6-841c-9222d451b85c service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:09.342108 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 671/1346] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:10:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:10:13.463643 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f5505-d354-4495-9d01-b99782b9e7ba None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:13.464202 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f5505-d354-4495-9d01-b99782b9e7ba None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:13.464202 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f5505-d354-4495-9d01-b99782b9e7ba None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:13.465514 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 676/1347] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:10:13.471183 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d3ec7-2d74-4d7f-a0ab-cba1be76870d None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:13.471640 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d3ec7-2d74-4d7f-a0ab-cba1be76870d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:13.471737 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d3ec7-2d74-4d7f-a0ab-cba1be76870d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:13.488114 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:13.544652 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-9a4d3ec7-2d74-4d7f-a0ab-cba1be76870d None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:10:13.545870 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9a4d3ec7-2d74-4d7f-a0ab-cba1be76870d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:13.652608 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 672/1348] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:10:13.934405 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f5505-d354-4495-9d01-b99782b9e7ba None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:13.936012 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-5b7f5505-d354-4495-9d01-b99782b9e7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:13.996045 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:14.041899 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f5505-d354-4495-9d01-b99782b9e7ba None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:14.114398 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbee3e-f3ef-48bf-bded-c3a0b9702f67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:14.114960 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbee3e-f3ef-48bf-bded-c3a0b9702f67 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:14.115302 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbee3e-f3ef-48bf-bded-c3a0b9702f67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:14.115739 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbee3e-f3ef-48bf-bded-c3a0b9702f67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:14.117092 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-8ecbee3e-f3ef-48bf-bded-c3a0b9702f67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:14.220700 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:14.225007 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecbee3e-f3ef-48bf-bded-c3a0b9702f67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:14.226472 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecbee3e-f3ef-48bf-bded-c3a0b9702f67 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:14.244777 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 677/1349] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:10:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:10:19.083351 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd802e56-0fe8-4dc7-9604-4d2dac4597da None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:19.083351 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd802e56-0fe8-4dc7-9604-4d2dac4597da None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:19.084363 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd802e56-0fe8-4dc7-9604-4d2dac4597da None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:19.085055 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 673/1350] 10.222.0.79 () {54 vars in 921 bytes} [Wed Aug 31 19:10:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:10:19.090499 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e2163-a621-4be2-9424-b25203a57d67 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:19.090946 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e2163-a621-4be2-9424-b25203a57d67 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:19.091033 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e2163-a621-4be2-9424-b25203a57d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:19.193277 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-1f9e2163-a621-4be2-9424-b25203a57d67 None None] MFA Rules not processed for user `ece00ea631594381bf1c27cfc2ece6f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:10:19.196506 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1f9e2163-a621-4be2-9424-b25203a57d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:19.344555 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 678/1351] 10.222.0.79 () {58 vars in 1018 bytes} [Wed Aug 31 19:10:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:10:23.545891 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f553e4b-de36-46e7-8c63-5363abf5030e None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:23.546436 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f553e4b-de36-46e7-8c63-5363abf5030e None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:23.546714 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f553e4b-de36-46e7-8c63-5363abf5030e None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:23.548182 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 674/1352] 10.222.0.79 () {54 vars in 921 bytes} [Wed Aug 31 19:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:10:23.553631 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e88a19-b9c8-4528-8f03-af6557b3dfdd None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:23.554100 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e88a19-b9c8-4528-8f03-af6557b3dfdd None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:23.554184 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e88a19-b9c8-4528-8f03-af6557b3dfdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:23.610224 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:23.635283 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-98e88a19-b9c8-4528-8f03-af6557b3dfdd None None] MFA Rules not processed for user `ece00ea631594381bf1c27cfc2ece6f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:10:23.636481 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-98e88a19-b9c8-4528-8f03-af6557b3dfdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:23.651053 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=59 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:23.756549 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 679/1353] 10.222.0.79 () {58 vars in 1018 bytes} [Wed Aug 31 19:10:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:10:25.260203 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be3cca-f6c7-44fa-8cd3-56178a1bf764 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:25.260799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be3cca-f6c7-44fa-8cd3-56178a1bf764 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:25.260799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be3cca-f6c7-44fa-8cd3-56178a1bf764 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:25.262182 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 675/1354] 10.222.0.79 () {54 vars in 921 bytes} [Wed Aug 31 19:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:10:25.267553 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5efe36-d711-493b-bd36-ae7089b87632 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:25.268033 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5efe36-d711-493b-bd36-ae7089b87632 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:25.268128 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5efe36-d711-493b-bd36-ae7089b87632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:25.351724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-1e5efe36-d711-493b-bd36-ae7089b87632 None None] MFA Rules not processed for user `ece00ea631594381bf1c27cfc2ece6f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:10:25.353554 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1e5efe36-d711-493b-bd36-ae7089b87632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:25.399675 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:25.468520 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 680/1355] 10.222.0.79 () {58 vars in 1018 bytes} [Wed Aug 31 19:10:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:10:28.827878 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f22ec-4cea-4f23-9c87-7a9e0a73e7ab None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:28.827878 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f22ec-4cea-4f23-9c87-7a9e0a73e7ab None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:28.828465 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f22ec-4cea-4f23-9c87-7a9e0a73e7ab None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:28.831876 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 676/1356] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:10:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:10:28.836268 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd755f-d4c9-4ca0-a85b-34132c09d5d5 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:28.836740 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd755f-d4c9-4ca0-a85b-34132c09d5d5 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:28.836821 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd755f-d4c9-4ca0-a85b-34132c09d5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:28.922755 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-5afd755f-d4c9-4ca0-a85b-34132c09d5d5 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:10:28.925425 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-5afd755f-d4c9-4ca0-a85b-34132c09d5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:29.047546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 681/1357] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:10:29.346657 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205d05c-08cf-46e0-bb15-8a3fe2ffa693 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:29.347387 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205d05c-08cf-46e0-bb15-8a3fe2ffa693 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:29.347916 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205d05c-08cf-46e0-bb15-8a3fe2ffa693 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:29.349745 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 677/1358] 10.222.0.79 () {54 vars in 962 bytes} [Wed Aug 31 19:10:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:10:29.358564 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213bc5fa-40c0-419d-8028-eaa1d5dd1312 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:29.359084 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213bc5fa-40c0-419d-8028-eaa1d5dd1312 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:29.359537 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213bc5fa-40c0-419d-8028-eaa1d5dd1312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:29.384795 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:29.451206 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-213bc5fa-40c0-419d-8028-eaa1d5dd1312 None None] MFA Rules not processed for user `1fd6d45d1bc3479da72cb1a1990a6137`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:10:29.452426 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-213bc5fa-40c0-419d-8028-eaa1d5dd1312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:29.579259 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 682/1359] 10.222.0.79 () {58 vars in 1059 bytes} [Wed Aug 31 19:10:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:10:29.587366 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205d05c-08cf-46e0-bb15-8a3fe2ffa693 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:29.589003 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5205d05c-08cf-46e0-bb15-8a3fe2ffa693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:29.763150 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205d05c-08cf-46e0-bb15-8a3fe2ffa693 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:29.848550 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:29.891000 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756adf7-1976-4c51-a0d0-c31b9f3b8932 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:29.891615 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756adf7-1976-4c51-a0d0-c31b9f3b8932 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:29.891943 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756adf7-1976-4c51-a0d0-c31b9f3b8932 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:29.892216 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756adf7-1976-4c51-a0d0-c31b9f3b8932 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:29.893833 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b756adf7-1976-4c51-a0d0-c31b9f3b8932 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:30.011148 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b756adf7-1976-4c51-a0d0-c31b9f3b8932 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:30.013609 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b756adf7-1976-4c51-a0d0-c31b9f3b8932 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:30.040145 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 678/1360] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:10:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:10:32.259938 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6b9a1-3e0e-4661-8d46-d0014baf6a05 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:32.260450 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6b9a1-3e0e-4661-8d46-d0014baf6a05 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:32.260450 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6b9a1-3e0e-4661-8d46-d0014baf6a05 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:32.261933 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 683/1361] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:10:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:10:32.267001 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356880c-b04e-44b8-ae01-4fff09eaaf1b None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:32.267422 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356880c-b04e-44b8-ae01-4fff09eaaf1b None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:32.267552 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356880c-b04e-44b8-ae01-4fff09eaaf1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:32.340298 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-c356880c-b04e-44b8-ae01-4fff09eaaf1b None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:10:32.341748 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c356880c-b04e-44b8-ae01-4fff09eaaf1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:32.384206 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:32.458661 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 679/1362] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:10:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:10:32.750922 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6b9a1-3e0e-4661-8d46-d0014baf6a05 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:32.752444 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f8a6b9a1-3e0e-4661-8d46-d0014baf6a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:32.822051 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:32.912150 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6b9a1-3e0e-4661-8d46-d0014baf6a05 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:33.060192 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb19e21-a493-4c3e-b7fe-49eb94f8ef44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:33.060807 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb19e21-a493-4c3e-b7fe-49eb94f8ef44 service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:33.061087 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb19e21-a493-4c3e-b7fe-49eb94f8ef44 service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:33.061358 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb19e21-a493-4c3e-b7fe-49eb94f8ef44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:33.063020 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-8cb19e21-a493-4c3e-b7fe-49eb94f8ef44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:33.086600 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:33.161367 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb19e21-a493-4c3e-b7fe-49eb94f8ef44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:33.163233 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb19e21-a493-4c3e-b7fe-49eb94f8ef44 service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:33.187772 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 684/1363] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:10:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:10:35.446487 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfba0e3-6a01-4cc8-83d4-7d7a6130be99 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:35.447037 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfba0e3-6a01-4cc8-83d4-7d7a6130be99 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:35.447471 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfba0e3-6a01-4cc8-83d4-7d7a6130be99 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:35.448765 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 680/1364] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:10:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:10:35.454533 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8833be-4068-4f44-b524-bf65f3bdf466 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:35.455018 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8833be-4068-4f44-b524-bf65f3bdf466 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:35.455110 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8833be-4068-4f44-b524-bf65f3bdf466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:35.530104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-2a8833be-4068-4f44-b524-bf65f3bdf466 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:10:35.530104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-2a8833be-4068-4f44-b524-bf65f3bdf466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:35.635370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:35.638526 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 685/1365] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:10:35.937409 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6b136-7e2e-4280-b4f1-eaa09dc6c41c None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:35.937710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6b136-7e2e-4280-b4f1-eaa09dc6c41c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:35.938392 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6b136-7e2e-4280-b4f1-eaa09dc6c41c None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:35.940045 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 681/1366] 10.222.0.79 () {54 vars in 962 bytes} [Wed Aug 31 19:10:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:10:35.947019 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164a9ac-34bc-4360-80b9-673ccd48ee3d None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:35.947433 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164a9ac-34bc-4360-80b9-673ccd48ee3d None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:35.947844 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164a9ac-34bc-4360-80b9-673ccd48ee3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:36.034423 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-e164a9ac-34bc-4360-80b9-673ccd48ee3d None None] MFA Rules not processed for user `1fd6d45d1bc3479da72cb1a1990a6137`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:10:36.035669 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-e164a9ac-34bc-4360-80b9-673ccd48ee3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:36.167615 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 686/1367] 10.222.0.79 () {58 vars in 1059 bytes} [Wed Aug 31 19:10:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:10:36.176389 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6b136-7e2e-4280-b4f1-eaa09dc6c41c None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:36.178198 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-72a6b136-7e2e-4280-b4f1-eaa09dc6c41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:36.344125 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6b136-7e2e-4280-b4f1-eaa09dc6c41c None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:36.364913 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:36.472588 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e77d28-ba91-499c-a49e-2c65dc60cb26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:36.473231 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e77d28-ba91-499c-a49e-2c65dc60cb26 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:36.473536 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e77d28-ba91-499c-a49e-2c65dc60cb26 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:36.473670 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e77d28-ba91-499c-a49e-2c65dc60cb26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:36.475250 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-55e77d28-ba91-499c-a49e-2c65dc60cb26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:36.574144 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e77d28-ba91-499c-a49e-2c65dc60cb26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:36.576131 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e77d28-ba91-499c-a49e-2c65dc60cb26 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:36.596306 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 682/1368] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:10:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:10:37.075460 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ee9d6-56ef-4498-90ef-5630fd7b33c4 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:37.076074 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ee9d6-56ef-4498-90ef-5630fd7b33c4 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:37.076074 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ee9d6-56ef-4498-90ef-5630fd7b33c4 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:37.077534 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 687/1369] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:10:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:10:37.082774 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b9cba-dd61-4fef-89f9-91f28c449ec4 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:37.083506 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b9cba-dd61-4fef-89f9-91f28c449ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:37.084062 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b9cba-dd61-4fef-89f9-91f28c449ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:37.137962 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:37.177041 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-554b9cba-dd61-4fef-89f9-91f28c449ec4 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:10:37.178255 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-554b9cba-dd61-4fef-89f9-91f28c449ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:37.286510 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 683/1370] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:10:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:10:37.886667 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de4937-d6cd-42f6-99d9-ace5c1e64831 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:37.886667 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de4937-d6cd-42f6-99d9-ace5c1e64831 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:37.886667 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de4937-d6cd-42f6-99d9-ace5c1e64831 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:37.888350 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 688/1371] 10.222.0.79 () {54 vars in 964 bytes} [Wed Aug 31 19:10:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:10:37.893463 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7c4f5-7712-4b90-99e9-2ba9d701786e None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:37.894260 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7c4f5-7712-4b90-99e9-2ba9d701786e None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:37.894742 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7c4f5-7712-4b90-99e9-2ba9d701786e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:37.988574 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-dad7c4f5-7712-4b90-99e9-2ba9d701786e None None] MFA Rules not processed for user `17e0a157474749939b6f8d2af26d7d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:10:37.990548 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-dad7c4f5-7712-4b90-99e9-2ba9d701786e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:38.049396 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:38.084724 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 684/1372] 10.222.0.79 () {58 vars in 1061 bytes} [Wed Aug 31 19:10:37 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:10:38.093502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de4937-d6cd-42f6-99d9-ace5c1e64831 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:38.095168 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-30de4937-d6cd-42f6-99d9-ace5c1e64831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:38.149480 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:38.216973 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de4937-d6cd-42f6-99d9-ace5c1e64831 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:38.307875 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c25017-6b36-4bda-bfa7-df8e71e7e9bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:38.308648 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c25017-6b36-4bda-bfa7-df8e71e7e9bf service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:38.308964 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c25017-6b36-4bda-bfa7-df8e71e7e9bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:38.309332 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c25017-6b36-4bda-bfa7-df8e71e7e9bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:38.311326 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-90c25017-6b36-4bda-bfa7-df8e71e7e9bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:38.443505 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:38.467099 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c25017-6b36-4bda-bfa7-df8e71e7e9bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:38.469348 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c25017-6b36-4bda-bfa7-df8e71e7e9bf service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:38.490353 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 689/1373] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:10:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:10:38.597433 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f58689-fbde-4c49-9d82-ee7b43fd73f8 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:38.597722 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f58689-fbde-4c49-9d82-ee7b43fd73f8 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:38.597996 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f58689-fbde-4c49-9d82-ee7b43fd73f8 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:38.599706 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 685/1374] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:10:38.605361 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4f168-e903-4df0-88bf-0867fd000b5b None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:38.605585 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4f168-e903-4df0-88bf-0867fd000b5b None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:38.605858 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4f168-e903-4df0-88bf-0867fd000b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:38.673027 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-d2f4f168-e903-4df0-88bf-0867fd000b5b None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:10:38.674217 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d2f4f168-e903-4df0-88bf-0867fd000b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:38.770818 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 690/1375] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:10:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:10:39.055144 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f58689-fbde-4c49-9d82-ee7b43fd73f8 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:39.056698 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a2f58689-fbde-4c49-9d82-ee7b43fd73f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:39.206255 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f58689-fbde-4c49-9d82-ee7b43fd73f8 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:39.260272 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:39.325423 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d698f0-ba1e-4b2e-841b-735cd3ae9912 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:39.325974 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d698f0-ba1e-4b2e-841b-735cd3ae9912 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:39.326252 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d698f0-ba1e-4b2e-841b-735cd3ae9912 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:39.326552 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d698f0-ba1e-4b2e-841b-735cd3ae9912 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:39.328150 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d4d698f0-ba1e-4b2e-841b-735cd3ae9912 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:39.420637 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d698f0-ba1e-4b2e-841b-735cd3ae9912 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:39.422238 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d698f0-ba1e-4b2e-841b-735cd3ae9912 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:39.440307 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 686/1376] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:10:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:10:41.396422 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5a31b-c7b9-430c-9ca3-3ec4d4f22806 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:41.396958 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5a31b-c7b9-430c-9ca3-3ec4d4f22806 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:41.396958 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5a31b-c7b9-430c-9ca3-3ec4d4f22806 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:41.398297 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 691/1377] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:10:41.403860 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb80f30-5117-4f71-abae-94f9636b8d03 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:41.404310 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb80f30-5117-4f71-abae-94f9636b8d03 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:41.404425 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb80f30-5117-4f71-abae-94f9636b8d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:41.474679 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-dcb80f30-5117-4f71-abae-94f9636b8d03 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:10:41.476512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-dcb80f30-5117-4f71-abae-94f9636b8d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:41.484567 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:41.614771 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 687/1378] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:10:41.907716 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5a31b-c7b9-430c-9ca3-3ec4d4f22806 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:41.909368 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-84b5a31b-c7b9-430c-9ca3-3ec4d4f22806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:41.996270 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:42.142955 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5a31b-c7b9-430c-9ca3-3ec4d4f22806 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:42.274004 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8217cf4-d8fb-497a-b406-b5ca4d84d3d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:42.274940 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8217cf4-d8fb-497a-b406-b5ca4d84d3d1 service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:42.275399 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8217cf4-d8fb-497a-b406-b5ca4d84d3d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:42.275668 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8217cf4-d8fb-497a-b406-b5ca4d84d3d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:42.277270 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f8217cf4-d8fb-497a-b406-b5ca4d84d3d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:42.302432 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:42.391349 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8217cf4-d8fb-497a-b406-b5ca4d84d3d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:42.393459 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8217cf4-d8fb-497a-b406-b5ca4d84d3d1 service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:42.414904 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 692/1379] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:10:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:10:44.448298 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f141ee1-7b9d-40c3-8a69-e72d44a3eb89 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:44.449023 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f141ee1-7b9d-40c3-8a69-e72d44a3eb89 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:44.449023 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f141ee1-7b9d-40c3-8a69-e72d44a3eb89 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:44.450178 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 688/1380] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:10:44.455514 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb71a4-9a40-41da-960b-ba4d7ce9cccb None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:44.456232 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb71a4-9a40-41da-960b-ba4d7ce9cccb None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:44.456232 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb71a4-9a40-41da-960b-ba4d7ce9cccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:44.526070 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-35cb71a4-9a40-41da-960b-ba4d7ce9cccb None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:10:44.530577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-35cb71a4-9a40-41da-960b-ba4d7ce9cccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:44.633045 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:44.639761 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 693/1381] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:10:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:10:44.956887 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f141ee1-7b9d-40c3-8a69-e72d44a3eb89 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:44.958535 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2f141ee1-7b9d-40c3-8a69-e72d44a3eb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:45.107347 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:45.119000 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f141ee1-7b9d-40c3-8a69-e72d44a3eb89 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:45.246623 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337560d-660c-4f57-b601-c5fad117cf28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:45.247151 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337560d-660c-4f57-b601-c5fad117cf28 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:45.247429 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337560d-660c-4f57-b601-c5fad117cf28 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:45.247766 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337560d-660c-4f57-b601-c5fad117cf28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:45.249378 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3337560d-660c-4f57-b601-c5fad117cf28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:45.345473 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337560d-660c-4f57-b601-c5fad117cf28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:45.347180 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337560d-660c-4f57-b601-c5fad117cf28 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:45.359020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:45.370642 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 689/1382] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:10:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:10:47.495839 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157a8c9-c569-4f00-ab02-86ef57c52e2e None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:47.496745 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157a8c9-c569-4f00-ab02-86ef57c52e2e None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:47.496745 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157a8c9-c569-4f00-ab02-86ef57c52e2e None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:47.497834 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 694/1383] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:10:47.505945 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bf4eb-60a7-4079-930e-699eafe1e018 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:47.506640 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bf4eb-60a7-4079-930e-699eafe1e018 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:47.506925 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bf4eb-60a7-4079-930e-699eafe1e018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:47.586746 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-9f1bf4eb-60a7-4079-930e-699eafe1e018 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:10:47.588029 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9f1bf4eb-60a7-4079-930e-699eafe1e018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:47.705889 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 690/1384] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:10:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:10:48.082521 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157a8c9-c569-4f00-ab02-86ef57c52e2e None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:48.084078 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-e157a8c9-c569-4f00-ab02-86ef57c52e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:48.248807 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157a8c9-c569-4f00-ab02-86ef57c52e2e None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:48.326094 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:48.388909 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc860c-dd56-4992-9950-7c176930defe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:48.389725 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc860c-dd56-4992-9950-7c176930defe service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:48.390096 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc860c-dd56-4992-9950-7c176930defe service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:48.390449 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc860c-dd56-4992-9950-7c176930defe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:48.392602 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-63fc860c-dd56-4992-9950-7c176930defe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:48.491333 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc860c-dd56-4992-9950-7c176930defe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:48.493048 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc860c-dd56-4992-9950-7c176930defe service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:48.512556 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 695/1385] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:10:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:10:50.506402 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b9da2-21bc-42ce-bc20-d307f5706abc None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:50.507472 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b9da2-21bc-42ce-bc20-d307f5706abc None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:50.507472 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b9da2-21bc-42ce-bc20-d307f5706abc None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:50.508854 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 691/1386] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:10:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:10:50.514823 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefc767-7db8-465c-b69d-33d2a288901e None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:50.515265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefc767-7db8-465c-b69d-33d2a288901e None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:50.515367 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefc767-7db8-465c-b69d-33d2a288901e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:50.587699 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-9eefc767-7db8-465c-b69d-33d2a288901e None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:10:50.589318 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-9eefc767-7db8-465c-b69d-33d2a288901e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:50.633617 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:50.711712 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 696/1387] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:10:51.005677 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8b9da2-21bc-42ce-bc20-d307f5706abc None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:51.007855 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ae8b9da2-21bc-42ce-bc20-d307f5706abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:51.096752 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:51.180836 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8b9da2-21bc-42ce-bc20-d307f5706abc None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:51.303481 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3356d30-e42b-40de-af87-fa4d45c5d6bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:51.304966 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3356d30-e42b-40de-af87-fa4d45c5d6bb service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:51.304966 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3356d30-e42b-40de-af87-fa4d45c5d6bb service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:51.305700 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3356d30-e42b-40de-af87-fa4d45c5d6bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:51.306885 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e3356d30-e42b-40de-af87-fa4d45c5d6bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:51.352247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:51.411450 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3356d30-e42b-40de-af87-fa4d45c5d6bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:51.413604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3356d30-e42b-40de-af87-fa4d45c5d6bb service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:51.434203 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 692/1388] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:10:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:10:53.392422 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1fc6c-8f85-44c3-9a19-51baa187d1e3 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:53.392996 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1fc6c-8f85-44c3-9a19-51baa187d1e3 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:53.392996 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1fc6c-8f85-44c3-9a19-51baa187d1e3 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:53.394341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 697/1389] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:10:53.400497 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85cc92-2035-4bc8-9406-141e65896293 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:53.401037 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85cc92-2035-4bc8-9406-141e65896293 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:53.401037 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85cc92-2035-4bc8-9406-141e65896293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:53.471755 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-ec85cc92-2035-4bc8-9406-141e65896293 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:10:53.472957 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ec85cc92-2035-4bc8-9406-141e65896293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:53.556640 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78faf75-e580-454f-ab64-f40f4c69a941 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:53.556931 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78faf75-e580-454f-ab64-f40f4c69a941 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:53.557206 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78faf75-e580-454f-ab64-f40f4c69a941 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:53.558566 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 698/1390] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:10:53.563668 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01d8a3-8f2e-4ca5-b049-f6e89fafe0e7 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:53.563954 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01d8a3-8f2e-4ca5-b049-f6e89fafe0e7 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:53.564235 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01d8a3-8f2e-4ca5-b049-f6e89fafe0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:53.579612 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 693/1391] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:10:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:10:53.632966 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-fb01d8a3-8f2e-4ca5-b049-f6e89fafe0e7 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:10:53.634222 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-fb01d8a3-8f2e-4ca5-b049-f6e89fafe0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:53.742536 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 699/1392] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:10:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:10:53.890783 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85cc92-2035-4bc8-9406-141e65896293 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:53.891920 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ec85cc92-2035-4bc8-9406-141e65896293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:53.907672 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:54.049021 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f533b47-50b0-4cc4-a65f-c75df112b57d None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:54.049304 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f533b47-50b0-4cc4-a65f-c75df112b57d None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:54.049575 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f533b47-50b0-4cc4-a65f-c75df112b57d None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:54.050961 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 700/1393] 10.222.0.79 () {54 vars in 967 bytes} [Wed Aug 31 19:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:10:54.052609 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85cc92-2035-4bc8-9406-141e65896293 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:54.056442 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623b9e7-8f51-40b4-9e78-85ba6a27a482 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:54.056728 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623b9e7-8f51-40b4-9e78-85ba6a27a482 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:54.057149 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623b9e7-8f51-40b4-9e78-85ba6a27a482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:54.075303 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:54.154383 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-2623b9e7-8f51-40b4-9e78-85ba6a27a482 None None] MFA Rules not processed for user `254dd957da6345f79bcab42b27b8d2cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:10:54.155613 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-2623b9e7-8f51-40b4-9e78-85ba6a27a482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:54.188931 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a15c5e-b25b-48dc-97df-39144a60433d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:54.189537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a15c5e-b25b-48dc-97df-39144a60433d service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:54.189809 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a15c5e-b25b-48dc-97df-39144a60433d service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:54.190076 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a15c5e-b25b-48dc-97df-39144a60433d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:54.191704 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b8a15c5e-b25b-48dc-97df-39144a60433d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:54.201257 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:54.243297 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 701/1394] 10.222.0.79 () {58 vars in 1064 bytes} [Wed Aug 31 19:10:54 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:10:54.251415 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623b9e7-8f51-40b4-9e78-85ba6a27a482 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:54.259457 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623b9e7-8f51-40b4-9e78-85ba6a27a482 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:54.294612 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a15c5e-b25b-48dc-97df-39144a60433d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:54.296236 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a15c5e-b25b-48dc-97df-39144a60433d service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:54.315572 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 694/1395] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:10:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:10:54.341282 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33f1c2-1614-4526-9291-690d6f06f67b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '254dd957da6345f79bcab42b27b8d2cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:54.342006 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33f1c2-1614-4526-9291-690d6f06f67b service glance] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:54.342321 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33f1c2-1614-4526-9291-690d6f06f67b service glance] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:54.342690 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33f1c2-1614-4526-9291-690d6f06f67b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:54.344611 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-8d33f1c2-1614-4526-9291-690d6f06f67b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:54.382859 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:54.482957 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d33f1c2-1614-4526-9291-690d6f06f67b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:54.484410 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d33f1c2-1614-4526-9291-690d6f06f67b service glance] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:54.506418 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 702/1396] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:10:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:10:55.294269 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959e8d4-ff5e-4a9a-8d76-2505d2a38120 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:55.294874 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959e8d4-ff5e-4a9a-8d76-2505d2a38120 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:55.294874 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959e8d4-ff5e-4a9a-8d76-2505d2a38120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:55.375230 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-f959e8d4-ff5e-4a9a-8d76-2505d2a38120 None None] MFA Rules not processed for user `3e070c93f47045ecb5bf0a1622395091`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:10:55.376633 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f959e8d4-ff5e-4a9a-8d76-2505d2a38120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:55.481788 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:55.486299 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 695/1397] 10.222.0.79 () {58 vars in 1009 bytes} [Wed Aug 31 19:10:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:10:55.532059 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c807a6-43e1-46f1-a9fe-9e52d645b3df None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:55.532584 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c807a6-43e1-46f1-a9fe-9e52d645b3df None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:55.532584 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c807a6-43e1-46f1-a9fe-9e52d645b3df None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:55.533994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 703/1398] 10.222.0.79 () {54 vars in 943 bytes} [Wed Aug 31 19:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:10:55.541829 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91186c2d-4a37-4bdf-88a4-a7be037bbf43 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:55.542117 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91186c2d-4a37-4bdf-88a4-a7be037bbf43 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:55.542397 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91186c2d-4a37-4bdf-88a4-a7be037bbf43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:55.621713 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-91186c2d-4a37-4bdf-88a4-a7be037bbf43 None None] MFA Rules not processed for user `3b289a0bef53460ca5173ad946394d72`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:10:55.622952 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-91186c2d-4a37-4bdf-88a4-a7be037bbf43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:55.733180 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 696/1399] 10.222.0.79 () {58 vars in 1040 bytes} [Wed Aug 31 19:10:55 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:10:55.743826 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c807a6-43e1-46f1-a9fe-9e52d645b3df None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:55.745454 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d9c807a6-43e1-46f1-a9fe-9e52d645b3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:55.882331 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:55.885229 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c807a6-43e1-46f1-a9fe-9e52d645b3df None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:55.993289 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b6f74-4352-4d4a-a845-b0c0d0dbd6cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b289a0bef53460ca5173ad946394d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:55.993814 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b6f74-4352-4d4a-a845-b0c0d0dbd6cb service swift] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:55.994096 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b6f74-4352-4d4a-a845-b0c0d0dbd6cb service swift] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:55.994370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b6f74-4352-4d4a-a845-b0c0d0dbd6cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:55.996035 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1a7b6f74-4352-4d4a-a845-b0c0d0dbd6cb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:56.085017 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7b6f74-4352-4d4a-a845-b0c0d0dbd6cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:56.086656 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7b6f74-4352-4d4a-a845-b0c0d0dbd6cb service swift] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:56.095245 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 704/1400] 10.222.0.79 () {60 vars in 1384 bytes} [Wed Aug 31 19:10:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:10:56.293366 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcb812-3ef8-48dd-8222-df416730b4ef None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:56.293726 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcb812-3ef8-48dd-8222-df416730b4ef None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:56.294072 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcb812-3ef8-48dd-8222-df416730b4ef None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:56.295552 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 697/1401] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:10:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:10:56.301370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957f741-7375-4194-b083-f8e00b8df396 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:56.301656 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957f741-7375-4194-b083-f8e00b8df396 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:56.301938 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957f741-7375-4194-b083-f8e00b8df396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:56.340916 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:56.377422 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-b957f741-7375-4194-b083-f8e00b8df396 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:10:56.379056 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-b957f741-7375-4194-b083-f8e00b8df396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:56.498804 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 705/1402] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:10:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:10:56.793759 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bcb812-3ef8-48dd-8222-df416730b4ef None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:56.795305 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a3bcb812-3ef8-48dd-8222-df416730b4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:56.863673 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:56.993026 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bcb812-3ef8-48dd-8222-df416730b4ef None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:10:57.123265 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea1392-f15d-4b92-9057-24cee396d35c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:10:57.123873 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea1392-f15d-4b92-9057-24cee396d35c service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:57.124146 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea1392-f15d-4b92-9057-24cee396d35c service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:57.124419 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea1392-f15d-4b92-9057-24cee396d35c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:57.126039 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-48ea1392-f15d-4b92-9057-24cee396d35c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:57.154585 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:57.240607 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea1392-f15d-4b92-9057-24cee396d35c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:10:57.242208 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea1392-f15d-4b92-9057-24cee396d35c service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:10:57.264957 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 698/1403] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:10:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:10:59.303893 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2c7ad-97ea-43b5-a44d-c997911b2d04 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:59.304311 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2c7ad-97ea-43b5-a44d-c997911b2d04 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:59.304460 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2c7ad-97ea-43b5-a44d-c997911b2d04 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:59.306007 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 706/1404] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:10:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:10:59.315585 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c115d2-bcec-4e70-941c-0ab10f6b0029 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:10:59.316165 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c115d2-bcec-4e70-941c-0ab10f6b0029 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:10:59.316165 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c115d2-bcec-4e70-941c-0ab10f6b0029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:10:59.401534 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-35c115d2-bcec-4e70-941c-0ab10f6b0029 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:10:59.402880 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-35c115d2-bcec-4e70-941c-0ab10f6b0029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:10:59.512876 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:59.522230 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 699/1405] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:10:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:10:59.846719 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2c7ad-97ea-43b5-a44d-c997911b2d04 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:10:59.848356 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-17b2c7ad-97ea-43b5-a44d-c997911b2d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:00.006979 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:00.061932 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2c7ad-97ea-43b5-a44d-c997911b2d04 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:00.201994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e052f-be75-4d33-ad2e-9d2033667f2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:00.202669 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e052f-be75-4d33-ad2e-9d2033667f2e service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:00.202956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e052f-be75-4d33-ad2e-9d2033667f2e service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:00.203342 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e052f-be75-4d33-ad2e-9d2033667f2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:00.204943 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-778e052f-be75-4d33-ad2e-9d2033667f2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:00.290836 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:00.313420 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e052f-be75-4d33-ad2e-9d2033667f2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:00.316647 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e052f-be75-4d33-ad2e-9d2033667f2e service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:00.337817 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 707/1406] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:10:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:11:02.389068 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaed758-c1f7-45a3-840d-904fc97805b7 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:02.389666 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaed758-c1f7-45a3-840d-904fc97805b7 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:02.389666 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaed758-c1f7-45a3-840d-904fc97805b7 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:02.390995 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 700/1407] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:11:02.396508 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14056b85-2e6b-44d2-a6fc-d16f08e25eae None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:02.397456 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14056b85-2e6b-44d2-a6fc-d16f08e25eae None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:02.397786 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14056b85-2e6b-44d2-a6fc-d16f08e25eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:02.475233 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-14056b85-2e6b-44d2-a6fc-d16f08e25eae None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:11:02.476575 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-14056b85-2e6b-44d2-a6fc-d16f08e25eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:02.597160 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 708/1408] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:11:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:11:02.886841 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaed758-c1f7-45a3-840d-904fc97805b7 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:02.888711 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-bdaed758-c1f7-45a3-840d-904fc97805b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:03.085693 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaed758-c1f7-45a3-840d-904fc97805b7 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:03.161852 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:03.220498 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2971eeb2-6abb-4cbc-9f6c-275f0f7c9842 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:03.221421 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971eeb2-6abb-4cbc-9f6c-275f0f7c9842 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:03.221700 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971eeb2-6abb-4cbc-9f6c-275f0f7c9842 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:03.221978 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971eeb2-6abb-4cbc-9f6c-275f0f7c9842 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:03.224377 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2971eeb2-6abb-4cbc-9f6c-275f0f7c9842 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:03.338845 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2971eeb2-6abb-4cbc-9f6c-275f0f7c9842 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:03.340573 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2971eeb2-6abb-4cbc-9f6c-275f0f7c9842 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:03.361477 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 701/1409] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:11:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:11:12.595525 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=79 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:13.359110 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=64 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:18.381947 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f7464-45ec-4bba-8402-61dba1e71545 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:18.383039 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f7464-45ec-4bba-8402-61dba1e71545 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:18.383039 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f7464-45ec-4bba-8402-61dba1e71545 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:18.384374 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 709/1410] 10.222.0.79 () {54 vars in 918 bytes} [Wed Aug 31 19:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:11:18.389525 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d0f25-c552-40b5-af79-27030371a02a None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:18.389937 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d0f25-c552-40b5-af79-27030371a02a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:18.390075 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d0f25-c552-40b5-af79-27030371a02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:18.467870 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-762d0f25-c552-40b5-af79-27030371a02a None None] MFA Rules not processed for user `ece00ea631594381bf1c27cfc2ece6f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:11:18.469079 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-762d0f25-c552-40b5-af79-27030371a02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:18.575365 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 702/1411] 10.222.0.79 () {58 vars in 1015 bytes} [Wed Aug 31 19:11:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:11:18.590155 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee982e-8499-4b5c-a573-b9e768ca66e9 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:18.590438 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee982e-8499-4b5c-a573-b9e768ca66e9 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:18.590747 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee982e-8499-4b5c-a573-b9e768ca66e9 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:18.592377 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 710/1412] 10.222.0.79 () {54 vars in 918 bytes} [Wed Aug 31 19:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:11:18.596918 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60401e8b-3939-4514-b964-45774557d846 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:18.597230 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60401e8b-3939-4514-b964-45774557d846 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:18.597502 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60401e8b-3939-4514-b964-45774557d846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:18.670530 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:18.673642 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-60401e8b-3939-4514-b964-45774557d846 None None] MFA Rules not processed for user `1fd6d45d1bc3479da72cb1a1990a6137`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:11:18.675450 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-60401e8b-3939-4514-b964-45774557d846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:18.790365 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 703/1413] 10.222.0.79 () {58 vars in 1015 bytes} [Wed Aug 31 19:11:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:11:21.195739 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbce859-ae0e-4d51-9824-26617b82240b None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:21.196277 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbce859-ae0e-4d51-9824-26617b82240b None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:21.196277 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbce859-ae0e-4d51-9824-26617b82240b None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:21.197522 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 711/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:11:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:11:21.202909 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e14870-cfa2-428f-a695-337a8e498065 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:21.203343 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e14870-cfa2-428f-a695-337a8e498065 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:21.203463 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e14870-cfa2-428f-a695-337a8e498065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:21.268654 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-68e14870-cfa2-428f-a695-337a8e498065 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:11:21.269846 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-68e14870-cfa2-428f-a695-337a8e498065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:21.327401 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:21.370851 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 704/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:11:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:11:21.658712 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbce859-ae0e-4d51-9824-26617b82240b None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:21.660272 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-5bbce859-ae0e-4d51-9824-26617b82240b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:21.807780 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbce859-ae0e-4d51-9824-26617b82240b None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:21.879504 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:21.919833 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904c6f7-805f-47df-bc79-f82a156f5de8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:21.920425 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904c6f7-805f-47df-bc79-f82a156f5de8 service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:21.920699 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904c6f7-805f-47df-bc79-f82a156f5de8 service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:21.920966 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904c6f7-805f-47df-bc79-f82a156f5de8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:21.922574 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d904c6f7-805f-47df-bc79-f82a156f5de8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:22.009727 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d904c6f7-805f-47df-bc79-f82a156f5de8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:22.011359 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d904c6f7-805f-47df-bc79-f82a156f5de8 service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:22.029681 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 712/1416] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:11:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:11:22.924283 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb512713-cbd9-4e71-8ad3-5419922180ac None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:22.924863 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb512713-cbd9-4e71-8ad3-5419922180ac None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:22.924863 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb512713-cbd9-4e71-8ad3-5419922180ac None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:22.926219 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 705/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 19:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:11:22.931640 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e866410-9995-45ce-aa64-51ad0deb5e70 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:22.932092 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e866410-9995-45ce-aa64-51ad0deb5e70 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:22.932210 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e866410-9995-45ce-aa64-51ad0deb5e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:23.009300 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-6e866410-9995-45ce-aa64-51ad0deb5e70 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:11:23.010518 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-6e866410-9995-45ce-aa64-51ad0deb5e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:23.036265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:23.107775 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 713/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 19:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:11:23.256461 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb512713-cbd9-4e71-8ad3-5419922180ac None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:23.257884 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-fb512713-cbd9-4e71-8ad3-5419922180ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:23.402701 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb512713-cbd9-4e71-8ad3-5419922180ac None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:23.447264 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:23.520879 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c0d022-e1d1-41aa-91b7-5e8aa9dbcf8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:23.521407 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0d022-e1d1-41aa-91b7-5e8aa9dbcf8c service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:23.521674 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0d022-e1d1-41aa-91b7-5e8aa9dbcf8c service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:23.521939 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0d022-e1d1-41aa-91b7-5e8aa9dbcf8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:23.523560 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-64c0d022-e1d1-41aa-91b7-5e8aa9dbcf8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:23.613463 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c0d022-e1d1-41aa-91b7-5e8aa9dbcf8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:23.615192 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c0d022-e1d1-41aa-91b7-5e8aa9dbcf8c service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:23.632969 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 706/1419] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:11:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:11:24.520514 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870b449-a0e5-41be-90be-5c0892d4885a None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:24.521119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870b449-a0e5-41be-90be-5c0892d4885a None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:24.521119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870b449-a0e5-41be-90be-5c0892d4885a None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:24.522384 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 714/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 19:11:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:11:24.527440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8fb356-ccc0-404d-a7b8-e4028956eb16 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:24.527930 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8fb356-ccc0-404d-a7b8-e4028956eb16 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:24.528079 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8fb356-ccc0-404d-a7b8-e4028956eb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:24.583396 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:24.606864 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-1b8fb356-ccc0-404d-a7b8-e4028956eb16 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:11:24.608071 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1b8fb356-ccc0-404d-a7b8-e4028956eb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:24.704417 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 707/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 19:11:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:11:24.853099 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870b449-a0e5-41be-90be-5c0892d4885a None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:24.855140 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-3870b449-a0e5-41be-90be-5c0892d4885a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:25.004035 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870b449-a0e5-41be-90be-5c0892d4885a None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:25.015955 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:25.117318 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4f444-54ed-485d-a190-bf72a5cc0d7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:25.118468 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4f444-54ed-485d-a190-bf72a5cc0d7b service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:25.118769 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4f444-54ed-485d-a190-bf72a5cc0d7b service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:25.119038 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4f444-54ed-485d-a190-bf72a5cc0d7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:25.120626 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-14b4f444-54ed-485d-a190-bf72a5cc0d7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:25.210027 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4f444-54ed-485d-a190-bf72a5cc0d7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:25.211679 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4f444-54ed-485d-a190-bf72a5cc0d7b service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:25.230046 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 715/1422] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:11:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:11:26.092958 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3fb36-8fa8-44fa-88bf-8df71296b7d0 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:26.093511 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3fb36-8fa8-44fa-88bf-8df71296b7d0 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:26.093511 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3fb36-8fa8-44fa-88bf-8df71296b7d0 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:26.094892 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 708/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 19:11:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:11:26.099929 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57a205-efe2-412d-9be2-dcff2c552381 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:26.100370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57a205-efe2-412d-9be2-dcff2c552381 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:26.100487 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57a205-efe2-412d-9be2-dcff2c552381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:26.120508 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:26.176862 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-3e57a205-efe2-412d-9be2-dcff2c552381 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:11:26.178063 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-3e57a205-efe2-412d-9be2-dcff2c552381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:26.274978 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 716/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 19:11:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:11:26.427486 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3fb36-8fa8-44fa-88bf-8df71296b7d0 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:26.428900 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-48b3fb36-8fa8-44fa-88bf-8df71296b7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:26.538919 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:26.575649 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3fb36-8fa8-44fa-88bf-8df71296b7d0 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:26.687922 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e627a71-bf86-4679-b581-64345bb2a073 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:26.688452 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e627a71-bf86-4679-b581-64345bb2a073 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:26.688730 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e627a71-bf86-4679-b581-64345bb2a073 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:26.689000 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e627a71-bf86-4679-b581-64345bb2a073 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:26.690637 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8e627a71-bf86-4679-b581-64345bb2a073 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:26.766210 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:26.780081 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e627a71-bf86-4679-b581-64345bb2a073 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:26.781700 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e627a71-bf86-4679-b581-64345bb2a073 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:26.799221 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 709/1425] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:11:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:11:27.653444 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093bd536-b6c0-4af3-8e09-67d85cd8c71d None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:27.654007 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093bd536-b6c0-4af3-8e09-67d85cd8c71d None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:27.654007 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093bd536-b6c0-4af3-8e09-67d85cd8c71d None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:27.655391 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 717/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 19:11:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:11:27.660253 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e39b5-3216-46ef-af28-259253f74d9d None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:27.660703 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e39b5-3216-46ef-af28-259253f74d9d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:27.660807 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e39b5-3216-46ef-af28-259253f74d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:27.737258 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-562e39b5-3216-46ef-af28-259253f74d9d None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:11:27.738475 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-562e39b5-3216-46ef-af28-259253f74d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:27.834090 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 710/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 19:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:11:27.984215 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093bd536-b6c0-4af3-8e09-67d85cd8c71d None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:27.985721 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-093bd536-b6c0-4af3-8e09-67d85cd8c71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:28.068611 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:28.130399 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093bd536-b6c0-4af3-8e09-67d85cd8c71d None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:28.241138 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52025267-2c6f-4410-92c4-c13b7cb38a96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:28.241742 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52025267-2c6f-4410-92c4-c13b7cb38a96 service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:28.242019 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52025267-2c6f-4410-92c4-c13b7cb38a96 service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:28.242288 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52025267-2c6f-4410-92c4-c13b7cb38a96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:28.244364 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-52025267-2c6f-4410-92c4-c13b7cb38a96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:28.292785 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:28.337280 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52025267-2c6f-4410-92c4-c13b7cb38a96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:28.338913 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52025267-2c6f-4410-92c4-c13b7cb38a96 service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:28.360489 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 718/1428] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:11:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:11:29.163617 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511ebc7-cfd1-481f-9927-54e4ecdfd734 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:29.164198 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511ebc7-cfd1-481f-9927-54e4ecdfd734 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:29.164198 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511ebc7-cfd1-481f-9927-54e4ecdfd734 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:29.166185 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 711/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 19:11:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:11:29.171569 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde21bc-dba5-40d6-8228-924e38d1f45d None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:29.172014 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde21bc-dba5-40d6-8228-924e38d1f45d None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:29.172367 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde21bc-dba5-40d6-8228-924e38d1f45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:29.248311 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-afde21bc-dba5-40d6-8228-924e38d1f45d None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:11:29.249506 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-afde21bc-dba5-40d6-8228-924e38d1f45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:29.348731 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 719/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 19:11:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:11:29.500414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8511ebc7-cfd1-481f-9927-54e4ecdfd734 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:29.501877 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8511ebc7-cfd1-481f-9927-54e4ecdfd734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:29.551577 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:29.651678 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8511ebc7-cfd1-481f-9927-54e4ecdfd734 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:29.768253 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe955780-2a60-4866-b902-0e944d589352 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:29.768774 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe955780-2a60-4866-b902-0e944d589352 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:29.769051 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe955780-2a60-4866-b902-0e944d589352 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:29.769320 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe955780-2a60-4866-b902-0e944d589352 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:29.770966 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-fe955780-2a60-4866-b902-0e944d589352 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:29.778097 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:29.863434 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe955780-2a60-4866-b902-0e944d589352 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:29.865059 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe955780-2a60-4866-b902-0e944d589352 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:29.882847 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 712/1431] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:11:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:11:30.688895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a695a8-a661-4b6e-bb48-2393b9039e48 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:30.689481 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a695a8-a661-4b6e-bb48-2393b9039e48 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:30.689481 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a695a8-a661-4b6e-bb48-2393b9039e48 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:30.690898 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 720/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 19:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:11:30.695927 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57007a-0bb6-4b3e-af75-81d1b735e75b None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:30.696352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57007a-0bb6-4b3e-af75-81d1b735e75b None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:30.696467 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57007a-0bb6-4b3e-af75-81d1b735e75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:30.771973 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-8b57007a-0bb6-4b3e-af75-81d1b735e75b None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:11:30.773188 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8b57007a-0bb6-4b3e-af75-81d1b735e75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:30.840544 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:30.873634 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 713/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 19:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:11:31.023961 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a695a8-a661-4b6e-bb48-2393b9039e48 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:31.025971 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d3a695a8-a661-4b6e-bb48-2393b9039e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:31.043391 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:31.170821 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a695a8-a661-4b6e-bb48-2393b9039e48 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:31.255458 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:31.283285 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c44f7a-d26a-45be-b2a1-ccf538970729 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:31.283850 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c44f7a-d26a-45be-b2a1-ccf538970729 service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:31.284128 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c44f7a-d26a-45be-b2a1-ccf538970729 service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:31.284401 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c44f7a-d26a-45be-b2a1-ccf538970729 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:31.285987 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-a5c44f7a-d26a-45be-b2a1-ccf538970729 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:31.374442 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c44f7a-d26a-45be-b2a1-ccf538970729 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:31.376074 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c44f7a-d26a-45be-b2a1-ccf538970729 service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:31.393775 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 721/1434] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:11:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:11:32.216477 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cc8b4-f4e5-41dd-ab5d-c42a629c0138 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:32.217104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cc8b4-f4e5-41dd-ab5d-c42a629c0138 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:32.217104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cc8b4-f4e5-41dd-ab5d-c42a629c0138 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:32.218712 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 714/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 19:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:11:32.223554 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765e8d3-3ed6-4722-81a6-ded64c7d8abf None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:32.224016 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765e8d3-3ed6-4722-81a6-ded64c7d8abf None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:32.224119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765e8d3-3ed6-4722-81a6-ded64c7d8abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:32.300701 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-9765e8d3-3ed6-4722-81a6-ded64c7d8abf None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:11:32.301973 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-9765e8d3-3ed6-4722-81a6-ded64c7d8abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:32.345014 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:32.403235 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 722/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 19:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:11:32.557476 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40cc8b4-f4e5-41dd-ab5d-c42a629c0138 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:32.558979 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b40cc8b4-f4e5-41dd-ab5d-c42a629c0138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:32.704645 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40cc8b4-f4e5-41dd-ab5d-c42a629c0138 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:32.759955 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:32.818692 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bdd8bc-fc4f-499c-aa68-d29a909bc4fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:32.819204 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bdd8bc-fc4f-499c-aa68-d29a909bc4fd service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:32.819484 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bdd8bc-fc4f-499c-aa68-d29a909bc4fd service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:32.819758 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bdd8bc-fc4f-499c-aa68-d29a909bc4fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:32.821970 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-50bdd8bc-fc4f-499c-aa68-d29a909bc4fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:32.910217 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bdd8bc-fc4f-499c-aa68-d29a909bc4fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:32.911866 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bdd8bc-fc4f-499c-aa68-d29a909bc4fd service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:32.930843 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 715/1437] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:11:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:11:33.729737 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383e827-a08c-4b49-b765-fde1bcf999b1 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:33.730308 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383e827-a08c-4b49-b765-fde1bcf999b1 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:33.730308 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383e827-a08c-4b49-b765-fde1bcf999b1 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:33.731739 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 723/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 19:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:11:33.736752 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ad1c6-4b8f-4bdc-a450-57b2ccb8857a None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:33.737206 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ad1c6-4b8f-4bdc-a450-57b2ccb8857a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:33.737319 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ad1c6-4b8f-4bdc-a450-57b2ccb8857a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:33.811770 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-9b4ad1c6-4b8f-4bdc-a450-57b2ccb8857a None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:11:33.812879 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9b4ad1c6-4b8f-4bdc-a450-57b2ccb8857a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:33.814892 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:33.910187 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 716/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 19:11:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:11:34.061360 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383e827-a08c-4b49-b765-fde1bcf999b1 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:34.062986 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-7383e827-a08c-4b49-b765-fde1bcf999b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:34.204555 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383e827-a08c-4b49-b765-fde1bcf999b1 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:34.231329 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:34.316565 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fbd2ee-098f-4972-bc58-80d70d91b081 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:34.317112 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fbd2ee-098f-4972-bc58-80d70d91b081 service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:34.317386 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fbd2ee-098f-4972-bc58-80d70d91b081 service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:34.317674 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fbd2ee-098f-4972-bc58-80d70d91b081 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:34.319387 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-91fbd2ee-098f-4972-bc58-80d70d91b081 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:34.410016 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fbd2ee-098f-4972-bc58-80d70d91b081 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:34.411642 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fbd2ee-098f-4972-bc58-80d70d91b081 service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:34.429850 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 724/1440] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:11:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:11:36.269835 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597751c3-a144-4a43-945e-6d30e5b044f0 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:36.270400 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597751c3-a144-4a43-945e-6d30e5b044f0 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:36.270400 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597751c3-a144-4a43-945e-6d30e5b044f0 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:36.271752 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 717/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:11:36.277703 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109bab24-b111-47e4-b721-049d47b27927 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:36.278115 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109bab24-b111-47e4-b721-049d47b27927 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:36.278221 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109bab24-b111-47e4-b721-049d47b27927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:36.319467 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:36.347115 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-109bab24-b111-47e4-b721-049d47b27927 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:11:36.348324 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-109bab24-b111-47e4-b721-049d47b27927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:36.444258 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 725/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:11:36.734412 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597751c3-a144-4a43-945e-6d30e5b044f0 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:36.735973 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-597751c3-a144-4a43-945e-6d30e5b044f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:36.838787 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597751c3-a144-4a43-945e-6d30e5b044f0 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:36.871011 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:36.911852 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6f35a-97a7-43d8-bf1b-a2b3471c7887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:36.912463 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6f35a-97a7-43d8-bf1b-a2b3471c7887 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:36.912741 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6f35a-97a7-43d8-bf1b-a2b3471c7887 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:36.913020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6f35a-97a7-43d8-bf1b-a2b3471c7887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:36.914687 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-acd6f35a-97a7-43d8-bf1b-a2b3471c7887 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:37.023203 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd6f35a-97a7-43d8-bf1b-a2b3471c7887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:37.025295 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd6f35a-97a7-43d8-bf1b-a2b3471c7887 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:37.042749 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 718/1443] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:11:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:11:39.105341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fcfa3-ccd8-48e6-bc10-e5925fe5fe42 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:39.105930 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fcfa3-ccd8-48e6-bc10-e5925fe5fe42 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:39.105930 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fcfa3-ccd8-48e6-bc10-e5925fe5fe42 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:39.107338 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 726/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:11:39.112569 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57995b2-ec4e-43e3-af20-60d1f4dac0d7 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:39.113000 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57995b2-ec4e-43e3-af20-60d1f4dac0d7 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:39.113114 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57995b2-ec4e-43e3-af20-60d1f4dac0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:39.180374 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-c57995b2-ec4e-43e3-af20-60d1f4dac0d7 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:11:39.182166 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c57995b2-ec4e-43e3-af20-60d1f4dac0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:39.195439 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:39.285041 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 719/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:11:39.566505 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1fcfa3-ccd8-48e6-bc10-e5925fe5fe42 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:39.568066 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-dc1fcfa3-ccd8-48e6-bc10-e5925fe5fe42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:39.670037 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1fcfa3-ccd8-48e6-bc10-e5925fe5fe42 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:39.682235 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:39.745010 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd7a87-3870-4218-a677-1d56ff20edc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:39.745615 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd7a87-3870-4218-a677-1d56ff20edc5 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:39.745895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd7a87-3870-4218-a677-1d56ff20edc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:39.746165 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd7a87-3870-4218-a677-1d56ff20edc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:39.747794 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-eacd7a87-3870-4218-a677-1d56ff20edc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:39.856654 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd7a87-3870-4218-a677-1d56ff20edc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:39.858106 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd7a87-3870-4218-a677-1d56ff20edc5 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:39.877250 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 727/1446] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:11:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:11:42.100384 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a45938-65cc-4596-84cf-b7b0140ecc33 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:42.100969 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a45938-65cc-4596-84cf-b7b0140ecc33 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:42.100969 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a45938-65cc-4596-84cf-b7b0140ecc33 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:42.102324 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 720/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:11:42.108016 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e3c58-a8d6-48bf-825e-21effa731c5c None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:42.108443 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e3c58-a8d6-48bf-825e-21effa731c5c None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:42.108630 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e3c58-a8d6-48bf-825e-21effa731c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:42.156359 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:42.175641 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-b22e3c58-a8d6-48bf-825e-21effa731c5c None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:11:42.176873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-b22e3c58-a8d6-48bf-825e-21effa731c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:42.273656 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 728/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:11:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:11:42.562929 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a45938-65cc-4596-84cf-b7b0140ecc33 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:42.564452 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e2a45938-65cc-4596-84cf-b7b0140ecc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:42.671139 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a45938-65cc-4596-84cf-b7b0140ecc33 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:42.711224 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:42.746049 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca6aa9-fcf0-4539-9830-d19a10d386a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:42.746681 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca6aa9-fcf0-4539-9830-d19a10d386a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:42.746964 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca6aa9-fcf0-4539-9830-d19a10d386a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:42.747236 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca6aa9-fcf0-4539-9830-d19a10d386a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:42.748823 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a1ca6aa9-fcf0-4539-9830-d19a10d386a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:42.858443 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca6aa9-fcf0-4539-9830-d19a10d386a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:42.859916 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca6aa9-fcf0-4539-9830-d19a10d386a8 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:42.878209 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 721/1449] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:11:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:11:44.981691 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962faeaf-f74c-4933-ace9-55712884e7d2 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:44.982226 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962faeaf-f74c-4933-ace9-55712884e7d2 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:44.982324 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962faeaf-f74c-4933-ace9-55712884e7d2 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:44.983744 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 729/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:11:44.989136 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db89ac-b6fc-4a6a-b3d3-3b1017cb7c33 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:44.989567 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db89ac-b6fc-4a6a-b3d3-3b1017cb7c33 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:44.989662 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db89ac-b6fc-4a6a-b3d3-3b1017cb7c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:45.054404 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-96db89ac-b6fc-4a6a-b3d3-3b1017cb7c33 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:11:45.055629 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-96db89ac-b6fc-4a6a-b3d3-3b1017cb7c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:45.076658 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:45.151791 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 722/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:11:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:11:45.431634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962faeaf-f74c-4933-ace9-55712884e7d2 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:45.433155 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-962faeaf-f74c-4933-ace9-55712884e7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:45.535616 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962faeaf-f74c-4933-ace9-55712884e7d2 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:45.555384 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:45.610042 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf0730f-d88c-4392-abc3-b0917329824e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:45.610681 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0730f-d88c-4392-abc3-b0917329824e service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:45.610962 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0730f-d88c-4392-abc3-b0917329824e service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:45.611233 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0730f-d88c-4392-abc3-b0917329824e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:45.612820 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-7bf0730f-d88c-4392-abc3-b0917329824e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:45.725330 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf0730f-d88c-4392-abc3-b0917329824e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:45.726723 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf0730f-d88c-4392-abc3-b0917329824e service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:45.744907 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 730/1452] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:11:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:11:47.718548 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc25993-c62a-41cd-9df8-fb3f5868ac1b None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:47.719117 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc25993-c62a-41cd-9df8-fb3f5868ac1b None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:47.719117 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc25993-c62a-41cd-9df8-fb3f5868ac1b None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:47.720455 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 723/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:11:47.725824 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731c6e6-0dad-4efa-bec7-fad9f64962ed None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:47.726331 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731c6e6-0dad-4efa-bec7-fad9f64962ed None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:47.726475 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731c6e6-0dad-4efa-bec7-fad9f64962ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:47.789707 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:47.792320 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-5731c6e6-0dad-4efa-bec7-fad9f64962ed None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:11:47.794033 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-5731c6e6-0dad-4efa-bec7-fad9f64962ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:47.889361 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 731/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:11:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:11:48.173493 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc25993-c62a-41cd-9df8-fb3f5868ac1b None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:48.175051 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2fc25993-c62a-41cd-9df8-fb3f5868ac1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:48.276600 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc25993-c62a-41cd-9df8-fb3f5868ac1b None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:48.326272 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:48.350566 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37629981-6ef9-4615-9ce1-a248cdfd3b5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:48.351172 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37629981-6ef9-4615-9ce1-a248cdfd3b5d service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:48.351447 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37629981-6ef9-4615-9ce1-a248cdfd3b5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:48.351715 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37629981-6ef9-4615-9ce1-a248cdfd3b5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:48.353927 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-37629981-6ef9-4615-9ce1-a248cdfd3b5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:48.474613 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37629981-6ef9-4615-9ce1-a248cdfd3b5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:48.476027 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37629981-6ef9-4615-9ce1-a248cdfd3b5d service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:48.494126 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 724/1455] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:11:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:11:50.478998 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce5ae0-72e0-4350-bfc8-a0f49cd13daf None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:50.479536 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce5ae0-72e0-4350-bfc8-a0f49cd13daf None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:50.479536 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce5ae0-72e0-4350-bfc8-a0f49cd13daf None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:50.480904 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 732/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:11:50.486201 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066dd53e-1dff-417f-8f78-896ccf436c82 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:50.486691 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066dd53e-1dff-417f-8f78-896ccf436c82 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:50.486798 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066dd53e-1dff-417f-8f78-896ccf436c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:50.557156 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-066dd53e-1dff-417f-8f78-896ccf436c82 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:11:50.558354 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-066dd53e-1dff-417f-8f78-896ccf436c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:50.587605 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:50.656180 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 725/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:11:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:11:50.952025 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce5ae0-72e0-4350-bfc8-a0f49cd13daf None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:50.953738 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-7fce5ae0-72e0-4350-bfc8-a0f49cd13daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:51.059084 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce5ae0-72e0-4350-bfc8-a0f49cd13daf None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:51.087228 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:51.132554 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf41b6-d96e-4703-9a30-e493c344a93d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:51.133071 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf41b6-d96e-4703-9a30-e493c344a93d service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:51.133347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf41b6-d96e-4703-9a30-e493c344a93d service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:51.133617 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf41b6-d96e-4703-9a30-e493c344a93d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:51.135895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-6abf41b6-d96e-4703-9a30-e493c344a93d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:51.242997 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf41b6-d96e-4703-9a30-e493c344a93d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:51.245099 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf41b6-d96e-4703-9a30-e493c344a93d service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:51.262741 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 733/1458] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:11:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:11:53.205641 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4027dc-7dc0-4cfc-98f0-a311d1cdbabe None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:53.206308 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4027dc-7dc0-4cfc-98f0-a311d1cdbabe None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:53.206308 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4027dc-7dc0-4cfc-98f0-a311d1cdbabe None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:53.207666 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 726/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:11:53.213540 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d003cad-33e6-4995-bc82-9e1a32c0b51a None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:53.214010 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d003cad-33e6-4995-bc82-9e1a32c0b51a None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:53.214125 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d003cad-33e6-4995-bc82-9e1a32c0b51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:53.279280 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-0d003cad-33e6-4995-bc82-9e1a32c0b51a None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:11:53.280474 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-0d003cad-33e6-4995-bc82-9e1a32c0b51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:53.288761 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:53.377828 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 734/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:11:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:11:53.657343 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4027dc-7dc0-4cfc-98f0-a311d1cdbabe None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:53.658913 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8d4027dc-7dc0-4cfc-98f0-a311d1cdbabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:53.762884 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4027dc-7dc0-4cfc-98f0-a311d1cdbabe None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:53.817251 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:53.835305 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc2844-ce4a-4aaf-bfd5-6f680b44148a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:53.835906 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc2844-ce4a-4aaf-bfd5-6f680b44148a service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:53.836184 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc2844-ce4a-4aaf-bfd5-6f680b44148a service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:53.836450 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc2844-ce4a-4aaf-bfd5-6f680b44148a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:53.838613 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-31bc2844-ce4a-4aaf-bfd5-6f680b44148a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:53.946156 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc2844-ce4a-4aaf-bfd5-6f680b44148a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:53.947683 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc2844-ce4a-4aaf-bfd5-6f680b44148a service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:53.965731 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 727/1461] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:11:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:11:55.917538 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b110c3d-787b-4be5-aa52-5749bb218ee0 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:55.918275 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b110c3d-787b-4be5-aa52-5749bb218ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:55.918275 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b110c3d-787b-4be5-aa52-5749bb218ee0 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:55.919444 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 735/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:11:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:11:55.924921 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53517e7c-5536-47fe-a8d8-9d0705884bc2 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:55.925359 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53517e7c-5536-47fe-a8d8-9d0705884bc2 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:55.925472 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53517e7c-5536-47fe-a8d8-9d0705884bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:55.992066 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-53517e7c-5536-47fe-a8d8-9d0705884bc2 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:11:55.993303 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-53517e7c-5536-47fe-a8d8-9d0705884bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:56.031154 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:56.091244 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 728/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:11:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:11:56.373580 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b110c3d-787b-4be5-aa52-5749bb218ee0 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:56.375137 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-3b110c3d-787b-4be5-aa52-5749bb218ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:56.476627 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b110c3d-787b-4be5-aa52-5749bb218ee0 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:56.516579 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:56.552870 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81d1e7-0e47-4678-8adc-0ad1bbb58aed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:56.553473 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81d1e7-0e47-4678-8adc-0ad1bbb58aed service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:56.553746 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81d1e7-0e47-4678-8adc-0ad1bbb58aed service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:56.554011 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81d1e7-0e47-4678-8adc-0ad1bbb58aed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:56.555637 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-6b81d1e7-0e47-4678-8adc-0ad1bbb58aed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:56.663927 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81d1e7-0e47-4678-8adc-0ad1bbb58aed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:56.665365 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81d1e7-0e47-4678-8adc-0ad1bbb58aed service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:56.682710 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 736/1464] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:11:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:11:58.609030 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a19dfd-359b-4fd0-a3c4-8d46649931fd None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:58.609579 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a19dfd-359b-4fd0-a3c4-8d46649931fd None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:58.609579 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a19dfd-359b-4fd0-a3c4-8d46649931fd None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:58.611007 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 729/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:11:58.616342 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08a5c9-d5d6-47e6-a7dd-7737921a0066 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:58.616751 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08a5c9-d5d6-47e6-a7dd-7737921a0066 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:58.616885 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08a5c9-d5d6-47e6-a7dd-7737921a0066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:58.683961 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-ee08a5c9-d5d6-47e6-a7dd-7737921a0066 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:11:58.685181 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-ee08a5c9-d5d6-47e6-a7dd-7737921a0066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:58.703573 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:58.783574 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 737/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:11:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:11:59.067646 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a19dfd-359b-4fd0-a3c4-8d46649931fd None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:11:59.069183 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-69a19dfd-359b-4fd0-a3c4-8d46649931fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:59.172359 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a19dfd-359b-4fd0-a3c4-8d46649931fd None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:11:59.239557 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:59.247048 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b5100-4bb5-4a00-bcad-2dfba3deda4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:11:59.247654 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b5100-4bb5-4a00-bcad-2dfba3deda4f service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:11:59.247932 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b5100-4bb5-4a00-bcad-2dfba3deda4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:11:59.248206 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b5100-4bb5-4a00-bcad-2dfba3deda4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:11:59.249851 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7c1b5100-4bb5-4a00-bcad-2dfba3deda4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:11:59.360958 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b5100-4bb5-4a00-bcad-2dfba3deda4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:11:59.362407 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b5100-4bb5-4a00-bcad-2dfba3deda4f service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:11:59.379951 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 730/1467] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:11:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:12:01.314244 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618b148-ad83-4774-8b78-2d87c6c85f52 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:01.314825 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618b148-ad83-4774-8b78-2d87c6c85f52 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:01.314825 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618b148-ad83-4774-8b78-2d87c6c85f52 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:01.316123 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 738/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:12:01.321312 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768bbcc-9b25-422e-b944-f44292a1cd54 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:01.321750 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768bbcc-9b25-422e-b944-f44292a1cd54 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:01.322499 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768bbcc-9b25-422e-b944-f44292a1cd54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:01.387569 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-5768bbcc-9b25-422e-b944-f44292a1cd54 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:12:01.388758 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5768bbcc-9b25-422e-b944-f44292a1cd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:12:01.436078 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:01.483814 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 731/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:12:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:12:01.767241 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7618b148-ad83-4774-8b78-2d87c6c85f52 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:01.768762 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-7618b148-ad83-4774-8b78-2d87c6c85f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:12:01.872019 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7618b148-ad83-4774-8b78-2d87c6c85f52 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:01.920534 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:01.946166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c39b2-d4e9-4d1b-a35f-e9ac4286f742 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:01.947310 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c39b2-d4e9-4d1b-a35f-e9ac4286f742 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:01.947591 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c39b2-d4e9-4d1b-a35f-e9ac4286f742 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:01.947858 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c39b2-d4e9-4d1b-a35f-e9ac4286f742 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:01.949439 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-529c39b2-d4e9-4d1b-a35f-e9ac4286f742 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:12:02.064909 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c39b2-d4e9-4d1b-a35f-e9ac4286f742 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:02.066337 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c39b2-d4e9-4d1b-a35f-e9ac4286f742 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:02.084690 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 739/1470] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:12:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:12:11.482061 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=22 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:12.082498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=66 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:21.859632 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b871c9-d347-49fb-91b8-b4ffa16bd590 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:21.860243 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b871c9-d347-49fb-91b8-b4ffa16bd590 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:21.860243 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b871c9-d347-49fb-91b8-b4ffa16bd590 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:21.861523 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 732/1471] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:12:21.866672 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a8a16-401e-4412-a682-b242e40b44ff None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:21.867128 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a8a16-401e-4412-a682-b242e40b44ff None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:21.867244 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a8a16-401e-4412-a682-b242e40b44ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:21.939659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-c03a8a16-401e-4412-a682-b242e40b44ff None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:12:21.940929 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-c03a8a16-401e-4412-a682-b242e40b44ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:12:22.044853 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 740/1472] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:12:22.346385 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577167a-fbb8-440b-926a-50aaa4352de3 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:22.346707 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577167a-fbb8-440b-926a-50aaa4352de3 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:22.346979 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577167a-fbb8-440b-926a-50aaa4352de3 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:22.348302 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 733/1473] 10.222.0.79 () {54 vars in 967 bytes} [Wed Aug 31 19:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:12:22.355343 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd5d24-0ddb-422b-88e8-66eaf4712183 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:22.355633 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd5d24-0ddb-422b-88e8-66eaf4712183 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:22.355899 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd5d24-0ddb-422b-88e8-66eaf4712183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:22.434194 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-bfbd5d24-0ddb-422b-88e8-66eaf4712183 None None] MFA Rules not processed for user `254dd957da6345f79bcab42b27b8d2cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:12:22.435488 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-bfbd5d24-0ddb-422b-88e8-66eaf4712183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:12:22.456438 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:22.513760 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 741/1474] 10.222.0.79 () {58 vars in 1064 bytes} [Wed Aug 31 19:12:22 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:12:22.521532 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577167a-fbb8-440b-926a-50aaa4352de3 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:22.523632 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3577167a-fbb8-440b-926a-50aaa4352de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:12:22.636414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577167a-fbb8-440b-926a-50aaa4352de3 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:22.839956 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c24ab-7dad-4eab-b003-f81a910869d6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '254dd957da6345f79bcab42b27b8d2cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:22.840575 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c24ab-7dad-4eab-b003-f81a910869d6 service glance] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:22.840856 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c24ab-7dad-4eab-b003-f81a910869d6 service glance] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:22.841129 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c24ab-7dad-4eab-b003-f81a910869d6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:22.842785 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-fc4c24ab-7dad-4eab-b003-f81a910869d6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:12:22.898720 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:22.978109 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c24ab-7dad-4eab-b003-f81a910869d6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:22.980153 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c24ab-7dad-4eab-b003-f81a910869d6 service glance] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:22.999857 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 734/1475] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:12:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:12:25.028229 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692792c-7c86-40e4-b3ba-dd2e199b575e None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:25.028827 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692792c-7c86-40e4-b3ba-dd2e199b575e None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:25.028827 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692792c-7c86-40e4-b3ba-dd2e199b575e None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:25.030138 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 742/1476] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:12:25.035571 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d9851-bc96-434b-b6d0-67317e90cd07 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:25.036056 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d9851-bc96-434b-b6d0-67317e90cd07 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:25.036171 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d9851-bc96-434b-b6d0-67317e90cd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:25.103258 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-ee7d9851-bc96-434b-b6d0-67317e90cd07 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:12:25.104960 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ee7d9851-bc96-434b-b6d0-67317e90cd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:12:25.207104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 735/1477] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:12:25.483568 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692792c-7c86-40e4-b3ba-dd2e199b575e None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:25.485119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1692792c-7c86-40e4-b3ba-dd2e199b575e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:12:25.627756 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692792c-7c86-40e4-b3ba-dd2e199b575e None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:25.684061 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:25.733901 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb0d36-1239-463e-a0e2-1be59cf12083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:25.734381 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb0d36-1239-463e-a0e2-1be59cf12083 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:25.734754 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb0d36-1239-463e-a0e2-1be59cf12083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:25.735023 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb0d36-1239-463e-a0e2-1be59cf12083 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:25.735664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb0d36-1239-463e-a0e2-1be59cf12083 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:25.737439 dv-cinder-852210-6-smb devstack@keystone.service[81682]: WARNING py.warnings [None req-5fcb0d36-1239-463e-a0e2-1be59cf12083 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:12:25.737439 dv-cinder-852210-6-smb devstack@keystone.service[81682]: warnings.warn(msg) Aug 31 19:12:25.737439 dv-cinder-852210-6-smb devstack@keystone.service[81682]: Aug 31 19:12:25.738629 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb0d36-1239-463e-a0e2-1be59cf12083 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:25.758535 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 743/1478] 10.222.0.79 () {56 vars in 1108 bytes} [Wed Aug 31 19:12:25 2022] GET /identity/v3/projects => generated 2553 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:12:27.732356 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf92d38-f9e3-4ea2-b09a-ed6ebf6ec4c7 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:27.732937 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf92d38-f9e3-4ea2-b09a-ed6ebf6ec4c7 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:27.732937 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf92d38-f9e3-4ea2-b09a-ed6ebf6ec4c7 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:27.734296 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 736/1479] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:12:27.739959 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9832fe-5fa3-4aa4-ac94-f60e70f0d261 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:27.740463 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9832fe-5fa3-4aa4-ac94-f60e70f0d261 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:27.740592 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9832fe-5fa3-4aa4-ac94-f60e70f0d261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:27.820419 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-ae9832fe-5fa3-4aa4-ac94-f60e70f0d261 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:12:27.822338 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-ae9832fe-5fa3-4aa4-ac94-f60e70f0d261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:12:27.947605 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 744/1480] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:12:28.239505 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf92d38-f9e3-4ea2-b09a-ed6ebf6ec4c7 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:28.241026 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-bcf92d38-f9e3-4ea2-b09a-ed6ebf6ec4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:12:28.251670 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:28.402345 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf92d38-f9e3-4ea2-b09a-ed6ebf6ec4c7 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:28.497002 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:28.531301 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e4ec1-8a41-40c3-bdc5-b1a4f717ef7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:28.531915 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e4ec1-8a41-40c3-bdc5-b1a4f717ef7b service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:28.532196 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e4ec1-8a41-40c3-bdc5-b1a4f717ef7b service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:28.532463 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e4ec1-8a41-40c3-bdc5-b1a4f717ef7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:28.534067 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f96e4ec1-8a41-40c3-bdc5-b1a4f717ef7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:12:28.627670 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e4ec1-8a41-40c3-bdc5-b1a4f717ef7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:28.629403 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e4ec1-8a41-40c3-bdc5-b1a4f717ef7b service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:28.652868 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 737/1481] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:12:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:12:30.795304 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b4b69-9337-421e-947e-375177dd9498 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:30.795850 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b4b69-9337-421e-947e-375177dd9498 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:30.795850 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b4b69-9337-421e-947e-375177dd9498 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:30.797199 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 745/1482] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:12:30.803217 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670d393-0c0c-4be8-9a67-494c71cf5694 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:30.803832 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670d393-0c0c-4be8-9a67-494c71cf5694 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:30.803832 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670d393-0c0c-4be8-9a67-494c71cf5694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:30.874962 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-9670d393-0c0c-4be8-9a67-494c71cf5694 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:12:30.876153 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9670d393-0c0c-4be8-9a67-494c71cf5694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:12:30.923267 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:30.975114 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 738/1483] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:12:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:12:31.268338 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b4b69-9337-421e-947e-375177dd9498 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:31.269868 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-b89b4b69-9337-421e-947e-375177dd9498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:12:31.294762 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:31.378085 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b4b69-9337-421e-947e-375177dd9498 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:31.453388 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952977a0-4947-4f9a-aa16-867b3dab296b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:31.453996 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952977a0-4947-4f9a-aa16-867b3dab296b service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:31.454270 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952977a0-4947-4f9a-aa16-867b3dab296b service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:31.454568 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952977a0-4947-4f9a-aa16-867b3dab296b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:31.456175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-952977a0-4947-4f9a-aa16-867b3dab296b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:12:31.536263 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:31.580645 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952977a0-4947-4f9a-aa16-867b3dab296b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:31.582089 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952977a0-4947-4f9a-aa16-867b3dab296b service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:31.719497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 746/1484] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:12:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:12:33.812812 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22c969-d9f1-48da-877f-dba2b6dc326f None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:33.813412 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22c969-d9f1-48da-877f-dba2b6dc326f None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:33.813412 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22c969-d9f1-48da-877f-dba2b6dc326f None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:33.814811 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 739/1485] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:12:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:12:33.820257 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b661f08-b3bf-46fb-81fe-ceb28168b244 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:33.820694 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b661f08-b3bf-46fb-81fe-ceb28168b244 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:33.820802 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b661f08-b3bf-46fb-81fe-ceb28168b244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:33.897990 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-8b661f08-b3bf-46fb-81fe-ceb28168b244 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:12:33.899277 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-8b661f08-b3bf-46fb-81fe-ceb28168b244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:12:34.005096 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 747/1486] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:12:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:12:34.307904 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f22c969-d9f1-48da-877f-dba2b6dc326f None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:34.309488 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7f22c969-d9f1-48da-877f-dba2b6dc326f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:12:34.426428 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f22c969-d9f1-48da-877f-dba2b6dc326f None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:34.508473 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:34.508938 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13967b68-17b4-4a83-9e01-72423523dcb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:34.509597 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13967b68-17b4-4a83-9e01-72423523dcb9 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:34.510172 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13967b68-17b4-4a83-9e01-72423523dcb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:34.510778 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13967b68-17b4-4a83-9e01-72423523dcb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:34.513036 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-13967b68-17b4-4a83-9e01-72423523dcb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:12:34.641077 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13967b68-17b4-4a83-9e01-72423523dcb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:34.642559 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13967b68-17b4-4a83-9e01-72423523dcb9 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:34.669086 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 740/1487] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:12:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:12:36.684985 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb73cf-f746-47df-8d1b-10fce4f78bbb None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:36.685511 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb73cf-f746-47df-8d1b-10fce4f78bbb None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:36.685511 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb73cf-f746-47df-8d1b-10fce4f78bbb None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:36.686811 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 748/1488] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:12:36.692296 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e0cbd-ac4f-4d20-8377-0aea8a4d20d2 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:36.692880 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e0cbd-ac4f-4d20-8377-0aea8a4d20d2 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:36.692880 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e0cbd-ac4f-4d20-8377-0aea8a4d20d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:36.765087 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-048e0cbd-ac4f-4d20-8377-0aea8a4d20d2 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:12:36.766291 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-048e0cbd-ac4f-4d20-8377-0aea8a4d20d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:12:36.821002 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:36.876807 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 741/1489] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:12:37.164688 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb73cf-f746-47df-8d1b-10fce4f78bbb None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:37.166844 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-22cb73cf-f746-47df-8d1b-10fce4f78bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:12:37.207347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:37.282974 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb73cf-f746-47df-8d1b-10fce4f78bbb None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:37.367577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f73e5-6f7c-4565-8b3d-f3dbf56a5433 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:37.368179 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f73e5-6f7c-4565-8b3d-f3dbf56a5433 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:37.368451 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f73e5-6f7c-4565-8b3d-f3dbf56a5433 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:37.368721 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f73e5-6f7c-4565-8b3d-f3dbf56a5433 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:37.370950 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-bf1f73e5-6f7c-4565-8b3d-f3dbf56a5433 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:12:37.456878 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:37.487929 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1f73e5-6f7c-4565-8b3d-f3dbf56a5433 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:37.489367 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1f73e5-6f7c-4565-8b3d-f3dbf56a5433 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:37.508128 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 749/1490] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:12:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:12:39.824079 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ab413-0323-4bfe-b7ea-326101c1db51 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:39.824626 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ab413-0323-4bfe-b7ea-326101c1db51 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:39.824626 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ab413-0323-4bfe-b7ea-326101c1db51 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:39.826018 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 742/1491] 10.222.0.79 () {54 vars in 927 bytes} [Wed Aug 31 19:12:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:12:39.832532 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e3c8e-d6c1-4fd4-9853-04c5b614e5d5 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:39.833027 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e3c8e-d6c1-4fd4-9853-04c5b614e5d5 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:39.833363 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e3c8e-d6c1-4fd4-9853-04c5b614e5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:39.908756 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-2e0e3c8e-d6c1-4fd4-9853-04c5b614e5d5 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:12:39.910067 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-2e0e3c8e-d6c1-4fd4-9853-04c5b614e5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:12:40.016956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 750/1492] 10.222.0.79 () {58 vars in 1024 bytes} [Wed Aug 31 19:12:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:12:40.311312 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ab413-0323-4bfe-b7ea-326101c1db51 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:12:40.312837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-eb8ab413-0323-4bfe-b7ea-326101c1db51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:12:40.424085 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ab413-0323-4bfe-b7ea-326101c1db51 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:12:40.501190 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09509d6-a003-4167-85ab-17ffaa4fd8e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:12:40.501795 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09509d6-a003-4167-85ab-17ffaa4fd8e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:12:40.502075 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09509d6-a003-4167-85ab-17ffaa4fd8e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:12:40.502339 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09509d6-a003-4167-85ab-17ffaa4fd8e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:12:40.503986 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c09509d6-a003-4167-85ab-17ffaa4fd8e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:12:40.514008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:40.629254 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09509d6-a003-4167-85ab-17ffaa4fd8e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:12:40.630910 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09509d6-a003-4167-85ab-17ffaa4fd8e2 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:12:40.650696 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 743/1493] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:12:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:12:50.015128 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=82 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:50.648470 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=50 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:13:53.293493 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94644f-2442-489a-abee-025f47c60564 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:13:53.294653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94644f-2442-489a-abee-025f47c60564 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:13:53.294653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94644f-2442-489a-abee-025f47c60564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:13:53.373699 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-4e94644f-2442-489a-abee-025f47c60564 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:13:53.379513 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-4e94644f-2442-489a-abee-025f47c60564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:13:53.482410 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 751/1494] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:13:53.490602 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8de4cb-db86-4d45-b0cc-b90b46fea566 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:13:53.491140 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8de4cb-db86-4d45-b0cc-b90b46fea566 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:13:53.491140 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8de4cb-db86-4d45-b0cc-b90b46fea566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:13:53.567520 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-2e8de4cb-db86-4d45-b0cc-b90b46fea566 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:13:53.568658 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2e8de4cb-db86-4d45-b0cc-b90b46fea566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:13:53.664199 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 744/1495] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:13:53.669116 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e94644f-2442-489a-abee-025f47c60564 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:13:53.670917 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-4e94644f-2442-489a-abee-025f47c60564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:13:53.682129 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e94644f-2442-489a-abee-025f47c60564 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:13:53.742294 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:13:53.777701 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897fca4-20b0-4ea8-a511-ef2e1d035bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:13:53.778300 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897fca4-20b0-4ea8-a511-ef2e1d035bba admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:13:53.779107 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897fca4-20b0-4ea8-a511-ef2e1d035bba admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:13:53.779378 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897fca4-20b0-4ea8-a511-ef2e1d035bba admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:13:53.780013 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897fca4-20b0-4ea8-a511-ef2e1d035bba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:13:53.780311 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897fca4-20b0-4ea8-a511-ef2e1d035bba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:13:53.781316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: WARNING py.warnings [None req-4897fca4-20b0-4ea8-a511-ef2e1d035bba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:13:53.781316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: warnings.warn(msg) Aug 31 19:13:53.781316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: Aug 31 19:13:53.782194 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897fca4-20b0-4ea8-a511-ef2e1d035bba admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:13:53.793068 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 752/1496] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:13:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:13:53.801824 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8de4cb-db86-4d45-b0cc-b90b46fea566 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:13:53.810783 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8de4cb-db86-4d45-b0cc-b90b46fea566 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:13:53.871891 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:13:53.906766 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f8bc2-cc39-47ba-aef0-a439130d09fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:13:53.907366 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f8bc2-cc39-47ba-aef0-a439130d09fc admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:13:53.907640 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f8bc2-cc39-47ba-aef0-a439130d09fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:13:53.907909 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f8bc2-cc39-47ba-aef0-a439130d09fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:13:53.908545 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f8bc2-cc39-47ba-aef0-a439130d09fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:13:53.910281 dv-cinder-852210-6-smb devstack@keystone.service[81683]: WARNING py.warnings [None req-fc8f8bc2-cc39-47ba-aef0-a439130d09fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:13:53.910281 dv-cinder-852210-6-smb devstack@keystone.service[81683]: warnings.warn(msg) Aug 31 19:13:53.910281 dv-cinder-852210-6-smb devstack@keystone.service[81683]: Aug 31 19:13:53.911514 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f8bc2-cc39-47ba-aef0-a439130d09fc admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:13:53.968316 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 745/1497] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:13:53 2022] POST /identity/v3/projects => generated 377 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:13:53.972853 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897fca4-20b0-4ea8-a511-ef2e1d035bba admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:13:53.974374 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-4897fca4-20b0-4ea8-a511-ef2e1d035bba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:13:54.008141 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897fca4-20b0-4ea8-a511-ef2e1d035bba admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:13:54.102989 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521af61-2822-4ca4-b151-dc3d07dfa654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:13:54.103588 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521af61-2822-4ca4-b151-dc3d07dfa654 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:13:54.103860 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521af61-2822-4ca4-b151-dc3d07dfa654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:13:54.104121 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521af61-2822-4ca4-b151-dc3d07dfa654 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:13:54.104735 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a521af61-2822-4ca4-b151-dc3d07dfa654 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:13:54.105731 dv-cinder-852210-6-smb devstack@keystone.service[81682]: WARNING py.warnings [None req-a521af61-2822-4ca4-b151-dc3d07dfa654 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:13:54.105731 dv-cinder-852210-6-smb devstack@keystone.service[81682]: warnings.warn(msg) Aug 31 19:13:54.105731 dv-cinder-852210-6-smb devstack@keystone.service[81682]: Aug 31 19:13:54.106947 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a521af61-2822-4ca4-b151-dc3d07dfa654 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:13:54.148381 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 753/1498] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:13:53 2022] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:13:54.152576 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f8bc2-cc39-47ba-aef0-a439130d09fc admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:13:54.154670 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-fc8f8bc2-cc39-47ba-aef0-a439130d09fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:13:54.215076 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f8bc2-cc39-47ba-aef0-a439130d09fc admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:13:54.298239 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:13:54.310788 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb59a95-6456-472a-9751-f16eba0beb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:13:54.311397 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb59a95-6456-472a-9751-f16eba0beb9e admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:13:54.311676 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb59a95-6456-472a-9751-f16eba0beb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:13:54.311948 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb59a95-6456-472a-9751-f16eba0beb9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:13:54.312591 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb59a95-6456-472a-9751-f16eba0beb9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:13:54.313605 dv-cinder-852210-6-smb devstack@keystone.service[81683]: WARNING py.warnings [None req-8cb59a95-6456-472a-9751-f16eba0beb9e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:13:54.313605 dv-cinder-852210-6-smb devstack@keystone.service[81683]: warnings.warn(msg) Aug 31 19:13:54.313605 dv-cinder-852210-6-smb devstack@keystone.service[81683]: Aug 31 19:13:54.314505 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb59a95-6456-472a-9751-f16eba0beb9e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:13:54.327916 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 746/1499] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:13:54.332141 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521af61-2822-4ca4-b151-dc3d07dfa654 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:13:54.333638 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-a521af61-2822-4ca4-b151-dc3d07dfa654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:13:54.344988 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521af61-2822-4ca4-b151-dc3d07dfa654 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:13:54.369704 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:13:54.440458 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9219bc0-2794-49fe-891a-060379d6d8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:13:54.440986 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9219bc0-2794-49fe-891a-060379d6d8fe admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:13:54.441263 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9219bc0-2794-49fe-891a-060379d6d8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:13:54.441533 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9219bc0-2794-49fe-891a-060379d6d8fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:13:54.442171 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9219bc0-2794-49fe-891a-060379d6d8fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:13:54.443207 dv-cinder-852210-6-smb devstack@keystone.service[81682]: WARNING py.warnings [None req-b9219bc0-2794-49fe-891a-060379d6d8fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:13:54.443207 dv-cinder-852210-6-smb devstack@keystone.service[81682]: warnings.warn(msg) Aug 31 19:13:54.443207 dv-cinder-852210-6-smb devstack@keystone.service[81682]: Aug 31 19:13:54.444089 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9219bc0-2794-49fe-891a-060379d6d8fe admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:13:54.457466 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 754/1500] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:13:54.461671 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb59a95-6456-472a-9751-f16eba0beb9e admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:13:54.463371 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8cb59a95-6456-472a-9751-f16eba0beb9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:13:54.495920 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb59a95-6456-472a-9751-f16eba0beb9e admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:13:54.591201 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4aeb62-da09-4140-80bb-566cfb00595f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:13:54.591861 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4aeb62-da09-4140-80bb-566cfb00595f admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:13:54.592140 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4aeb62-da09-4140-80bb-566cfb00595f admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:13:54.592412 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4aeb62-da09-4140-80bb-566cfb00595f admin admin] PATH_INFO: `/v3/projects/3a29dc70a6b24476a4b6de60101c0a98/users/9fee00e378f94e0ab07adf6e99c83c9f/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:13:54.614942 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4aeb62-da09-4140-80bb-566cfb00595f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a29dc70a6b24476a4b6de60101c0a98, user_id=9fee00e378f94e0ab07adf6e99c83c9f, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:13:54.615969 dv-cinder-852210-6-smb devstack@keystone.service[81683]: WARNING py.warnings [None req-2e4aeb62-da09-4140-80bb-566cfb00595f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:13:54.615969 dv-cinder-852210-6-smb devstack@keystone.service[81683]: warnings.warn(msg) Aug 31 19:13:54.615969 dv-cinder-852210-6-smb devstack@keystone.service[81683]: Aug 31 19:13:54.617911 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4aeb62-da09-4140-80bb-566cfb00595f admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:13:54.642415 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 747/1501] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:13:54 2022] PUT /identity/v3/projects/3a29dc70a6b24476a4b6de60101c0a98/users/9fee00e378f94e0ab07adf6e99c83c9f/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:13:54.654580 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e0077-ecc3-4b2f-b06c-e4d70a7b0e7f None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:13:54.654862 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e0077-ecc3-4b2f-b06c-e4d70a7b0e7f None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:13:54.655134 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e0077-ecc3-4b2f-b06c-e4d70a7b0e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:13:54.713124 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-754e0077-ecc3-4b2f-b06c-e4d70a7b0e7f None None] MFA Rules not processed for user `9fee00e378f94e0ab07adf6e99c83c9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:13:54.714247 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-754e0077-ecc3-4b2f-b06c-e4d70a7b0e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:13:54.792785 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 755/1502] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:13:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:13:54.806448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781df66-c295-4972-a0dc-4dcd9fa21660 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:13:54.806762 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781df66-c295-4972-a0dc-4dcd9fa21660 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:13:54.807030 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781df66-c295-4972-a0dc-4dcd9fa21660 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:13:54.808360 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 748/1503] 10.222.0.79 () {54 vars in 964 bytes} [Wed Aug 31 19:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:13:54.813962 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca02907-6959-4be2-a019-73669c241f83 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:13:54.814249 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca02907-6959-4be2-a019-73669c241f83 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:13:54.814564 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca02907-6959-4be2-a019-73669c241f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:13:54.845233 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:13:54.891588 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-eca02907-6959-4be2-a019-73669c241f83 None None] MFA Rules not processed for user `17e0a157474749939b6f8d2af26d7d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:13:54.892810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-eca02907-6959-4be2-a019-73669c241f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:13:54.969861 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 756/1504] 10.222.0.79 () {58 vars in 1061 bytes} [Wed Aug 31 19:13:54 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:13:54.979625 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e781df66-c295-4972-a0dc-4dcd9fa21660 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:13:54.981170 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e781df66-c295-4972-a0dc-4dcd9fa21660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:13:55.031643 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:13:55.084955 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e781df66-c295-4972-a0dc-4dcd9fa21660 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:13:55.158533 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b6fd6-4bd8-4db9-9342-58e3168e8d7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:13:55.159140 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b6fd6-4bd8-4db9-9342-58e3168e8d7e service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:13:55.159418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b6fd6-4bd8-4db9-9342-58e3168e8d7e service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:13:55.159688 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b6fd6-4bd8-4db9-9342-58e3168e8d7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:13:55.161274 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-221b6fd6-4bd8-4db9-9342-58e3168e8d7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:13:55.258698 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b6fd6-4bd8-4db9-9342-58e3168e8d7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:13:55.260096 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b6fd6-4bd8-4db9-9342-58e3168e8d7e service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:13:55.263644 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:13:55.279764 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 749/1505] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:13:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:13:55.325191 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d3d63-323f-42c8-9961-bd887b709db7 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:13:55.326029 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d3d63-323f-42c8-9961-bd887b709db7 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:13:55.326304 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d3d63-323f-42c8-9961-bd887b709db7 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:13:55.327637 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 757/1506] 10.222.0.79 () {52 vars in 830 bytes} [Wed Aug 31 19:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:13:55.331138 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b6fd6-4bd8-4db9-9342-58e3168e8d7e service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:13:55.332328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-221b6fd6-4bd8-4db9-9342-58e3168e8d7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:13:55.432466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b6fd6-4bd8-4db9-9342-58e3168e8d7e service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:13:55.536543 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e6d8b2-c013-4518-990c-558d47cbc227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:13:55.537199 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6d8b2-c013-4518-990c-558d47cbc227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:13:55.537362 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6d8b2-c013-4518-990c-558d47cbc227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:13:55.537629 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6d8b2-c013-4518-990c-558d47cbc227 admin admin] PATH_INFO: `/v3/users/9fee00e378f94e0ab07adf6e99c83c9f` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:13:55.550677 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e6d8b2-c013-4518-990c-558d47cbc227 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fee00e378f94e0ab07adf6e99c83c9f)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:13:55.551730 dv-cinder-852210-6-smb devstack@keystone.service[81683]: WARNING py.warnings [None req-45e6d8b2-c013-4518-990c-558d47cbc227 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:13:55.551730 dv-cinder-852210-6-smb devstack@keystone.service[81683]: warnings.warn(msg) Aug 31 19:13:55.551730 dv-cinder-852210-6-smb devstack@keystone.service[81683]: Aug 31 19:13:55.552935 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e6d8b2-c013-4518-990c-558d47cbc227 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:13:55.563509 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:13:55.624815 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-45e6d8b2-c013-4518-990c-558d47cbc227 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fee00e378f94e0ab07adf6e99c83c9f'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:13:55.635464 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-45e6d8b2-c013-4518-990c-558d47cbc227 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fee00e378f94e0ab07adf6e99c83c9f'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:13:55.651747 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-45e6d8b2-c013-4518-990c-558d47cbc227 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fee00e378f94e0ab07adf6e99c83c9f'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:13:55.676358 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-45e6d8b2-c013-4518-990c-558d47cbc227 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fee00e378f94e0ab07adf6e99c83c9f'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:13:55.677409 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-45e6d8b2-c013-4518-990c-558d47cbc227 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fee00e378f94e0ab07adf6e99c83c9f'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:13:55.687336 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 750/1507] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:13:55 2022] DELETE /identity/v3/users/9fee00e378f94e0ab07adf6e99c83c9f => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:13:55.691719 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214a345-62ed-45ba-8300-11cf437ce991 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:13:55.692334 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214a345-62ed-45ba-8300-11cf437ce991 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:13:55.692544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214a345-62ed-45ba-8300-11cf437ce991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:13:55.756132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-f214a345-62ed-45ba-8300-11cf437ce991 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:13:55.757416 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f214a345-62ed-45ba-8300-11cf437ce991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:13:55.836999 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:13:55.851798 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 758/1508] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:13:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:13:55.861543 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e6d8b2-c013-4518-990c-558d47cbc227 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:13:55.862801 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-45e6d8b2-c013-4518-990c-558d47cbc227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:13:55.967781 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e6d8b2-c013-4518-990c-558d47cbc227 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:13:56.026691 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:13:56.048016 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8fc4e7-902b-43a0-b319-d21b9a53aaa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:13:56.048629 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fc4e7-902b-43a0-b319-d21b9a53aaa3 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:13:56.048908 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fc4e7-902b-43a0-b319-d21b9a53aaa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:13:56.049177 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fc4e7-902b-43a0-b319-d21b9a53aaa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:13:56.050804 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0b8fc4e7-902b-43a0-b319-d21b9a53aaa3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:13:56.173708 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8fc4e7-902b-43a0-b319-d21b9a53aaa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:13:56.175115 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8fc4e7-902b-43a0-b319-d21b9a53aaa3 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:13:56.194405 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 751/1509] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:13:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:13:56.572164 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214a345-62ed-45ba-8300-11cf437ce991 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:13:56.573430 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f214a345-62ed-45ba-8300-11cf437ce991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:13:56.585209 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214a345-62ed-45ba-8300-11cf437ce991 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:13:56.696869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a174221-26b9-407d-8087-5414b3d17ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:13:56.697555 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a174221-26b9-407d-8087-5414b3d17ee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:13:56.697675 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a174221-26b9-407d-8087-5414b3d17ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:13:56.697955 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a174221-26b9-407d-8087-5414b3d17ee8 admin admin] PATH_INFO: `/v3/projects/3a29dc70a6b24476a4b6de60101c0a98` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:13:56.709238 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a174221-26b9-407d-8087-5414b3d17ee8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a29dc70a6b24476a4b6de60101c0a98)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:13:56.710287 dv-cinder-852210-6-smb devstack@keystone.service[81682]: WARNING py.warnings [None req-8a174221-26b9-407d-8087-5414b3d17ee8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:13:56.710287 dv-cinder-852210-6-smb devstack@keystone.service[81682]: warnings.warn(msg) Aug 31 19:13:56.710287 dv-cinder-852210-6-smb devstack@keystone.service[81682]: Aug 31 19:13:56.711628 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a174221-26b9-407d-8087-5414b3d17ee8 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:13:56.771789 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-8a174221-26b9-407d-8087-5414b3d17ee8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a29dc70a6b24476a4b6de60101c0a98', 'request_id': 'req-8a174221-26b9-407d-8087-5414b3d17ee8'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:13:56.779478 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-8a174221-26b9-407d-8087-5414b3d17ee8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a29dc70a6b24476a4b6de60101c0a98', 'request_id': 'req-8a174221-26b9-407d-8087-5414b3d17ee8'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:13:56.795450 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-8a174221-26b9-407d-8087-5414b3d17ee8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a29dc70a6b24476a4b6de60101c0a98', 'request_id': 'req-8a174221-26b9-407d-8087-5414b3d17ee8'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:13:56.825270 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-8a174221-26b9-407d-8087-5414b3d17ee8 admin admin] The token cache is being invalidate because project 3a29dc70a6b24476a4b6de60101c0a98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:13:56.826089 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-8a174221-26b9-407d-8087-5414b3d17ee8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:13:56.826619 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-8a174221-26b9-407d-8087-5414b3d17ee8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:13:56.827939 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 759/1510] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:13:56 2022] DELETE /identity/v3/projects/3a29dc70a6b24476a4b6de60101c0a98 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:14:06.192062 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=62 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:14:06.823099 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:15:42.544264 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b8488-c750-4a1e-a84b-9d5cd13140ac None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:15:42.544779 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b8488-c750-4a1e-a84b-9d5cd13140ac None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:15:42.544903 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b8488-c750-4a1e-a84b-9d5cd13140ac None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:15:42.546175 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 752/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 19:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:15:42.551930 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c1ea4-8939-4201-b53c-b7027670b956 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:15:42.552466 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c1ea4-8939-4201-b53c-b7027670b956 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:15:42.552577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c1ea4-8939-4201-b53c-b7027670b956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:15:42.636895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-362c1ea4-8939-4201-b53c-b7027670b956 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:15:42.638121 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-362c1ea4-8939-4201-b53c-b7027670b956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:15:42.748996 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 760/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 19:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:15:42.903643 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b8488-c750-4a1e-a84b-9d5cd13140ac None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:15:42.905805 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-754b8488-c750-4a1e-a84b-9d5cd13140ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:15:43.025627 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b8488-c750-4a1e-a84b-9d5cd13140ac None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:15:43.031005 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d94810-d987-49c2-9bab-99a32d58645d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:15:43.031610 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d94810-d987-49c2-9bab-99a32d58645d service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:15:43.031892 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d94810-d987-49c2-9bab-99a32d58645d service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:15:43.032169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d94810-d987-49c2-9bab-99a32d58645d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:15:43.040985 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d94810-d987-49c2-9bab-99a32d58645d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:15:43.042603 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d94810-d987-49c2-9bab-99a32d58645d service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:15:43.051957 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 753/1513] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:15:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:15:43.886962 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756de7f-ed5e-4e2e-9231-b92e53b10391 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:15:43.887528 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756de7f-ed5e-4e2e-9231-b92e53b10391 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:15:43.887528 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756de7f-ed5e-4e2e-9231-b92e53b10391 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:15:43.888858 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 761/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 19:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:15:43.894122 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae308b-a5f8-46c9-9d55-6498ab27f793 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:15:43.894536 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae308b-a5f8-46c9-9d55-6498ab27f793 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:15:43.894706 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae308b-a5f8-46c9-9d55-6498ab27f793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:15:43.914730 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-66ae308b-a5f8-46c9-9d55-6498ab27f793 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:15:43.915921 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-66ae308b-a5f8-46c9-9d55-6498ab27f793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:15:43.923720 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 754/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 19:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:15:44.076641 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756de7f-ed5e-4e2e-9231-b92e53b10391 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:15:44.091511 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756de7f-ed5e-4e2e-9231-b92e53b10391 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:15:44.097090 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73286530-ec2c-4e13-8a4c-4f0b2a9844fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:15:44.097682 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73286530-ec2c-4e13-8a4c-4f0b2a9844fa service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:15:44.098231 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73286530-ec2c-4e13-8a4c-4f0b2a9844fa service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:15:44.098527 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73286530-ec2c-4e13-8a4c-4f0b2a9844fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:15:44.106891 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73286530-ec2c-4e13-8a4c-4f0b2a9844fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:15:44.108493 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73286530-ec2c-4e13-8a4c-4f0b2a9844fa service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:15:44.117985 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 762/1516] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:15:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:15:47.475105 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8553de0-12e0-429d-8d73-406f6a1e65ff None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:15:47.475679 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8553de0-12e0-429d-8d73-406f6a1e65ff None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:15:47.475679 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8553de0-12e0-429d-8d73-406f6a1e65ff None None] PATH_INFO: `/v3` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:15:47.476993 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 755/1517] 10.222.0.91 () {54 vars in 925 bytes} [Wed Aug 31 19:15:47 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:15:47.486838 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc608820-fd8c-456a-8941-8f7c9182948a None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:15:47.487247 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc608820-fd8c-456a-8941-8f7c9182948a None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:15:47.487386 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc608820-fd8c-456a-8941-8f7c9182948a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:15:47.546975 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-dc608820-fd8c-456a-8941-8f7c9182948a None None] MFA Rules not processed for user `ece00ea631594381bf1c27cfc2ece6f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:15:47.548198 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-dc608820-fd8c-456a-8941-8f7c9182948a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:15:47.564902 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:15:47.619162 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 763/1518] 10.222.0.91 () {58 vars in 1015 bytes} [Wed Aug 31 19:15:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:15:52.202214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df8c02-657e-44d6-a605-5d0b89286790 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:15:52.202832 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df8c02-657e-44d6-a605-5d0b89286790 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:15:52.202832 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df8c02-657e-44d6-a605-5d0b89286790 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:15:52.204045 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 756/1519] 10.222.0.79 () {54 vars in 961 bytes} [Wed Aug 31 19:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:15:52.209093 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b74386-783a-4514-b445-8554aa12799b None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:15:52.209570 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b74386-783a-4514-b445-8554aa12799b None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:15:52.209713 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b74386-783a-4514-b445-8554aa12799b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:15:52.229624 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-e8b74386-783a-4514-b445-8554aa12799b None None] MFA Rules not processed for user `ece00ea631594381bf1c27cfc2ece6f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:15:52.230852 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-e8b74386-783a-4514-b445-8554aa12799b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:15:52.239398 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 764/1520] 10.222.0.79 () {58 vars in 1058 bytes} [Wed Aug 31 19:15:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:15:52.247350 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df8c02-657e-44d6-a605-5d0b89286790 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:15:52.261038 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df8c02-657e-44d6-a605-5d0b89286790 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:15:52.265892 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d25389-421d-4e72-a793-7633c15765e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece00ea631594381bf1c27cfc2ece6f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:15:52.266514 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d25389-421d-4e72-a793-7633c15765e6 service placement] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:15:52.266798 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d25389-421d-4e72-a793-7633c15765e6 service placement] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:15:52.267069 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d25389-421d-4e72-a793-7633c15765e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:15:52.275336 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d25389-421d-4e72-a793-7633c15765e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:15:52.276915 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d25389-421d-4e72-a793-7633c15765e6 service placement] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:15:52.286154 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 757/1521] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:15:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:15:55.357634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161106e-370a-46f4-aea4-1268d18d6cbf None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:15:55.358211 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161106e-370a-46f4-aea4-1268d18d6cbf None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:15:55.358211 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161106e-370a-46f4-aea4-1268d18d6cbf None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:15:55.359557 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 765/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 19:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:15:55.364409 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc5728-fb95-4170-99de-d890e1dafec8 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:15:55.365369 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc5728-fb95-4170-99de-d890e1dafec8 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:15:55.365558 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc5728-fb95-4170-99de-d890e1dafec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:15:55.384497 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-c8fc5728-fb95-4170-99de-d890e1dafec8 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:15:55.385688 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c8fc5728-fb95-4170-99de-d890e1dafec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:15:55.393382 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 758/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 19:15:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:15:55.547457 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161106e-370a-46f4-aea4-1268d18d6cbf None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:15:55.561721 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161106e-370a-46f4-aea4-1268d18d6cbf None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:15:55.567108 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63da4ca-2be8-4430-96f0-f5e6b2ee2fd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:15:55.567732 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63da4ca-2be8-4430-96f0-f5e6b2ee2fd9 service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:15:55.568009 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63da4ca-2be8-4430-96f0-f5e6b2ee2fd9 service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:15:55.568285 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63da4ca-2be8-4430-96f0-f5e6b2ee2fd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:15:55.576189 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63da4ca-2be8-4430-96f0-f5e6b2ee2fd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:15:55.577757 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63da4ca-2be8-4430-96f0-f5e6b2ee2fd9 service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:15:55.587494 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 766/1524] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:15:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:15:56.417883 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd917d5-8833-42a2-bc8c-681f0d78dfd8 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:15:56.418574 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd917d5-8833-42a2-bc8c-681f0d78dfd8 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:15:56.418574 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd917d5-8833-42a2-bc8c-681f0d78dfd8 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:15:56.419811 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 759/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 19:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:15:56.424559 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa672c3e-496e-4b4f-a6aa-966895f58335 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:15:56.424989 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa672c3e-496e-4b4f-a6aa-966895f58335 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:15:56.425105 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa672c3e-496e-4b4f-a6aa-966895f58335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:15:56.445109 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-aa672c3e-496e-4b4f-a6aa-966895f58335 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:15:56.446289 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-aa672c3e-496e-4b4f-a6aa-966895f58335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:15:56.454389 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 767/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 19:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:15:56.604053 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd917d5-8833-42a2-bc8c-681f0d78dfd8 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:15:56.618602 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd917d5-8833-42a2-bc8c-681f0d78dfd8 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:15:56.623966 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee84d77-ec88-45c5-ad18-e1112cd152cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:15:56.624567 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee84d77-ec88-45c5-ad18-e1112cd152cf service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:15:56.624828 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee84d77-ec88-45c5-ad18-e1112cd152cf service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:15:56.625101 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee84d77-ec88-45c5-ad18-e1112cd152cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:15:56.633512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee84d77-ec88-45c5-ad18-e1112cd152cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:15:56.635110 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee84d77-ec88-45c5-ad18-e1112cd152cf service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:15:56.644219 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 760/1527] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:15:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:16:00.519687 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2773eea-93ad-4562-9d09-aa3d2a69c23b None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:16:00.520289 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2773eea-93ad-4562-9d09-aa3d2a69c23b None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:16:00.520289 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2773eea-93ad-4562-9d09-aa3d2a69c23b None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:16:00.521616 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 768/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:16:00.526763 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6925a-821a-4710-8c95-907c5c4f7a17 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:16:00.527235 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6925a-821a-4710-8c95-907c5c4f7a17 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:16:00.527339 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6925a-821a-4710-8c95-907c5c4f7a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:16:00.547386 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-7fb6925a-821a-4710-8c95-907c5c4f7a17 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:16:00.548573 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7fb6925a-821a-4710-8c95-907c5c4f7a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:16:00.556997 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 761/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:16:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:16:00.844236 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2773eea-93ad-4562-9d09-aa3d2a69c23b None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:16:00.845922 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f2773eea-93ad-4562-9d09-aa3d2a69c23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:16:00.934028 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2773eea-93ad-4562-9d09-aa3d2a69c23b None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:16:00.938145 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c018e43-1d8c-4ddb-9dec-c353abb6010e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:16:00.938791 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c018e43-1d8c-4ddb-9dec-c353abb6010e service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:16:00.939073 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c018e43-1d8c-4ddb-9dec-c353abb6010e service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:16:00.939711 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c018e43-1d8c-4ddb-9dec-c353abb6010e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:16:00.950998 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c018e43-1d8c-4ddb-9dec-c353abb6010e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:16:00.952420 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c018e43-1d8c-4ddb-9dec-c353abb6010e service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:16:00.964539 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 769/1530] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:16:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:16:02.870299 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa19306-92bb-4b79-bfac-b8543871c8e5 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:16:02.870903 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa19306-92bb-4b79-bfac-b8543871c8e5 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:16:02.870903 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa19306-92bb-4b79-bfac-b8543871c8e5 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:16:02.872199 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 762/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:16:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:16:02.877558 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c802dd-b0c8-47f2-a36d-693278354eb7 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:16:02.878002 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c802dd-b0c8-47f2-a36d-693278354eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:16:02.878118 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c802dd-b0c8-47f2-a36d-693278354eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:16:02.898781 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-41c802dd-b0c8-47f2-a36d-693278354eb7 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:16:02.899974 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-41c802dd-b0c8-47f2-a36d-693278354eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:16:02.907788 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 770/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:16:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:16:03.196328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa19306-92bb-4b79-bfac-b8543871c8e5 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:16:03.198024 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0fa19306-92bb-4b79-bfac-b8543871c8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:16:03.211189 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa19306-92bb-4b79-bfac-b8543871c8e5 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:16:03.214716 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8627dcd-4c86-4f3b-88f2-34570f7819c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:16:03.215314 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8627dcd-4c86-4f3b-88f2-34570f7819c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:16:03.215593 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8627dcd-4c86-4f3b-88f2-34570f7819c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:16:03.215864 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8627dcd-4c86-4f3b-88f2-34570f7819c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:16:03.224884 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8627dcd-4c86-4f3b-88f2-34570f7819c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:16:03.226318 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8627dcd-4c86-4f3b-88f2-34570f7819c1 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:16:03.235499 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 763/1533] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:16:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:16:06.872915 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc5734-636d-4b28-a412-1ced88037b5b None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:16:06.873461 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc5734-636d-4b28-a412-1ced88037b5b None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:16:06.873461 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc5734-636d-4b28-a412-1ced88037b5b None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:16:06.874835 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 771/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:16:06.879901 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90484417-feb0-469e-b63c-23df4c925a36 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:16:06.880362 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90484417-feb0-469e-b63c-23df4c925a36 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:16:06.880473 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90484417-feb0-469e-b63c-23df4c925a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:16:06.888918 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=81 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:16:06.901522 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-90484417-feb0-469e-b63c-23df4c925a36 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:16:06.902756 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-90484417-feb0-469e-b63c-23df4c925a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:16:06.910635 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 764/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:16:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:16:07.472199 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc5734-636d-4b28-a412-1ced88037b5b None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:16:07.474117 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-a7cc5734-636d-4b28-a412-1ced88037b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:16:07.539580 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:16:07.553747 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc5734-636d-4b28-a412-1ced88037b5b None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:16:07.557319 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c62921-8fae-46d0-b0d5-990d41a9b190 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:16:07.557923 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c62921-8fae-46d0-b0d5-990d41a9b190 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:16:07.558203 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c62921-8fae-46d0-b0d5-990d41a9b190 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:16:07.558503 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c62921-8fae-46d0-b0d5-990d41a9b190 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:16:07.567342 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c62921-8fae-46d0-b0d5-990d41a9b190 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:16:07.569455 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c62921-8fae-46d0-b0d5-990d41a9b190 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:16:07.578640 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 772/1536] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:16:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:16:09.505449 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613c812-0711-41ec-8670-ba3a0fd671a2 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:16:09.506592 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613c812-0711-41ec-8670-ba3a0fd671a2 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:16:09.506592 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613c812-0711-41ec-8670-ba3a0fd671a2 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:16:09.507880 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 765/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 19:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:16:09.513092 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078b974-1c0f-4e4b-8c42-e41a6b3f6502 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:16:09.513500 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078b974-1c0f-4e4b-8c42-e41a6b3f6502 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:16:09.513644 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078b974-1c0f-4e4b-8c42-e41a6b3f6502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:16:09.533763 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-e078b974-1c0f-4e4b-8c42-e41a6b3f6502 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:16:09.535459 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-e078b974-1c0f-4e4b-8c42-e41a6b3f6502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:16:09.544465 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 773/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 19:16:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:16:10.097472 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613c812-0711-41ec-8670-ba3a0fd671a2 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:16:10.100043 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b613c812-0711-41ec-8670-ba3a0fd671a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:16:10.112901 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613c812-0711-41ec-8670-ba3a0fd671a2 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:16:10.117064 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edeca67-ec9a-40e1-b77d-bed7f4141f2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:16:10.117655 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edeca67-ec9a-40e1-b77d-bed7f4141f2d service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:16:10.117934 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edeca67-ec9a-40e1-b77d-bed7f4141f2d service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:16:10.118207 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edeca67-ec9a-40e1-b77d-bed7f4141f2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:16:10.127040 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edeca67-ec9a-40e1-b77d-bed7f4141f2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:16:10.128461 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edeca67-ec9a-40e1-b77d-bed7f4141f2d service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:16:10.137776 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 766/1539] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:16:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:16:19.528811 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=11 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:16:20.133676 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=8 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:44.087287 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427578e4-fef9-450b-856b-228fc4a89706 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:44.087957 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427578e4-fef9-450b-856b-228fc4a89706 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:44.087957 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427578e4-fef9-450b-856b-228fc4a89706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:44.112820 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-427578e4-fef9-450b-856b-228fc4a89706 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:17:44.114811 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-427578e4-fef9-450b-856b-228fc4a89706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:44.127116 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 774/1540] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:17:44.135454 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3abfa-3439-4c46-8b24-c7a5e4904667 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:44.136015 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3abfa-3439-4c46-8b24-c7a5e4904667 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:44.136015 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3abfa-3439-4c46-8b24-c7a5e4904667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:44.171175 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-82a3abfa-3439-4c46-8b24-c7a5e4904667 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:17:44.172458 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-82a3abfa-3439-4c46-8b24-c7a5e4904667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:44.185978 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 767/1541] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:17:44.190919 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427578e4-fef9-450b-856b-228fc4a89706 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:44.211283 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427578e4-fef9-450b-856b-228fc4a89706 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:44.216584 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb90e49-1e6e-4c36-b2de-2de8668047d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:44.217224 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb90e49-1e6e-4c36-b2de-2de8668047d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:44.217502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb90e49-1e6e-4c36-b2de-2de8668047d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:44.217775 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb90e49-1e6e-4c36-b2de-2de8668047d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:44.218441 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb90e49-1e6e-4c36-b2de-2de8668047d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:17:44.223608 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb90e49-1e6e-4c36-b2de-2de8668047d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:44.225779 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb90e49-1e6e-4c36-b2de-2de8668047d9 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:44.236263 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cee59-b1ad-4015-81fe-4684cdf07f4d None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:44.236617 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cee59-b1ad-4015-81fe-4684cdf07f4d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:44.236826 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cee59-b1ad-4015-81fe-4684cdf07f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:44.241748 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 775/1542] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:17:44.251925 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb90e49-1e6e-4c36-b2de-2de8668047d9 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:44.267169 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb90e49-1e6e-4c36-b2de-2de8668047d9 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:44.272934 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003fc9b-e5eb-4b89-93e3-12a6d97408fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:44.273575 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003fc9b-e5eb-4b89-93e3-12a6d97408fc admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:44.273912 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003fc9b-e5eb-4b89-93e3-12a6d97408fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:44.274195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003fc9b-e5eb-4b89-93e3-12a6d97408fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:44.274929 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003fc9b-e5eb-4b89-93e3-12a6d97408fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:44.276199 dv-cinder-852210-6-smb devstack@keystone.service[81682]: WARNING py.warnings [None req-c003fc9b-e5eb-4b89-93e3-12a6d97408fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:17:44.276199 dv-cinder-852210-6-smb devstack@keystone.service[81682]: warnings.warn(msg) Aug 31 19:17:44.276199 dv-cinder-852210-6-smb devstack@keystone.service[81682]: Aug 31 19:17:44.276827 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-518cee59-b1ad-4015-81fe-4684cdf07f4d None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:17:44.277578 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003fc9b-e5eb-4b89-93e3-12a6d97408fc admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:44.278067 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-518cee59-b1ad-4015-81fe-4684cdf07f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:44.305257 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 768/1543] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 31 19:17:44.306808 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bfb24-31eb-4810-90db-127f6a882ecd None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:44.307125 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bfb24-31eb-4810-90db-127f6a882ecd None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:44.307368 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bfb24-31eb-4810-90db-127f6a882ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:44.339714 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-ee0bfb24-31eb-4810-90db-127f6a882ecd None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:17:44.340922 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ee0bfb24-31eb-4810-90db-127f6a882ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:44.344376 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 776/1544] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:17:44 2022] POST /identity/v3/projects => generated 369 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:17:44.348817 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea9e02-9339-4fd8-9c33-d244b75df74b None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:44.349258 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea9e02-9339-4fd8-9c33-d244b75df74b None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:44.349539 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea9e02-9339-4fd8-9c33-d244b75df74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:44.383110 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-72ea9e02-9339-4fd8-9c33-d244b75df74b None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:17:44.384341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-72ea9e02-9339-4fd8-9c33-d244b75df74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:44.439556 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 769/1545] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:17:44.446586 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0bfb24-31eb-4810-90db-127f6a882ecd None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:44.465129 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0bfb24-31eb-4810-90db-127f6a882ecd None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:44.469973 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b967a0f4-04d1-45c8-9b69-6fa1620ebd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:44.473827 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967a0f4-04d1-45c8-9b69-6fa1620ebd48 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:44.475634 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967a0f4-04d1-45c8-9b69-6fa1620ebd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:44.476150 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967a0f4-04d1-45c8-9b69-6fa1620ebd48 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:44.477523 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b967a0f4-04d1-45c8-9b69-6fa1620ebd48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:44.479669 dv-cinder-852210-6-smb devstack@keystone.service[81683]: WARNING py.warnings [None req-b967a0f4-04d1-45c8-9b69-6fa1620ebd48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:17:44.479669 dv-cinder-852210-6-smb devstack@keystone.service[81683]: warnings.warn(msg) Aug 31 19:17:44.479669 dv-cinder-852210-6-smb devstack@keystone.service[81683]: Aug 31 19:17:44.482196 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b967a0f4-04d1-45c8-9b69-6fa1620ebd48 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:44.490424 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 777/1546] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:17:44.494230 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397527f9-c492-4c6a-9a33-65f28c00fda7 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:44.494830 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397527f9-c492-4c6a-9a33-65f28c00fda7 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:44.495350 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397527f9-c492-4c6a-9a33-65f28c00fda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:44.552345 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 770/1547] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:17:44 2022] POST /identity/v3/users => generated 285 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:17:44.554194 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0dbe33-7138-43a9-bc10-579a690491d0 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:44.562576 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0dbe33-7138-43a9-bc10-579a690491d0 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:44.563589 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0dbe33-7138-43a9-bc10-579a690491d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:44.566859 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-397527f9-c492-4c6a-9a33-65f28c00fda7 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:17:44.568260 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-397527f9-c492-4c6a-9a33-65f28c00fda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:44.600320 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 778/1548] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:17:44.600537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-2e0dbe33-7138-43a9-bc10-579a690491d0 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:17:44.601094 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397527f9-c492-4c6a-9a33-65f28c00fda7 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:44.601709 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2e0dbe33-7138-43a9-bc10-579a690491d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:44.610030 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 771/1549] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:17:44.611022 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0dbe33-7138-43a9-bc10-579a690491d0 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:44.619017 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397527f9-c492-4c6a-9a33-65f28c00fda7 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:44.627386 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0dbe33-7138-43a9-bc10-579a690491d0 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:44.631480 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc67d1-1d58-46e5-9a3f-ea4609f79067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:44.632106 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc67d1-1d58-46e5-9a3f-ea4609f79067 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:44.632385 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc67d1-1d58-46e5-9a3f-ea4609f79067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:44.632653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc67d1-1d58-46e5-9a3f-ea4609f79067 admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:44.633302 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc67d1-1d58-46e5-9a3f-ea4609f79067 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:17:44.633436 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf188f9-715d-456d-8f63-cc75a8d8b9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:44.633598 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc67d1-1d58-46e5-9a3f-ea4609f79067 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:44.634012 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf188f9-715d-456d-8f63-cc75a8d8b9f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:44.634292 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf188f9-715d-456d-8f63-cc75a8d8b9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:44.634593 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf188f9-715d-456d-8f63-cc75a8d8b9f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:44.635227 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc67d1-1d58-46e5-9a3f-ea4609f79067 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:44.635330 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf188f9-715d-456d-8f63-cc75a8d8b9f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:44.636807 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf188f9-715d-456d-8f63-cc75a8d8b9f6 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:44.647797 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 772/1550] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:17:44.654360 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 779/1551] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:17:44.654568 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d19c7-47fc-411b-ab06-09be234e5717 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:44.654690 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf02ba-d4a2-4abd-981c-4e0259d4dd73 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:44.654794 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d19c7-47fc-411b-ab06-09be234e5717 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:44.654794 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d19c7-47fc-411b-ab06-09be234e5717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:44.654975 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf02ba-d4a2-4abd-981c-4e0259d4dd73 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:44.654975 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf02ba-d4a2-4abd-981c-4e0259d4dd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:44.669998 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-449d19c7-47fc-411b-ab06-09be234e5717 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:17:44.670590 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-8edf02ba-d4a2-4abd-981c-4e0259d4dd73 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:17:44.671238 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-449d19c7-47fc-411b-ab06-09be234e5717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:44.671759 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-8edf02ba-d4a2-4abd-981c-4e0259d4dd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:44.679876 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 780/1552] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:17:44.680650 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf02ba-d4a2-4abd-981c-4e0259d4dd73 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:44.686515 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 773/1553] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:17:44.687410 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a5543-0457-4561-a39c-1043dc0b4076 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:44.688669 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a5543-0457-4561-a39c-1043dc0b4076 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:44.692093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a5543-0457-4561-a39c-1043dc0b4076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:44.697562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf02ba-d4a2-4abd-981c-4e0259d4dd73 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:44.702793 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9ba4e-45e0-4d90-92d9-31302404f78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:44.703407 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9ba4e-45e0-4d90-92d9-31302404f78a admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:44.703803 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9ba4e-45e0-4d90-92d9-31302404f78a admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:44.703992 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9ba4e-45e0-4d90-92d9-31302404f78a admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:44.704659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9ba4e-45e0-4d90-92d9-31302404f78a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:17:44.704963 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9ba4e-45e0-4d90-92d9-31302404f78a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:44.706575 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9ba4e-45e0-4d90-92d9-31302404f78a admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:44.716452 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-7c4a5543-0457-4561-a39c-1043dc0b4076 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:17:44.718243 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7c4a5543-0457-4561-a39c-1043dc0b4076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:44.719503 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 781/1554] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:17:44.720723 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6054eb1-7358-489d-b280-817bb43cd09b None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:44.721006 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6054eb1-7358-489d-b280-817bb43cd09b None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:44.721277 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6054eb1-7358-489d-b280-817bb43cd09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:44.727218 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 774/1555] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:17:44.728601 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66edc8f-a3ef-48bb-be54-7ff229883131 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:44.728861 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66edc8f-a3ef-48bb-be54-7ff229883131 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:44.729133 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66edc8f-a3ef-48bb-be54-7ff229883131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:44.745457 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-d6054eb1-7358-489d-b280-817bb43cd09b None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:17:44.746720 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d6054eb1-7358-489d-b280-817bb43cd09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:44.748807 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-c66edc8f-a3ef-48bb-be54-7ff229883131 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:17:44.749962 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c66edc8f-a3ef-48bb-be54-7ff229883131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:44.756047 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 782/1556] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:17:44.757103 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6054eb1-7358-489d-b280-817bb43cd09b None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:44.758280 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 775/1557] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:17:44.759081 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66edc8f-a3ef-48bb-be54-7ff229883131 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:44.775464 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66edc8f-a3ef-48bb-be54-7ff229883131 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:44.775738 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6054eb1-7358-489d-b280-817bb43cd09b None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:44.780157 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b1698-cb3c-4f72-9de6-9f55fd75a2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:44.780444 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e9b0c-5f8e-4472-9828-874a33dd100d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:44.780763 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b1698-cb3c-4f72-9de6-9f55fd75a2c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:44.781038 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b1698-cb3c-4f72-9de6-9f55fd75a2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:44.781144 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e9b0c-5f8e-4472-9828-874a33dd100d admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:44.781309 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b1698-cb3c-4f72-9de6-9f55fd75a2c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:44.781405 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e9b0c-5f8e-4472-9828-874a33dd100d admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:44.781581 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e9b0c-5f8e-4472-9828-874a33dd100d admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:44.781938 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b1698-cb3c-4f72-9de6-9f55fd75a2c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:44.782225 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e9b0c-5f8e-4472-9828-874a33dd100d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:44.783883 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b1698-cb3c-4f72-9de6-9f55fd75a2c4 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:44.784030 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e9b0c-5f8e-4472-9828-874a33dd100d admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:44.794473 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 783/1558] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:17:44.795707 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65ec48-4c57-46d1-b092-d9ea3176d725 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:44.795983 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65ec48-4c57-46d1-b092-d9ea3176d725 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:44.796251 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65ec48-4c57-46d1-b092-d9ea3176d725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:44.821533 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 776/1559] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:17:44 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:17:44.821814 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-1c65ec48-4c57-46d1-b092-d9ea3176d725 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:17:44.822014 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693286ef-bf73-4eac-8279-8d050c003692 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:44.822196 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1c65ec48-4c57-46d1-b092-d9ea3176d725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:44.822370 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693286ef-bf73-4eac-8279-8d050c003692 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:44.822370 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693286ef-bf73-4eac-8279-8d050c003692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:44.839515 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-693286ef-bf73-4eac-8279-8d050c003692 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:17:44.840981 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-693286ef-bf73-4eac-8279-8d050c003692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:44.870551 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:44.886492 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 784/1560] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:17:44.886857 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65ec48-4c57-46d1-b092-d9ea3176d725 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:44.899248 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65ec48-4c57-46d1-b092-d9ea3176d725 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:44.904423 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c0963-598c-439e-a9e2-28b784171626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:44.905063 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c0963-598c-439e-a9e2-28b784171626 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:44.905340 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c0963-598c-439e-a9e2-28b784171626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:44.905606 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c0963-598c-439e-a9e2-28b784171626 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:44.906264 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c0963-598c-439e-a9e2-28b784171626 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:44.908214 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c0963-598c-439e-a9e2-28b784171626 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:44.914697 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 777/1561] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:17:44.915448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693286ef-bf73-4eac-8279-8d050c003692 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:44.930178 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693286ef-bf73-4eac-8279-8d050c003692 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:44.937160 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56fedf-8315-4ade-946b-727c06a2ef7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:44.937763 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56fedf-8315-4ade-946b-727c06a2ef7c admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:44.938166 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56fedf-8315-4ade-946b-727c06a2ef7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:44.938519 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56fedf-8315-4ade-946b-727c06a2ef7c admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:44.939231 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac56fedf-8315-4ade-946b-727c06a2ef7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:17:44.939536 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac56fedf-8315-4ade-946b-727c06a2ef7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:44.940594 dv-cinder-852210-6-smb devstack@keystone.service[81683]: WARNING py.warnings [None req-ac56fedf-8315-4ade-946b-727c06a2ef7c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:17:44.940594 dv-cinder-852210-6-smb devstack@keystone.service[81683]: warnings.warn(msg) Aug 31 19:17:44.940594 dv-cinder-852210-6-smb devstack@keystone.service[81683]: Aug 31 19:17:44.941572 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac56fedf-8315-4ade-946b-727c06a2ef7c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:44.949105 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:44.950085 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 785/1562] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:17:44 2022] POST /identity/v3/projects => generated 379 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:17:44.951982 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81d45f-de61-40c3-aad8-00128821f0b9 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:44.952556 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81d45f-de61-40c3-aad8-00128821f0b9 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:44.953109 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81d45f-de61-40c3-aad8-00128821f0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:44.955475 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 778/1563] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:17:44.956913 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b19e9-8fb7-43df-9f0d-228cd22d21c4 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:44.957214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b19e9-8fb7-43df-9f0d-228cd22d21c4 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:44.957535 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b19e9-8fb7-43df-9f0d-228cd22d21c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:44.979653 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-1b6b19e9-8fb7-43df-9f0d-228cd22d21c4 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:17:44.980875 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1b6b19e9-8fb7-43df-9f0d-228cd22d21c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:44.982985 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-8f81d45f-de61-40c3-aad8-00128821f0b9 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:17:44.984157 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-8f81d45f-de61-40c3-aad8-00128821f0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:45.042329 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 779/1564] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:17:45.046279 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b19e9-8fb7-43df-9f0d-228cd22d21c4 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:45.046380 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 786/1565] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:17:45.046718 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81d45f-de61-40c3-aad8-00128821f0b9 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:45.052503 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b19e9-8fb7-43df-9f0d-228cd22d21c4 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:45.057058 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5c89a-a08f-4a39-b60b-760c36f0a4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:45.057718 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5c89a-a08f-4a39-b60b-760c36f0a4be admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:45.057995 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5c89a-a08f-4a39-b60b-760c36f0a4be admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:45.058266 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5c89a-a08f-4a39-b60b-760c36f0a4be admin admin] PATH_INFO: `/v3/projects/12780e57c1084b889f58882232078614/users/c93675882aca4597947fecbbf611a722/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:45.059610 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81d45f-de61-40c3-aad8-00128821f0b9 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:45.064318 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c45c0-259a-406f-b82f-fb2a4f2a4ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:45.064919 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c45c0-259a-406f-b82f-fb2a4f2a4ffc admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:45.065196 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c45c0-259a-406f-b82f-fb2a4f2a4ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:45.065466 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c45c0-259a-406f-b82f-fb2a4f2a4ffc admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:45.066090 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c45c0-259a-406f-b82f-fb2a4f2a4ffc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:45.068175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c45c0-259a-406f-b82f-fb2a4f2a4ffc admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:45.074362 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d5c89a-a08f-4a39-b60b-760c36f0a4be admin admin] RBAC: Authorizing `identity:create_grant(project_id=12780e57c1084b889f58882232078614, user_id=c93675882aca4597947fecbbf611a722, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:45.077040 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d5c89a-a08f-4a39-b60b-760c36f0a4be admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:45.090099 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 787/1566] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:17:45 2022] POST /identity/v3/users => generated 287 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:17:45.090986 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c45c0-259a-406f-b82f-fb2a4f2a4ffc admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:45.091587 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 780/1567] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:17:45 2022] PUT /identity/v3/projects/12780e57c1084b889f58882232078614/users/c93675882aca4597947fecbbf611a722/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:17:45.092555 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5c89a-a08f-4a39-b60b-760c36f0a4be admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:45.102275 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c45c0-259a-406f-b82f-fb2a4f2a4ffc admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:45.162579 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39984318-b88e-4560-a3ce-ff04a4d1c7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:45.163097 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39984318-b88e-4560-a3ce-ff04a4d1c7c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:45.163404 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39984318-b88e-4560-a3ce-ff04a4d1c7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:45.163648 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39984318-b88e-4560-a3ce-ff04a4d1c7c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:45.164306 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39984318-b88e-4560-a3ce-ff04a4d1c7c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:17:45.164610 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39984318-b88e-4560-a3ce-ff04a4d1c7c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:45.166240 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39984318-b88e-4560-a3ce-ff04a4d1c7c4 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:45.171092 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5c89a-a08f-4a39-b60b-760c36f0a4be admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:45.175802 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afae430-69ac-4060-b1bb-7a518b39fdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:45.176416 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afae430-69ac-4060-b1bb-7a518b39fdba admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:45.176695 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afae430-69ac-4060-b1bb-7a518b39fdba admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:45.176988 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afae430-69ac-4060-b1bb-7a518b39fdba admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:45.177710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afae430-69ac-4060-b1bb-7a518b39fdba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:17:45.178124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afae430-69ac-4060-b1bb-7a518b39fdba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:45.178664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 788/1568] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:17:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:17:45.179487 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39984318-b88e-4560-a3ce-ff04a4d1c7c4 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:45.179946 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afae430-69ac-4060-b1bb-7a518b39fdba admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:45.192164 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 781/1569] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:17:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:17:45.193014 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afae430-69ac-4060-b1bb-7a518b39fdba admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:45.196252 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39984318-b88e-4560-a3ce-ff04a4d1c7c4 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:45.201169 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ffe3b-e951-4e1a-a436-afe2c55c7bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:45.201776 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ffe3b-e951-4e1a-a436-afe2c55c7bba admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:45.202103 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ffe3b-e951-4e1a-a436-afe2c55c7bba admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:45.202378 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ffe3b-e951-4e1a-a436-afe2c55c7bba admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:45.203038 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ffe3b-e951-4e1a-a436-afe2c55c7bba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:45.204481 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afae430-69ac-4060-b1bb-7a518b39fdba admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:45.205020 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ffe3b-e951-4e1a-a436-afe2c55c7bba admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:45.209721 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e733f1-bb7e-4d6c-b0c4-c3e378133db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:45.210345 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e733f1-bb7e-4d6c-b0c4-c3e378133db3 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:45.210658 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e733f1-bb7e-4d6c-b0c4-c3e378133db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:45.210936 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e733f1-bb7e-4d6c-b0c4-c3e378133db3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:45.211580 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e733f1-bb7e-4d6c-b0c4-c3e378133db3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:45.213519 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e733f1-bb7e-4d6c-b0c4-c3e378133db3 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:45.231215 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 789/1570] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:17:45 2022] POST /identity/v3/users => generated 290 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:17:45.231215 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ffe3b-e951-4e1a-a436-afe2c55c7bba admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:45.240061 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ffe3b-e951-4e1a-a436-afe2c55c7bba admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:45.244159 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 782/1571] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:17:45 2022] POST /identity/v3/projects => generated 393 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:17:45.244986 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e733f1-bb7e-4d6c-b0c4-c3e378133db3 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:45.248157 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764819e-7acc-4c6e-889d-7829d556d696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:45.248768 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764819e-7acc-4c6e-889d-7829d556d696 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:45.249076 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764819e-7acc-4c6e-889d-7829d556d696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:45.249351 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764819e-7acc-4c6e-889d-7829d556d696 admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:45.250003 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764819e-7acc-4c6e-889d-7829d556d696 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:17:45.250307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764819e-7acc-4c6e-889d-7829d556d696 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:45.252166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764819e-7acc-4c6e-889d-7829d556d696 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:45.272127 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 790/1572] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:17:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:17:45.272127 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764819e-7acc-4c6e-889d-7829d556d696 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:45.280765 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764819e-7acc-4c6e-889d-7829d556d696 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:45.295085 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:45.296606 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:45.312883 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e733f1-bb7e-4d6c-b0c4-c3e378133db3 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:45.318003 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3ca35-31cc-416c-bb0a-e02c5716f2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:45.318639 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3ca35-31cc-416c-bb0a-e02c5716f2de admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:45.318918 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3ca35-31cc-416c-bb0a-e02c5716f2de admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:45.319187 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3ca35-31cc-416c-bb0a-e02c5716f2de admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:45.319836 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe3ca35-31cc-416c-bb0a-e02c5716f2de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:17:45.320132 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe3ca35-31cc-416c-bb0a-e02c5716f2de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:45.321722 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe3ca35-31cc-416c-bb0a-e02c5716f2de admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:45.335082 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 783/1573] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:17:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:17:45.336530 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fbef4-f2e5-4323-a619-50b3d72c889d None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:45.336823 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fbef4-f2e5-4323-a619-50b3d72c889d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:45.337077 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fbef4-f2e5-4323-a619-50b3d72c889d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:45.341274 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372d58c-ddde-4d2f-ade1-269dd75f3c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:45.342146 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372d58c-ddde-4d2f-ade1-269dd75f3c25 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:45.342450 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372d58c-ddde-4d2f-ade1-269dd75f3c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:45.342875 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372d58c-ddde-4d2f-ade1-269dd75f3c25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:45.343523 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372d58c-ddde-4d2f-ade1-269dd75f3c25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:45.345118 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372d58c-ddde-4d2f-ade1-269dd75f3c25 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:45.356297 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 791/1574] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:17:45.359712 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372d58c-ddde-4d2f-ade1-269dd75f3c25 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:45.366860 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372d58c-ddde-4d2f-ade1-269dd75f3c25 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:45.369127 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-c10fbef4-f2e5-4323-a619-50b3d72c889d None None] MFA Rules not processed for user `c93675882aca4597947fecbbf611a722`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:17:45.370336 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c10fbef4-f2e5-4323-a619-50b3d72c889d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:45.371297 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d8351-4a23-4477-9559-b639eb366cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:45.371889 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d8351-4a23-4477-9559-b639eb366cc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:45.372165 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d8351-4a23-4477-9559-b639eb366cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:45.372432 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d8351-4a23-4477-9559-b639eb366cc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:45.373053 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d8351-4a23-4477-9559-b639eb366cc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:45.374970 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d8351-4a23-4477-9559-b639eb366cc2 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:45.414539 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 792/1575] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:17:45 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:17:45.415284 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d8351-4a23-4477-9559-b639eb366cc2 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:45.439626 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 784/1576] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:17:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:17:45.440497 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fbef4-f2e5-4323-a619-50b3d72c889d None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:45.451751 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fbef4-f2e5-4323-a619-50b3d72c889d None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:45.485888 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d8351-4a23-4477-9559-b639eb366cc2 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:45.490865 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d7d0c-086b-481c-993b-b923dc72972d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:45.491474 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d7d0c-086b-481c-993b-b923dc72972d admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:45.491774 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d7d0c-086b-481c-993b-b923dc72972d admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:45.492020 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d7d0c-086b-481c-993b-b923dc72972d admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:45.492653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d7d0c-086b-481c-993b-b923dc72972d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:45.494625 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d7d0c-086b-481c-993b-b923dc72972d admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:45.511347 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5aea1-e3b5-4284-9445-72b6f4f43db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:45.511969 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5aea1-e3b5-4284-9445-72b6f4f43db9 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:45.512249 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5aea1-e3b5-4284-9445-72b6f4f43db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:45.512551 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5aea1-e3b5-4284-9445-72b6f4f43db9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:45.513362 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5aea1-e3b5-4284-9445-72b6f4f43db9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:45.515610 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5aea1-e3b5-4284-9445-72b6f4f43db9 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:45.524480 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 793/1577] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:17:45 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:17:45.525558 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d7d0c-086b-481c-993b-b923dc72972d admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:45.527656 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 785/1578] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:17:45.528240 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5aea1-e3b5-4284-9445-72b6f4f43db9 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:45.549206 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5aea1-e3b5-4284-9445-72b6f4f43db9 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:45.590751 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d7d0c-086b-481c-993b-b923dc72972d admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:45.595463 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c6467-bbf6-4d45-91f0-caa68e1a713b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:45.596078 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c6467-bbf6-4d45-91f0-caa68e1a713b admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:45.596361 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c6467-bbf6-4d45-91f0-caa68e1a713b admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:45.596639 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c6467-bbf6-4d45-91f0-caa68e1a713b admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:45.597276 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c6467-bbf6-4d45-91f0-caa68e1a713b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:45.599684 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c6467-bbf6-4d45-91f0-caa68e1a713b admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:45.608674 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a138b4-59bf-4fe6-ae80-af8317b6b5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:45.609375 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a138b4-59bf-4fe6-ae80-af8317b6b5f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:45.609651 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a138b4-59bf-4fe6-ae80-af8317b6b5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:45.609919 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a138b4-59bf-4fe6-ae80-af8317b6b5f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:45.610657 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a138b4-59bf-4fe6-ae80-af8317b6b5f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:45.612737 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a138b4-59bf-4fe6-ae80-af8317b6b5f7 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:45.622966 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 794/1579] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:17:45 2022] POST /identity/v3/users => generated 297 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:17:45.623802 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c6467-bbf6-4d45-91f0-caa68e1a713b admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:45.628651 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:45.634481 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c6467-bbf6-4d45-91f0-caa68e1a713b admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:45.640287 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82ba5e-c7c9-4df5-9e7e-54d0336461dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:45.640892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82ba5e-c7c9-4df5-9e7e-54d0336461dc admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:45.641179 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82ba5e-c7c9-4df5-9e7e-54d0336461dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:45.641454 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82ba5e-c7c9-4df5-9e7e-54d0336461dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:45.642096 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee82ba5e-c7c9-4df5-9e7e-54d0336461dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:45.644035 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee82ba5e-c7c9-4df5-9e7e-54d0336461dc admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:45.646857 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 786/1580] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:17:45 2022] POST /identity/v3/projects => generated 363 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:17:45.647682 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a138b4-59bf-4fe6-ae80-af8317b6b5f7 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:45.649478 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:45.682365 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 795/1581] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:17:45 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:17:45.682365 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82ba5e-c7c9-4df5-9e7e-54d0336461dc admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:45.719373 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a138b4-59bf-4fe6-ae80-af8317b6b5f7 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:45.752367 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82ba5e-c7c9-4df5-9e7e-54d0336461dc admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:45.758190 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc6fe6-1f7e-404f-bb21-d393e767cb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:45.758627 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc6fe6-1f7e-404f-bb21-d393e767cb46 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:45.758904 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc6fe6-1f7e-404f-bb21-d393e767cb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:45.759176 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc6fe6-1f7e-404f-bb21-d393e767cb46 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:45.759814 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc6fe6-1f7e-404f-bb21-d393e767cb46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:45.761724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc6fe6-1f7e-404f-bb21-d393e767cb46 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:45.779582 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e616cf5-9211-412a-ad6f-812c1b2412d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:45.780200 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e616cf5-9211-412a-ad6f-812c1b2412d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:45.780479 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e616cf5-9211-412a-ad6f-812c1b2412d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:45.780758 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e616cf5-9211-412a-ad6f-812c1b2412d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:45.781404 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e616cf5-9211-412a-ad6f-812c1b2412d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:45.783054 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e616cf5-9211-412a-ad6f-812c1b2412d6 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:45.783987 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 796/1582] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:17:45 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:17:45.784803 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc6fe6-1f7e-404f-bb21-d393e767cb46 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:45.797144 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 787/1583] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:17:45.797340 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc6fe6-1f7e-404f-bb21-d393e767cb46 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:45.797471 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e616cf5-9211-412a-ad6f-812c1b2412d6 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:45.802501 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef63770-0d1e-4930-b59a-b1218300e88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:45.803104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef63770-0d1e-4930-b59a-b1218300e88a admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:45.803378 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef63770-0d1e-4930-b59a-b1218300e88a admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:45.803648 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef63770-0d1e-4930-b59a-b1218300e88a admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:45.804272 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef63770-0d1e-4930-b59a-b1218300e88a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:45.805314 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e616cf5-9211-412a-ad6f-812c1b2412d6 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:45.806177 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef63770-0d1e-4930-b59a-b1218300e88a admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:45.809981 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f99ec-bac0-4494-8f5c-5b231e950002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:45.810609 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f99ec-bac0-4494-8f5c-5b231e950002 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:45.810905 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f99ec-bac0-4494-8f5c-5b231e950002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:45.811165 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f99ec-bac0-4494-8f5c-5b231e950002 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:45.811801 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f99ec-bac0-4494-8f5c-5b231e950002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:45.813384 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f99ec-bac0-4494-8f5c-5b231e950002 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:45.824196 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 788/1584] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:17:45.827445 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f99ec-bac0-4494-8f5c-5b231e950002 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:45.837658 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f99ec-bac0-4494-8f5c-5b231e950002 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:45.842581 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 797/1585] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:17:45 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:17:45.843289 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef63770-0d1e-4930-b59a-b1218300e88a admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:45.846314 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73b512-97ac-4f08-888d-ff4256a02f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:45.846970 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73b512-97ac-4f08-888d-ff4256a02f65 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:45.847249 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73b512-97ac-4f08-888d-ff4256a02f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:45.847779 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73b512-97ac-4f08-888d-ff4256a02f65 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:45.848444 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d73b512-97ac-4f08-888d-ff4256a02f65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:45.850376 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d73b512-97ac-4f08-888d-ff4256a02f65 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:45.878477 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 789/1586] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:17:45 2022] POST /identity/v3/users => generated 289 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:17:45.879903 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73b512-97ac-4f08-888d-ff4256a02f65 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:45.889950 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73b512-97ac-4f08-888d-ff4256a02f65 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:45.910342 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef63770-0d1e-4930-b59a-b1218300e88a admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:45.915382 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401be3fe-670c-4b5f-8409-c4c38774a1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:45.915992 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401be3fe-670c-4b5f-8409-c4c38774a1de admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:45.916274 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401be3fe-670c-4b5f-8409-c4c38774a1de admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:45.916557 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401be3fe-670c-4b5f-8409-c4c38774a1de admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:45.917195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401be3fe-670c-4b5f-8409-c4c38774a1de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:45.918823 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401be3fe-670c-4b5f-8409-c4c38774a1de admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:45.929358 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 798/1587] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:17:45.930165 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401be3fe-670c-4b5f-8409-c4c38774a1de admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:45.939932 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401be3fe-670c-4b5f-8409-c4c38774a1de admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:45.946823 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411fd993-a5a4-4677-81d0-15b6e55064ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:45.947440 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fd993-a5a4-4677-81d0-15b6e55064ed admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:45.947722 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fd993-a5a4-4677-81d0-15b6e55064ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:45.947997 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fd993-a5a4-4677-81d0-15b6e55064ed admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:45.948633 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411fd993-a5a4-4677-81d0-15b6e55064ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:45.950336 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8107053-1fc2-4863-a05c-74261a8aeb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:45.950579 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411fd993-a5a4-4677-81d0-15b6e55064ed admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:45.951179 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8107053-1fc2-4863-a05c-74261a8aeb0a admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:45.951554 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8107053-1fc2-4863-a05c-74261a8aeb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:45.951921 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8107053-1fc2-4863-a05c-74261a8aeb0a admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:45.952644 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8107053-1fc2-4863-a05c-74261a8aeb0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:45.954787 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8107053-1fc2-4863-a05c-74261a8aeb0a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:45.967318 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:45.974077 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 799/1588] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:17:45 2022] POST /identity/v3/users => generated 293 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:17:45.978054 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411fd993-a5a4-4677-81d0-15b6e55064ed admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:45.981831 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 790/1589] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:17:45 2022] POST /identity/v3/users => generated 282 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:17:45.982191 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8107053-1fc2-4863-a05c-74261a8aeb0a admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:45.985320 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411fd993-a5a4-4677-81d0-15b6e55064ed admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:45.991780 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4cd28-47b9-49fb-9c27-c8d637d7c5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:45.992484 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4cd28-47b9-49fb-9c27-c8d637d7c5ed admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:45.992762 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4cd28-47b9-49fb-9c27-c8d637d7c5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:45.993033 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4cd28-47b9-49fb-9c27-c8d637d7c5ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:45.993703 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4cd28-47b9-49fb-9c27-c8d637d7c5ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:45.995320 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4cd28-47b9-49fb-9c27-c8d637d7c5ed admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:45.995727 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8107053-1fc2-4863-a05c-74261a8aeb0a admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:46.000343 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb6f62-a6ff-4d86-b49d-2eb34385a958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:46.001000 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb6f62-a6ff-4d86-b49d-2eb34385a958 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:46.001487 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb6f62-a6ff-4d86-b49d-2eb34385a958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:46.001608 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb6f62-a6ff-4d86-b49d-2eb34385a958 admin admin] PATH_INFO: `/v3/projects/209160d0cbe64f40bca6fedf0e31a4c9/users/07ff57133f824497b69892dbc4b32aed/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:46.007182 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 800/1590] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:17:46.007182 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4cd28-47b9-49fb-9c27-c8d637d7c5ed admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:46.018740 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb6f62-a6ff-4d86-b49d-2eb34385a958 admin admin] RBAC: Authorizing `identity:create_grant(project_id=209160d0cbe64f40bca6fedf0e31a4c9, user_id=07ff57133f824497b69892dbc4b32aed, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:46.019572 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4cd28-47b9-49fb-9c27-c8d637d7c5ed admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:46.021429 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb6f62-a6ff-4d86-b49d-2eb34385a958 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:46.024414 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef4f92-2410-4b9a-8502-b1da9afdc982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:46.025066 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef4f92-2410-4b9a-8502-b1da9afdc982 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:46.025462 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef4f92-2410-4b9a-8502-b1da9afdc982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:46.025654 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef4f92-2410-4b9a-8502-b1da9afdc982 admin admin] PATH_INFO: `/v3/projects/9bf42bd08d2549c390e326f22b012e5b/users/217c0db4963a40119eec67c947bbc38e/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:46.034683 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 791/1591] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:17:45 2022] PUT /identity/v3/projects/209160d0cbe64f40bca6fedf0e31a4c9/users/07ff57133f824497b69892dbc4b32aed/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:17:46.046016 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb6f62-a6ff-4d86-b49d-2eb34385a958 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:46.047689 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef4f92-2410-4b9a-8502-b1da9afdc982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bf42bd08d2549c390e326f22b012e5b, user_id=217c0db4963a40119eec67c947bbc38e, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:46.048953 dv-cinder-852210-6-smb devstack@keystone.service[81682]: WARNING py.warnings [None req-cbef4f92-2410-4b9a-8502-b1da9afdc982 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:17:46.048953 dv-cinder-852210-6-smb devstack@keystone.service[81682]: warnings.warn(msg) Aug 31 19:17:46.048953 dv-cinder-852210-6-smb devstack@keystone.service[81682]: Aug 31 19:17:46.052101 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef4f92-2410-4b9a-8502-b1da9afdc982 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:46.055393 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:46.067907 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 801/1592] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:17:46 2022] PUT /identity/v3/projects/9bf42bd08d2549c390e326f22b012e5b/users/217c0db4963a40119eec67c947bbc38e/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:17:46.068986 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef4f92-2410-4b9a-8502-b1da9afdc982 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:46.113194 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb6f62-a6ff-4d86-b49d-2eb34385a958 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:46.137013 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef4f92-2410-4b9a-8502-b1da9afdc982 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:46.142019 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff69e2-31df-4402-a91b-204907bc3d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:46.142661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff69e2-31df-4402-a91b-204907bc3d8d admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:46.142945 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff69e2-31df-4402-a91b-204907bc3d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:46.143213 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff69e2-31df-4402-a91b-204907bc3d8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:46.143854 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff69e2-31df-4402-a91b-204907bc3d8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:46.145489 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff69e2-31df-4402-a91b-204907bc3d8d admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:46.155568 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 802/1593] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:17:46.157155 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff69e2-31df-4402-a91b-204907bc3d8d admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:46.167322 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff69e2-31df-4402-a91b-204907bc3d8d admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:46.171301 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4ad36-370d-4799-89f8-7f2590bbc06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:46.171916 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4ad36-370d-4799-89f8-7f2590bbc06e admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:46.172039 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add852d3-9873-4eee-9dad-5183ea027206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:46.172196 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4ad36-370d-4799-89f8-7f2590bbc06e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:46.172469 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4ad36-370d-4799-89f8-7f2590bbc06e admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:46.172592 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add852d3-9873-4eee-9dad-5183ea027206 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:46.172776 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add852d3-9873-4eee-9dad-5183ea027206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:46.173042 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add852d3-9873-4eee-9dad-5183ea027206 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:46.173152 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4ad36-370d-4799-89f8-7f2590bbc06e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:46.173667 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add852d3-9873-4eee-9dad-5183ea027206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:46.175079 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4ad36-370d-4799-89f8-7f2590bbc06e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:46.175271 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add852d3-9873-4eee-9dad-5183ea027206 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:46.190649 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 803/1594] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:17:46.190649 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add852d3-9873-4eee-9dad-5183ea027206 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:46.197938 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add852d3-9873-4eee-9dad-5183ea027206 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:46.203692 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 792/1595] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:17:46 2022] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:17:46.203692 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4ad36-370d-4799-89f8-7f2590bbc06e admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:46.205838 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4cdc8-9117-4b81-a021-7a9e515e0b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:46.206433 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4cdc8-9117-4b81-a021-7a9e515e0b1b admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:46.206732 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4cdc8-9117-4b81-a021-7a9e515e0b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:46.207035 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4cdc8-9117-4b81-a021-7a9e515e0b1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:46.207665 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e4cdc8-9117-4b81-a021-7a9e515e0b1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:46.209769 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e4cdc8-9117-4b81-a021-7a9e515e0b1b admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:46.213170 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4ad36-370d-4799-89f8-7f2590bbc06e admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:46.217871 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8b1cb-8879-4ab8-9f24-554c5dbb008b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:46.218501 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8b1cb-8879-4ab8-9f24-554c5dbb008b admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:46.218775 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8b1cb-8879-4ab8-9f24-554c5dbb008b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:46.219053 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8b1cb-8879-4ab8-9f24-554c5dbb008b admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:46.219944 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf8b1cb-8879-4ab8-9f24-554c5dbb008b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:46.220052 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 804/1596] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:17:46.220591 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4cdc8-9117-4b81-a021-7a9e515e0b1b admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:46.222087 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf8b1cb-8879-4ab8-9f24-554c5dbb008b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:46.231109 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4cdc8-9117-4b81-a021-7a9e515e0b1b admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:46.236342 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 793/1597] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:17:46.236342 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50257ce8-f313-4eaf-8c69-57ba525426c1 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:46.236342 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50257ce8-f313-4eaf-8c69-57ba525426c1 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:46.236342 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50257ce8-f313-4eaf-8c69-57ba525426c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:46.237968 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50118114-b1e8-4a90-ba3d-7af98de7e623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:46.239137 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50118114-b1e8-4a90-ba3d-7af98de7e623 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:46.239410 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50118114-b1e8-4a90-ba3d-7af98de7e623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:46.239677 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50118114-b1e8-4a90-ba3d-7af98de7e623 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:46.240306 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50118114-b1e8-4a90-ba3d-7af98de7e623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:46.241886 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50118114-b1e8-4a90-ba3d-7af98de7e623 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:46.253314 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 805/1598] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:17:46.254351 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67031bb2-1926-431f-9403-a8f575ef8d41 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:46.254696 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67031bb2-1926-431f-9403-a8f575ef8d41 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:46.254926 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67031bb2-1926-431f-9403-a8f575ef8d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:46.265827 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-50257ce8-f313-4eaf-8c69-57ba525426c1 None None] MFA Rules not processed for user `07ff57133f824497b69892dbc4b32aed`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:17:46.267238 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-50257ce8-f313-4eaf-8c69-57ba525426c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:46.283641 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-67031bb2-1926-431f-9403-a8f575ef8d41 None None] MFA Rules not processed for user `217c0db4963a40119eec67c947bbc38e`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:17:46.284852 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-67031bb2-1926-431f-9403-a8f575ef8d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:46.325363 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:46.348619 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 794/1599] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:17:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:17:46.349553 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50257ce8-f313-4eaf-8c69-57ba525426c1 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:46.360179 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 806/1600] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:17:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:17:46.361092 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67031bb2-1926-431f-9403-a8f575ef8d41 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:46.367673 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50257ce8-f313-4eaf-8c69-57ba525426c1 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:46.372796 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7726ed-a417-4877-af2b-7c9030d18441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:46.374063 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7726ed-a417-4877-af2b-7c9030d18441 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:46.374350 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7726ed-a417-4877-af2b-7c9030d18441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:46.374777 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7726ed-a417-4877-af2b-7c9030d18441 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:46.375403 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7726ed-a417-4877-af2b-7c9030d18441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:46.377237 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7726ed-a417-4877-af2b-7c9030d18441 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:46.378138 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67031bb2-1926-431f-9403-a8f575ef8d41 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:46.383959 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2eef05-29cb-4a88-94dc-8f1fc4465d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:46.384694 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2eef05-29cb-4a88-94dc-8f1fc4465d86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:46.385056 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2eef05-29cb-4a88-94dc-8f1fc4465d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:46.385249 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2eef05-29cb-4a88-94dc-8f1fc4465d86 admin admin] PATH_INFO: `/v3/projects/863b7e38591440f5a677bf2671182221/users/d461f94acd3048ffad92bc382aacfc76/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:46.390545 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 795/1601] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:17:46.391011 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7726ed-a417-4877-af2b-7c9030d18441 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:46.403235 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7726ed-a417-4877-af2b-7c9030d18441 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:46.408015 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb422e-8508-4838-b822-90f8f3e07b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:46.408622 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb422e-8508-4838-b822-90f8f3e07b20 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:46.408903 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb422e-8508-4838-b822-90f8f3e07b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:46.409181 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb422e-8508-4838-b822-90f8f3e07b20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:46.409856 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb422e-8508-4838-b822-90f8f3e07b20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:46.412004 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb422e-8508-4838-b822-90f8f3e07b20 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:46.413559 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2eef05-29cb-4a88-94dc-8f1fc4465d86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=863b7e38591440f5a677bf2671182221, user_id=d461f94acd3048ffad92bc382aacfc76, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:46.416275 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2eef05-29cb-4a88-94dc-8f1fc4465d86 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:46.422922 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 796/1602] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:17:46.423936 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb422e-8508-4838-b822-90f8f3e07b20 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:46.435352 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 807/1603] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:17:46 2022] PUT /identity/v3/projects/863b7e38591440f5a677bf2671182221/users/d461f94acd3048ffad92bc382aacfc76/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:17:46.436181 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2eef05-29cb-4a88-94dc-8f1fc4465d86 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:46.437169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb422e-8508-4838-b822-90f8f3e07b20 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:46.465350 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:46.503077 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37ffca-1e6b-4109-a05d-48fc87425b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:46.503715 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37ffca-1e6b-4109-a05d-48fc87425b3b admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:46.504030 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37ffca-1e6b-4109-a05d-48fc87425b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:46.504305 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37ffca-1e6b-4109-a05d-48fc87425b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:46.504944 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b37ffca-1e6b-4109-a05d-48fc87425b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:46.506580 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b37ffca-1e6b-4109-a05d-48fc87425b3b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:46.517003 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 797/1604] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:17:46.517824 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37ffca-1e6b-4109-a05d-48fc87425b3b admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:46.519134 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2eef05-29cb-4a88-94dc-8f1fc4465d86 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:46.524994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81959cca-b09f-4008-b652-4ffe74c4ecf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:46.525638 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81959cca-b09f-4008-b652-4ffe74c4ecf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:46.525914 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81959cca-b09f-4008-b652-4ffe74c4ecf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:46.526379 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81959cca-b09f-4008-b652-4ffe74c4ecf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:46.527176 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81959cca-b09f-4008-b652-4ffe74c4ecf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:46.529125 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81959cca-b09f-4008-b652-4ffe74c4ecf2 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:46.540628 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37ffca-1e6b-4109-a05d-48fc87425b3b admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:46.545635 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e401c-acca-4c4e-83c8-6954770f81cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:46.546305 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e401c-acca-4c4e-83c8-6954770f81cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:46.546622 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e401c-acca-4c4e-83c8-6954770f81cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:46.546892 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e401c-acca-4c4e-83c8-6954770f81cd admin admin] PATH_INFO: `/v3/projects/1d53efe7d22341c68e74832d8d7e5dc2/users/39b6d3defb914283968dbbf18dfdb0ae/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:46.550436 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 808/1605] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:17:46.551286 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81959cca-b09f-4008-b652-4ffe74c4ecf2 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:46.562221 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81959cca-b09f-4008-b652-4ffe74c4ecf2 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:46.567670 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287078d-0a19-445e-a7db-a29396348bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:46.568277 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e401c-acca-4c4e-83c8-6954770f81cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d53efe7d22341c68e74832d8d7e5dc2, user_id=39b6d3defb914283968dbbf18dfdb0ae, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:46.568404 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287078d-0a19-445e-a7db-a29396348bd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:46.568583 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287078d-0a19-445e-a7db-a29396348bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:46.569002 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287078d-0a19-445e-a7db-a29396348bd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:46.569644 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a287078d-0a19-445e-a7db-a29396348bd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:46.571033 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e401c-acca-4c4e-83c8-6954770f81cd admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:46.571733 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a287078d-0a19-445e-a7db-a29396348bd5 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:46.585484 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 798/1606] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:17:46 2022] PUT /identity/v3/projects/1d53efe7d22341c68e74832d8d7e5dc2/users/39b6d3defb914283968dbbf18dfdb0ae/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:17:46.586917 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdc6f2-b2e2-457b-a7fa-8423804f631b None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:46.587199 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdc6f2-b2e2-457b-a7fa-8423804f631b None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:46.587469 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdc6f2-b2e2-457b-a7fa-8423804f631b None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:46.588723 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 799/1607] 10.222.0.79 () {54 vars in 962 bytes} [Wed Aug 31 19:17:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:17:46.589462 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cdc6f2-b2e2-457b-a7fa-8423804f631b None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:46.614322 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 809/1608] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:17:46 2022] POST /identity/v3/projects => generated 381 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:17:46.614746 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287078d-0a19-445e-a7db-a29396348bd5 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:46.661231 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cdc6f2-b2e2-457b-a7fa-8423804f631b None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:46.682160 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287078d-0a19-445e-a7db-a29396348bd5 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:46.687207 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efdea18-7041-473e-97de-2cd643975b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:46.687875 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efdea18-7041-473e-97de-2cd643975b16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:46.688165 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efdea18-7041-473e-97de-2cd643975b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:46.688428 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efdea18-7041-473e-97de-2cd643975b16 admin admin] PATH_INFO: `/v3/projects/3b3225f247194c74b64deb7ba7f3dcb2/users/83fcd5a3a5984363a0bdc1872b57d313/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:46.703157 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:46.705077 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efdea18-7041-473e-97de-2cd643975b16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b3225f247194c74b64deb7ba7f3dcb2, user_id=83fcd5a3a5984363a0bdc1872b57d313, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:46.708323 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efdea18-7041-473e-97de-2cd643975b16 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:46.721365 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a058f-8123-413a-8d62-7577a2e4f471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:46.721930 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 810/1609] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:17:46 2022] PUT /identity/v3/projects/3b3225f247194c74b64deb7ba7f3dcb2/users/83fcd5a3a5984363a0bdc1872b57d313/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:17:46.722156 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a058f-8123-413a-8d62-7577a2e4f471 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:46.722156 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a058f-8123-413a-8d62-7577a2e4f471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:46.723264 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a058f-8123-413a-8d62-7577a2e4f471 admin admin] PATH_INFO: `/v3/projects/8d80dc523a1343309bc0893f18038c1e/users/79d5a74b556544d5a46bf7b6d3488910/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:46.724114 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703156f-7a04-4894-a3f0-7fa0c0c447ed None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:46.724403 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703156f-7a04-4894-a3f0-7fa0c0c447ed None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:46.724670 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703156f-7a04-4894-a3f0-7fa0c0c447ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:46.740584 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a058f-8123-413a-8d62-7577a2e4f471 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d80dc523a1343309bc0893f18038c1e, user_id=79d5a74b556544d5a46bf7b6d3488910, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:46.743449 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a058f-8123-413a-8d62-7577a2e4f471 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:46.743829 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-7703156f-7a04-4894-a3f0-7fa0c0c447ed None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:17:46.745046 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-7703156f-7a04-4894-a3f0-7fa0c0c447ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:46.756738 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 800/1610] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:17:46 2022] PUT /identity/v3/projects/8d80dc523a1343309bc0893f18038c1e/users/79d5a74b556544d5a46bf7b6d3488910/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:17:46.757534 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a058f-8123-413a-8d62-7577a2e4f471 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:46.812150 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 811/1611] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:17:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:17:46.813883 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703156f-7a04-4894-a3f0-7fa0c0c447ed None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:46.823417 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703156f-7a04-4894-a3f0-7fa0c0c447ed None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:46.828028 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5975b-0bcb-4063-a968-f612e629029f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:46.828279 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a058f-8123-413a-8d62-7577a2e4f471 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:46.828682 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5975b-0bcb-4063-a968-f612e629029f admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:46.829616 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5975b-0bcb-4063-a968-f612e629029f admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:46.829895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5975b-0bcb-4063-a968-f612e629029f admin admin] PATH_INFO: `/v3/projects/843f2ea1f8d448118ac120c1631cc8f1/users/cf98518c693a414bb27b543354f78e80/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:46.833701 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403d0ed-86ea-432a-a100-b2ed14bd1b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:46.834359 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403d0ed-86ea-432a-a100-b2ed14bd1b96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:46.834674 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403d0ed-86ea-432a-a100-b2ed14bd1b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:46.834951 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403d0ed-86ea-432a-a100-b2ed14bd1b96 admin admin] PATH_INFO: `/v3/projects/e5201974d5644455b4f11d38d5a97198/users/f8ae8fa948c34e75a7dec755f29d5c0a/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:46.845345 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5975b-0bcb-4063-a968-f612e629029f admin admin] RBAC: Authorizing `identity:create_grant(project_id=843f2ea1f8d448118ac120c1631cc8f1, user_id=cf98518c693a414bb27b543354f78e80, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:46.848932 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5975b-0bcb-4063-a968-f612e629029f admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:46.851092 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403d0ed-86ea-432a-a100-b2ed14bd1b96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5201974d5644455b4f11d38d5a97198, user_id=f8ae8fa948c34e75a7dec755f29d5c0a, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:46.854017 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403d0ed-86ea-432a-a100-b2ed14bd1b96 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:46.858749 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:46.865914 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 812/1612] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:17:46 2022] PUT /identity/v3/projects/843f2ea1f8d448118ac120c1631cc8f1/users/cf98518c693a414bb27b543354f78e80/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:17:46.868692 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ed4d1-e0a6-45fb-876a-4e09d3ff88dc None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:46.868970 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ed4d1-e0a6-45fb-876a-4e09d3ff88dc None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:46.869246 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ed4d1-e0a6-45fb-876a-4e09d3ff88dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:46.873749 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 801/1613] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:17:46 2022] PUT /identity/v3/projects/e5201974d5644455b4f11d38d5a97198/users/f8ae8fa948c34e75a7dec755f29d5c0a/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:17:46.873749 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df02982-9049-44be-a007-7e5b5a91bd16 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:46.873749 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df02982-9049-44be-a007-7e5b5a91bd16 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:46.873749 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df02982-9049-44be-a007-7e5b5a91bd16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:46.901901 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-0df02982-9049-44be-a007-7e5b5a91bd16 None None] MFA Rules not processed for user `39b6d3defb914283968dbbf18dfdb0ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:17:46.903159 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0df02982-9049-44be-a007-7e5b5a91bd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:46.910306 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-6f7ed4d1-e0a6-45fb-876a-4e09d3ff88dc None None] MFA Rules not processed for user `1fd6d45d1bc3479da72cb1a1990a6137`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:17:46.911673 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-6f7ed4d1-e0a6-45fb-876a-4e09d3ff88dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:46.972116 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 802/1614] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:17:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:17:46.973373 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df02982-9049-44be-a007-7e5b5a91bd16 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:46.989615 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 813/1615] 10.222.0.79 () {58 vars in 1059 bytes} [Wed Aug 31 19:17:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:17:46.990301 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ed4d1-e0a6-45fb-876a-4e09d3ff88dc None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:47.026830 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:47.049649 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df02982-9049-44be-a007-7e5b5a91bd16 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:47.055470 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d1670-fbc9-4dab-b1ba-c04235c14a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:47.056086 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d1670-fbc9-4dab-b1ba-c04235c14a61 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:47.056372 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d1670-fbc9-4dab-b1ba-c04235c14a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:47.056656 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d1670-fbc9-4dab-b1ba-c04235c14a61 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:47.057297 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d1670-fbc9-4dab-b1ba-c04235c14a61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:47.059309 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d1670-fbc9-4dab-b1ba-c04235c14a61 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:47.074344 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ed4d1-e0a6-45fb-876a-4e09d3ff88dc None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:47.079428 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a62fc2-15a6-4af9-9035-15cbc58f065c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:47.081082 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a62fc2-15a6-4af9-9035-15cbc58f065c admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:47.081082 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a62fc2-15a6-4af9-9035-15cbc58f065c admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:47.081082 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a62fc2-15a6-4af9-9035-15cbc58f065c admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:47.081361 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a62fc2-15a6-4af9-9035-15cbc58f065c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:47.083878 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a62fc2-15a6-4af9-9035-15cbc58f065c admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:47.086109 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 803/1616] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:17:46 2022] POST /identity/v3/users => generated 297 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:17:47.087479 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d6b25-c5d8-4ad4-8c6a-7ea84b94fdca None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:47.087858 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d6b25-c5d8-4ad4-8c6a-7ea84b94fdca None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:47.088226 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d6b25-c5d8-4ad4-8c6a-7ea84b94fdca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:47.099968 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 814/1617] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:17:47.099968 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a62fc2-15a6-4af9-9035-15cbc58f065c admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:47.109436 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-622d6b25-c5d8-4ad4-8c6a-7ea84b94fdca None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:17:47.110754 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-622d6b25-c5d8-4ad4-8c6a-7ea84b94fdca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:47.119299 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 804/1618] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:17:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:17:47.120492 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016f02d-4e5f-4639-91d3-491958d28a0b None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:47.120773 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016f02d-4e5f-4639-91d3-491958d28a0b None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:47.121047 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016f02d-4e5f-4639-91d3-491958d28a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:47.140399 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-7016f02d-4e5f-4639-91d3-491958d28a0b None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:17:47.141697 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7016f02d-4e5f-4639-91d3-491958d28a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:47.151087 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 805/1619] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:17:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:17:47.152415 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c1687-71e5-41b1-bee1-620df7a41980 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:47.153332 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c1687-71e5-41b1-bee1-620df7a41980 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:47.153332 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c1687-71e5-41b1-bee1-620df7a41980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:47.157802 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a62fc2-15a6-4af9-9035-15cbc58f065c admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:47.161785 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ac6c1-74d8-460e-8a01-6e1cb374da66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:47.163124 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ac6c1-74d8-460e-8a01-6e1cb374da66 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:47.163124 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ac6c1-74d8-460e-8a01-6e1cb374da66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:47.163350 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ac6c1-74d8-460e-8a01-6e1cb374da66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:47.173055 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ac6c1-74d8-460e-8a01-6e1cb374da66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:47.174582 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ac6c1-74d8-460e-8a01-6e1cb374da66 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:47.184375 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 815/1620] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:17:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:17:47.185187 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ac6c1-74d8-460e-8a01-6e1cb374da66 service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:47.185397 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-083c1687-71e5-41b1-bee1-620df7a41980 None None] MFA Rules not processed for user `cf98518c693a414bb27b543354f78e80`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:17:47.186917 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-083c1687-71e5-41b1-bee1-620df7a41980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:47.201437 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ac6c1-74d8-460e-8a01-6e1cb374da66 service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:47.208662 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a84a6-92b1-4300-a0bc-fb353c891e27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:47.209658 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a84a6-92b1-4300-a0bc-fb353c891e27 service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:47.209658 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a84a6-92b1-4300-a0bc-fb353c891e27 service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:47.210021 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a84a6-92b1-4300-a0bc-fb353c891e27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:47.225374 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:47.263698 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 806/1621] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:17:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:17:47.269452 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3228e-933a-4f76-ad13-c92937368623 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:47.270217 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3228e-933a-4f76-ad13-c92937368623 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:47.270217 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3228e-933a-4f76-ad13-c92937368623 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:47.271367 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 807/1622] 10.222.0.79 () {54 vars in 962 bytes} [Wed Aug 31 19:17:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:17:47.272340 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3228e-933a-4f76-ad13-c92937368623 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:47.287412 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3228e-933a-4f76-ad13-c92937368623 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:47.288147 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a84a6-92b1-4300-a0bc-fb353c891e27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:47.290443 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a84a6-92b1-4300-a0bc-fb353c891e27 service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:47.293746 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad323f4-782e-40cb-bc02-207fc987e4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:47.294576 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad323f4-782e-40cb-bc02-207fc987e4d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:47.294960 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad323f4-782e-40cb-bc02-207fc987e4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:47.295305 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad323f4-782e-40cb-bc02-207fc987e4d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:47.296510 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad323f4-782e-40cb-bc02-207fc987e4d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:47.299831 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad323f4-782e-40cb-bc02-207fc987e4d8 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:47.309087 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 816/1623] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:17:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:17:47.310135 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a84a6-92b1-4300-a0bc-fb353c891e27 service nova] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:47.315204 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 808/1624] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:17:47.320161 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad323f4-782e-40cb-bc02-207fc987e4d8 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:47.323465 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a84a6-92b1-4300-a0bc-fb353c891e27 service nova] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:47.328990 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae125e04-6aea-4b0e-bcd3-e3d1a4b29435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:47.329859 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae125e04-6aea-4b0e-bcd3-e3d1a4b29435 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:47.330188 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae125e04-6aea-4b0e-bcd3-e3d1a4b29435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:47.330560 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae125e04-6aea-4b0e-bcd3-e3d1a4b29435 admin admin] PATH_INFO: `/v3/projects/3b3225f247194c74b64deb7ba7f3dcb2/users/83fcd5a3a5984363a0bdc1872b57d313/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:47.331590 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad323f4-782e-40cb-bc02-207fc987e4d8 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:47.332507 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae125e04-6aea-4b0e-bcd3-e3d1a4b29435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b3225f247194c74b64deb7ba7f3dcb2, user_id=83fcd5a3a5984363a0bdc1872b57d313, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:47.336273 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba9a38-08e4-4dff-a933-4232223896e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:47.336450 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae125e04-6aea-4b0e-bcd3-e3d1a4b29435 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:47.337139 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba9a38-08e4-4dff-a933-4232223896e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:47.337486 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba9a38-08e4-4dff-a933-4232223896e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:47.337896 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba9a38-08e4-4dff-a933-4232223896e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:47.350851 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 817/1625] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:17:47 2022] PUT /identity/v3/projects/3b3225f247194c74b64deb7ba7f3dcb2/users/83fcd5a3a5984363a0bdc1872b57d313/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:17:47.351796 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae125e04-6aea-4b0e-bcd3-e3d1a4b29435 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:47.352084 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba9a38-08e4-4dff-a933-4232223896e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:47.354125 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba9a38-08e4-4dff-a933-4232223896e8 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:47.368291 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 809/1626] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:17:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:17:47.369418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba9a38-08e4-4dff-a933-4232223896e8 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:47.382316 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba9a38-08e4-4dff-a933-4232223896e8 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:47.428560 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae125e04-6aea-4b0e-bcd3-e3d1a4b29435 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:47.432591 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c00e020-52c6-4b7d-82c7-cbad76d56d21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:47.433284 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00e020-52c6-4b7d-82c7-cbad76d56d21 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:47.433630 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00e020-52c6-4b7d-82c7-cbad76d56d21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:47.434604 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00e020-52c6-4b7d-82c7-cbad76d56d21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:47.467366 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d3178-4e3f-4245-bb54-f7da9da42ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:47.468358 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d3178-4e3f-4245-bb54-f7da9da42ca2 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:47.468724 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d3178-4e3f-4245-bb54-f7da9da42ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:47.469064 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d3178-4e3f-4245-bb54-f7da9da42ca2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:47.469943 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d3178-4e3f-4245-bb54-f7da9da42ca2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:47.472215 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d3178-4e3f-4245-bb54-f7da9da42ca2 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:47.517287 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 810/1627] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:17:47 2022] POST /identity/v3/projects => generated 365 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:17:47.517287 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e302f16-6a1b-4ffa-8172-6109cb41e79f None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:47.517287 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e302f16-6a1b-4ffa-8172-6109cb41e79f None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:47.517287 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e302f16-6a1b-4ffa-8172-6109cb41e79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:47.521384 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c00e020-52c6-4b7d-82c7-cbad76d56d21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:47.523219 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c00e020-52c6-4b7d-82c7-cbad76d56d21 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:47.537021 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:47.549276 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-7e302f16-6a1b-4ffa-8172-6109cb41e79f None None] MFA Rules not processed for user `1fd6d45d1bc3479da72cb1a1990a6137`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:17:47.549276 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7e302f16-6a1b-4ffa-8172-6109cb41e79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:47.551513 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 818/1628] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:17:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:17:47.552674 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c00e020-52c6-4b7d-82c7-cbad76d56d21 service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:47.581286 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c00e020-52c6-4b7d-82c7-cbad76d56d21 service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:47.656892 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 811/1629] 10.222.0.79 () {58 vars in 1059 bytes} [Wed Aug 31 19:17:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:17:47.669138 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9f7d6-2187-4795-99d7-ac88b6e72be1 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:47.670109 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9f7d6-2187-4795-99d7-ac88b6e72be1 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:47.671111 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9f7d6-2187-4795-99d7-ac88b6e72be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:47.677693 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:47.695809 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27a808-40dd-42cb-9cd7-7f963ed489b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:47.696588 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27a808-40dd-42cb-9cd7-7f963ed489b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:47.696929 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27a808-40dd-42cb-9cd7-7f963ed489b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:47.697556 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27a808-40dd-42cb-9cd7-7f963ed489b2 admin admin] PATH_INFO: `/v3/projects/c46de8e45b1048529995515d417c4be8/users/0d8582e63be94371a5bcaeb998d92275/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:47.724955 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27a808-40dd-42cb-9cd7-7f963ed489b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c46de8e45b1048529995515d417c4be8, user_id=0d8582e63be94371a5bcaeb998d92275, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:47.727813 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27a808-40dd-42cb-9cd7-7f963ed489b2 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:47.735172 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-0db9f7d6-2187-4795-99d7-ac88b6e72be1 None None] MFA Rules not processed for user `83fcd5a3a5984363a0bdc1872b57d313`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:17:47.739815 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0db9f7d6-2187-4795-99d7-ac88b6e72be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:47.748333 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 819/1630] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:17:47 2022] PUT /identity/v3/projects/c46de8e45b1048529995515d417c4be8/users/0d8582e63be94371a5bcaeb998d92275/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:17:47.749307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27a808-40dd-42cb-9cd7-7f963ed489b2 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:47.861758 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27a808-40dd-42cb-9cd7-7f963ed489b2 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:47.871555 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b96088-76fe-4745-ad82-8bc234e57833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:47.872812 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b96088-76fe-4745-ad82-8bc234e57833 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:47.873341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b96088-76fe-4745-ad82-8bc234e57833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:47.873759 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b96088-76fe-4745-ad82-8bc234e57833 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:47.874409 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b96088-76fe-4745-ad82-8bc234e57833 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:47.876429 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b96088-76fe-4745-ad82-8bc234e57833 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:47.883045 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 812/1631] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:17:47 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:17:47.884527 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507e733-c43c-47c1-bf63-2e05ab1d8502 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:47.885197 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507e733-c43c-47c1-bf63-2e05ab1d8502 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:47.885576 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507e733-c43c-47c1-bf63-2e05ab1d8502 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:47.895560 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 813/1632] 10.222.0.79 () {54 vars in 912 bytes} [Wed Aug 31 19:17:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:17:47.896561 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507e733-c43c-47c1-bf63-2e05ab1d8502 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:47.914437 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 820/1633] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:17:47 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:17:47.916136 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b96088-76fe-4745-ad82-8bc234e57833 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:47.932421 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b96088-76fe-4745-ad82-8bc234e57833 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:47.938590 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3465929-de2a-4ab6-9e08-08d6c4c18734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:47.939197 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3465929-de2a-4ab6-9e08-08d6c4c18734 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:47.939645 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3465929-de2a-4ab6-9e08-08d6c4c18734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:47.939921 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3465929-de2a-4ab6-9e08-08d6c4c18734 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:47.940574 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3465929-de2a-4ab6-9e08-08d6c4c18734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:47.942981 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3465929-de2a-4ab6-9e08-08d6c4c18734 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:47.958639 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 821/1634] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:17:47.961692 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fd9f1-f23e-41db-9c7f-1ca864e943ad None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:47.961985 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fd9f1-f23e-41db-9c7f-1ca864e943ad None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:47.962277 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fd9f1-f23e-41db-9c7f-1ca864e943ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:47.993610 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507e733-c43c-47c1-bf63-2e05ab1d8502 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:47.996119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-719fd9f1-f23e-41db-9c7f-1ca864e943ad None None] MFA Rules not processed for user `1fd6d45d1bc3479da72cb1a1990a6137`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:17:47.997905 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-719fd9f1-f23e-41db-9c7f-1ca864e943ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:48.001973 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ecbbf1-a769-4b00-a138-d1c820c71d19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:48.002864 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecbbf1-a769-4b00-a138-d1c820c71d19 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:48.002993 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecbbf1-a769-4b00-a138-d1c820c71d19 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:48.003795 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecbbf1-a769-4b00-a138-d1c820c71d19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:48.012912 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 822/1635] 10.222.0.79 () {58 vars in 1009 bytes} [Wed Aug 31 19:17:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:17:48.013898 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719fd9f1-f23e-41db-9c7f-1ca864e943ad None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:48.029762 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:48.087688 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ecbbf1-a769-4b00-a138-d1c820c71d19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:48.092729 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ecbbf1-a769-4b00-a138-d1c820c71d19 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:48.117134 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 814/1636] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:17:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:17:48.120406 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ecbbf1-a769-4b00-a138-d1c820c71d19 service nova] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:48.127490 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719fd9f1-f23e-41db-9c7f-1ca864e943ad None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:48.138623 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ecbbf1-a769-4b00-a138-d1c820c71d19 service nova] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:48.143198 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd063655-d074-46b3-aff4-b1c46e29df9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:48.143867 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd063655-d074-46b3-aff4-b1c46e29df9a service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:48.144150 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd063655-d074-46b3-aff4-b1c46e29df9a service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:48.147465 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd063655-d074-46b3-aff4-b1c46e29df9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:48.147569 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f9b19-ef71-4810-9d3b-fb77eb2a9a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:48.147569 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f9b19-ef71-4810-9d3b-fb77eb2a9a90 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:48.147867 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f9b19-ef71-4810-9d3b-fb77eb2a9a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:48.148117 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f9b19-ef71-4810-9d3b-fb77eb2a9a90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:48.148769 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f9b19-ef71-4810-9d3b-fb77eb2a9a90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:48.150890 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f9b19-ef71-4810-9d3b-fb77eb2a9a90 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:48.157857 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd063655-d074-46b3-aff4-b1c46e29df9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:48.161786 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd063655-d074-46b3-aff4-b1c46e29df9a service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:48.167548 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 815/1637] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:17:48.167548 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f9b19-ef71-4810-9d3b-fb77eb2a9a90 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:48.188349 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f9b19-ef71-4810-9d3b-fb77eb2a9a90 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:48.195132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 823/1638] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:17:48 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:17:48.196114 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd063655-d074-46b3-aff4-b1c46e29df9a service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:48.206176 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666b39e-411c-40ff-b7d8-549d821cf8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:48.208678 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666b39e-411c-40ff-b7d8-549d821cf8d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:48.210110 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666b39e-411c-40ff-b7d8-549d821cf8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:48.211223 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666b39e-411c-40ff-b7d8-549d821cf8d6 admin admin] PATH_INFO: `/v3/projects/c46de8e45b1048529995515d417c4be8/users/0d8582e63be94371a5bcaeb998d92275/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:48.214926 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd063655-d074-46b3-aff4-b1c46e29df9a service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:48.216711 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2666b39e-411c-40ff-b7d8-549d821cf8d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c46de8e45b1048529995515d417c4be8, user_id=0d8582e63be94371a5bcaeb998d92275, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:48.226654 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2666b39e-411c-40ff-b7d8-549d821cf8d6 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:48.227403 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71968c83-ec65-44a1-aad5-9146e353b734 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:48.229557 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71968c83-ec65-44a1-aad5-9146e353b734 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:48.229845 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71968c83-ec65-44a1-aad5-9146e353b734 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:48.230879 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71968c83-ec65-44a1-aad5-9146e353b734 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:48.265809 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 816/1639] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:17:48 2022] PUT /identity/v3/projects/c46de8e45b1048529995515d417c4be8/users/0d8582e63be94371a5bcaeb998d92275/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:17:48.267643 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666b39e-411c-40ff-b7d8-549d821cf8d6 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:48.269127 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71968c83-ec65-44a1-aad5-9146e353b734 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:48.274391 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71968c83-ec65-44a1-aad5-9146e353b734 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:48.322200 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 824/1640] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:17:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:17:48.325082 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779b349-1fcc-4e36-90e7-808dcaa80e1d None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:48.325377 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779b349-1fcc-4e36-90e7-808dcaa80e1d None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:48.325650 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779b349-1fcc-4e36-90e7-808dcaa80e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:48.422046 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-a779b349-1fcc-4e36-90e7-808dcaa80e1d None None] MFA Rules not processed for user `0d8582e63be94371a5bcaeb998d92275`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:17:48.427206 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-a779b349-1fcc-4e36-90e7-808dcaa80e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:48.523123 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666b39e-411c-40ff-b7d8-549d821cf8d6 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:48.547851 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d200b5c-9ae2-440a-bb69-1e51dd5eb592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:48.548947 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d200b5c-9ae2-440a-bb69-1e51dd5eb592 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:48.549235 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d200b5c-9ae2-440a-bb69-1e51dd5eb592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:48.550146 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d200b5c-9ae2-440a-bb69-1e51dd5eb592 admin admin] PATH_INFO: `/v3/projects/30007d24212742869aa10b798d254e52/users/ea96ae12a3a949bea552982ee6af4119/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:48.554521 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:48.602816 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d200b5c-9ae2-440a-bb69-1e51dd5eb592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30007d24212742869aa10b798d254e52, user_id=ea96ae12a3a949bea552982ee6af4119, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:48.614774 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d200b5c-9ae2-440a-bb69-1e51dd5eb592 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:48.672645 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 817/1641] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:17:48 2022] PUT /identity/v3/projects/30007d24212742869aa10b798d254e52/users/ea96ae12a3a949bea552982ee6af4119/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:17:48.672645 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d200b5c-9ae2-440a-bb69-1e51dd5eb592 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:48.752672 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 825/1642] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:17:48 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:17:48.756211 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef1323-96cb-4ae1-b549-ec93499cfd48 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:48.757862 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef1323-96cb-4ae1-b549-ec93499cfd48 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:48.758154 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef1323-96cb-4ae1-b549-ec93499cfd48 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:48.763222 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 826/1643] 10.222.0.79 () {54 vars in 912 bytes} [Wed Aug 31 19:17:48 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:17:48.765835 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef1323-96cb-4ae1-b549-ec93499cfd48 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:48.853707 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d200b5c-9ae2-440a-bb69-1e51dd5eb592 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:48.865641 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a77bbd-9373-487a-a69f-af81120ab9b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:48.868250 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a77bbd-9373-487a-a69f-af81120ab9b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:48.868548 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a77bbd-9373-487a-a69f-af81120ab9b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:48.869824 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a77bbd-9373-487a-a69f-af81120ab9b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:48.904106 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef1323-96cb-4ae1-b549-ec93499cfd48 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:48.917274 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db1769-cf52-43d5-9976-19e9f2429685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:48.917967 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db1769-cf52-43d5-9976-19e9f2429685 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:48.918250 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db1769-cf52-43d5-9976-19e9f2429685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:48.918800 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db1769-cf52-43d5-9976-19e9f2429685 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:48.919993 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db1769-cf52-43d5-9976-19e9f2429685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:48.924824 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db1769-cf52-43d5-9976-19e9f2429685 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:48.953641 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 827/1644] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:17:48.957433 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c4642-2eae-48be-adca-5fc4048c98e1 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:48.958104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c4642-2eae-48be-adca-5fc4048c98e1 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:48.958387 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c4642-2eae-48be-adca-5fc4048c98e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:48.971495 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:49.007935 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-1b2c4642-2eae-48be-adca-5fc4048c98e1 None None] MFA Rules not processed for user `1fd6d45d1bc3479da72cb1a1990a6137`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:17:49.009726 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1b2c4642-2eae-48be-adca-5fc4048c98e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:49.026402 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a77bbd-9373-487a-a69f-af81120ab9b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:49.028909 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a77bbd-9373-487a-a69f-af81120ab9b2 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:49.061767 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 818/1645] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:17:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:17:49.064850 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a77bbd-9373-487a-a69f-af81120ab9b2 service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:49.102203 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a77bbd-9373-487a-a69f-af81120ab9b2 service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:49.111503 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25c834-15f3-4ee1-8610-22ba050c5f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:49.118313 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25c834-15f3-4ee1-8610-22ba050c5f2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:49.119209 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25c834-15f3-4ee1-8610-22ba050c5f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:49.119675 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25c834-15f3-4ee1-8610-22ba050c5f2a admin admin] PATH_INFO: `/v3/projects/30007d24212742869aa10b798d254e52/users/ea96ae12a3a949bea552982ee6af4119/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:49.125035 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc25c834-15f3-4ee1-8610-22ba050c5f2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=30007d24212742869aa10b798d254e52, user_id=ea96ae12a3a949bea552982ee6af4119, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:49.131608 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc25c834-15f3-4ee1-8610-22ba050c5f2a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:49.186558 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 819/1646] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:17:49 2022] PUT /identity/v3/projects/30007d24212742869aa10b798d254e52/users/ea96ae12a3a949bea552982ee6af4119/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:17:49.188240 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c60df-d50b-4a65-b00e-40905ed5aa36 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:49.188777 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c60df-d50b-4a65-b00e-40905ed5aa36 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:49.189447 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c60df-d50b-4a65-b00e-40905ed5aa36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:49.202259 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 828/1647] 10.222.0.79 () {58 vars in 1009 bytes} [Wed Aug 31 19:17:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:17:49.226384 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-578c60df-d50b-4a65-b00e-40905ed5aa36 None None] MFA Rules not processed for user `ea96ae12a3a949bea552982ee6af4119`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:17:49.228794 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-578c60df-d50b-4a65-b00e-40905ed5aa36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:49.437408 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 820/1648] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:17:49 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:17:49.489765 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c4642-2eae-48be-adca-5fc4048c98e1 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:49.496603 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c60df-d50b-4a65-b00e-40905ed5aa36 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:49.524900 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c4642-2eae-48be-adca-5fc4048c98e1 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:49.658628 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c60df-d50b-4a65-b00e-40905ed5aa36 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:49.663617 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:49.672626 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebbd78d-caf1-43ae-b6d5-96212d9f96cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:49.677261 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebbd78d-caf1-43ae-b6d5-96212d9f96cd service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:49.678618 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf03e1-811a-4a6b-87e6-2e7f20a3b93f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:49.679221 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebbd78d-caf1-43ae-b6d5-96212d9f96cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:49.679599 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebbd78d-caf1-43ae-b6d5-96212d9f96cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:49.680547 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf03e1-811a-4a6b-87e6-2e7f20a3b93f service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:49.680844 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf03e1-811a-4a6b-87e6-2e7f20a3b93f service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:49.681119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf03e1-811a-4a6b-87e6-2e7f20a3b93f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:49.799995 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf03e1-811a-4a6b-87e6-2e7f20a3b93f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:49.803814 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf03e1-811a-4a6b-87e6-2e7f20a3b93f service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:49.824546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 829/1649] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:17:49 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:17:49.878111 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:49.890968 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf03e1-811a-4a6b-87e6-2e7f20a3b93f service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:49.913067 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf03e1-811a-4a6b-87e6-2e7f20a3b93f service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:49.932457 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebbd78d-caf1-43ae-b6d5-96212d9f96cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:49.935115 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebbd78d-caf1-43ae-b6d5-96212d9f96cd service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:49.935648 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908e829-2252-449d-88f9-73e2b845c293 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:49.937870 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908e829-2252-449d-88f9-73e2b845c293 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:49.938162 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908e829-2252-449d-88f9-73e2b845c293 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:49.939908 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908e829-2252-449d-88f9-73e2b845c293 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:49.986059 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 821/1650] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:17:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:17:49.986297 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1908e829-2252-449d-88f9-73e2b845c293 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:49.987874 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1908e829-2252-449d-88f9-73e2b845c293 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:50.020865 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 830/1651] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:17:49 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:17:50.638074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebbd78d-caf1-43ae-b6d5-96212d9f96cd service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:50.662319 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebbd78d-caf1-43ae-b6d5-96212d9f96cd service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:50.680156 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a32ece-9a29-473b-ad71-97817af3fbeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:50.683911 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a32ece-9a29-473b-ad71-97817af3fbeb service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:50.685563 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a32ece-9a29-473b-ad71-97817af3fbeb service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:50.687520 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a32ece-9a29-473b-ad71-97817af3fbeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:50.795675 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a32ece-9a29-473b-ad71-97817af3fbeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:50.805468 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a32ece-9a29-473b-ad71-97817af3fbeb service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:50.828246 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 822/1652] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:17:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:17:51.218305 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908e829-2252-449d-88f9-73e2b845c293 service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:51.260668 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908e829-2252-449d-88f9-73e2b845c293 service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:51.270449 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa216bf-4579-4f88-9a66-b321c2d8ea7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:51.270657 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa216bf-4579-4f88-9a66-b321c2d8ea7d service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:51.270866 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa216bf-4579-4f88-9a66-b321c2d8ea7d service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:51.271130 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa216bf-4579-4f88-9a66-b321c2d8ea7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:51.406375 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa216bf-4579-4f88-9a66-b321c2d8ea7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:51.410269 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa216bf-4579-4f88-9a66-b321c2d8ea7d service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:51.483130 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 831/1653] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:17:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:17:53.397199 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a32ece-9a29-473b-ad71-97817af3fbeb service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:53.662223 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a32ece-9a29-473b-ad71-97817af3fbeb service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:53.681738 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537a4ff-58d8-4dfa-aaf1-96fc260b72c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:53.688203 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537a4ff-58d8-4dfa-aaf1-96fc260b72c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:53.689915 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537a4ff-58d8-4dfa-aaf1-96fc260b72c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:53.690266 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537a4ff-58d8-4dfa-aaf1-96fc260b72c0 admin admin] PATH_INFO: `/v3/users/07ff57133f824497b69892dbc4b32aed` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:53.696521 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5537a4ff-58d8-4dfa-aaf1-96fc260b72c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07ff57133f824497b69892dbc4b32aed)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:53.708394 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5537a4ff-58d8-4dfa-aaf1-96fc260b72c0 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:53.866420 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-5537a4ff-58d8-4dfa-aaf1-96fc260b72c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07ff57133f824497b69892dbc4b32aed'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:17:53.884815 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-5537a4ff-58d8-4dfa-aaf1-96fc260b72c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07ff57133f824497b69892dbc4b32aed'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:17:53.921908 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-5537a4ff-58d8-4dfa-aaf1-96fc260b72c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07ff57133f824497b69892dbc4b32aed'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:17:53.958657 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-5537a4ff-58d8-4dfa-aaf1-96fc260b72c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07ff57133f824497b69892dbc4b32aed'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:17:53.962052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-5537a4ff-58d8-4dfa-aaf1-96fc260b72c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07ff57133f824497b69892dbc4b32aed'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:17:53.985579 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 823/1654] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:17:53 2022] DELETE /identity/v3/users/07ff57133f824497b69892dbc4b32aed => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:17:53.990713 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3301ac5-c199-4d68-ba31-bbd455bd0db7 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:53.991299 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3301ac5-c199-4d68-ba31-bbd455bd0db7 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:53.991299 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3301ac5-c199-4d68-ba31-bbd455bd0db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:54.059729 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-c3301ac5-c199-4d68-ba31-bbd455bd0db7 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:17:54.063870 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-c3301ac5-c199-4d68-ba31-bbd455bd0db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:54.262674 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 832/1655] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:17:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:17:54.303042 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537a4ff-58d8-4dfa-aaf1-96fc260b72c0 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:54.304499 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5537a4ff-58d8-4dfa-aaf1-96fc260b72c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:54.314311 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:54.428282 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537a4ff-58d8-4dfa-aaf1-96fc260b72c0 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:54.433592 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ccad53-c526-46e7-a2b8-9fd9b0495644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:54.434774 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ccad53-c526-46e7-a2b8-9fd9b0495644 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:54.435176 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ccad53-c526-46e7-a2b8-9fd9b0495644 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:54.435701 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ccad53-c526-46e7-a2b8-9fd9b0495644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:54.449228 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ccad53-c526-46e7-a2b8-9fd9b0495644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:54.451511 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ccad53-c526-46e7-a2b8-9fd9b0495644 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:54.473634 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 824/1656] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:17:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:17:55.681809 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3301ac5-c199-4d68-ba31-bbd455bd0db7 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:55.683335 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-c3301ac5-c199-4d68-ba31-bbd455bd0db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:55.704124 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3301ac5-c199-4d68-ba31-bbd455bd0db7 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:55.715866 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6f17a-e20f-4b70-b821-3420876faf16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:55.719341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6f17a-e20f-4b70-b821-3420876faf16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:55.720102 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6f17a-e20f-4b70-b821-3420876faf16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:55.720102 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6f17a-e20f-4b70-b821-3420876faf16 admin admin] PATH_INFO: `/v3/projects/209160d0cbe64f40bca6fedf0e31a4c9` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:55.723383 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd6f17a-e20f-4b70-b821-3420876faf16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=209160d0cbe64f40bca6fedf0e31a4c9)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:55.730148 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd6f17a-e20f-4b70-b821-3420876faf16 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:55.794386 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:55.866751 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cdd6f17a-e20f-4b70-b821-3420876faf16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '209160d0cbe64f40bca6fedf0e31a4c9', 'request_id': 'req-cdd6f17a-e20f-4b70-b821-3420876faf16'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:17:55.886727 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cdd6f17a-e20f-4b70-b821-3420876faf16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '209160d0cbe64f40bca6fedf0e31a4c9', 'request_id': 'req-cdd6f17a-e20f-4b70-b821-3420876faf16'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:17:55.907711 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cdd6f17a-e20f-4b70-b821-3420876faf16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '209160d0cbe64f40bca6fedf0e31a4c9', 'request_id': 'req-cdd6f17a-e20f-4b70-b821-3420876faf16'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:17:55.932848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cdd6f17a-e20f-4b70-b821-3420876faf16 admin admin] The token cache is being invalidate because project 209160d0cbe64f40bca6fedf0e31a4c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:17:55.934573 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cdd6f17a-e20f-4b70-b821-3420876faf16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:17:55.935347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cdd6f17a-e20f-4b70-b821-3420876faf16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:17:55.942684 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 833/1657] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:17:55 2022] DELETE /identity/v3/projects/209160d0cbe64f40bca6fedf0e31a4c9 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:17:55.945677 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06daff2c-b53a-4042-a42d-a1e47670badc None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:55.946512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06daff2c-b53a-4042-a42d-a1e47670badc None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:55.947795 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06daff2c-b53a-4042-a42d-a1e47670badc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:56.021139 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-06daff2c-b53a-4042-a42d-a1e47670badc None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:17:56.022718 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-06daff2c-b53a-4042-a42d-a1e47670badc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:56.255215 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf756a18-99ff-4b33-a4f2-cde805832a08 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:56.255540 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf756a18-99ff-4b33-a4f2-cde805832a08 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:56.255807 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf756a18-99ff-4b33-a4f2-cde805832a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:56.257763 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 825/1658] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:17:56.298670 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-bf756a18-99ff-4b33-a4f2-cde805832a08 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:17:56.319595 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-bf756a18-99ff-4b33-a4f2-cde805832a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:56.365609 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06daff2c-b53a-4042-a42d-a1e47670badc None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:56.373938 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 834/1659] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:17:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:17:56.383728 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06daff2c-b53a-4042-a42d-a1e47670badc None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:56.397372 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78e8e4-bd66-48c3-b838-d29a73444cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:56.398014 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78e8e4-bd66-48c3-b838-d29a73444cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:56.398302 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78e8e4-bd66-48c3-b838-d29a73444cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:56.398611 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78e8e4-bd66-48c3-b838-d29a73444cf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:56.399279 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb78e8e4-bd66-48c3-b838-d29a73444cf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:17:56.399746 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb78e8e4-bd66-48c3-b838-d29a73444cf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:56.402103 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb78e8e4-bd66-48c3-b838-d29a73444cf1 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:56.441885 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf756a18-99ff-4b33-a4f2-cde805832a08 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:56.452942 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 826/1660] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:17:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:17:56.465375 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf756a18-99ff-4b33-a4f2-cde805832a08 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:56.475396 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05802648-208f-4c1b-96ed-e72d4bb6deda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:56.475873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05802648-208f-4c1b-96ed-e72d4bb6deda admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:56.476152 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05802648-208f-4c1b-96ed-e72d4bb6deda admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:56.476423 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05802648-208f-4c1b-96ed-e72d4bb6deda admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:56.492741 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05802648-208f-4c1b-96ed-e72d4bb6deda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:56.494898 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05802648-208f-4c1b-96ed-e72d4bb6deda admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:56.591770 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78e8e4-bd66-48c3-b838-d29a73444cf1 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:56.609213 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 835/1661] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:17:56 2022] POST /identity/v3/projects => generated 405 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:17:56.616058 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78e8e4-bd66-48c3-b838-d29a73444cf1 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:56.735418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dbebe3-24d9-494f-842b-71274dc0897d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:56.739995 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbebe3-24d9-494f-842b-71274dc0897d admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:56.740297 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbebe3-24d9-494f-842b-71274dc0897d admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:56.742740 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbebe3-24d9-494f-842b-71274dc0897d admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:56.743560 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dbebe3-24d9-494f-842b-71274dc0897d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:56.749044 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dbebe3-24d9-494f-842b-71274dc0897d admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:56.764483 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16d992-c940-4fc4-ac37-8dc3d5e4d2a2 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:56.764984 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16d992-c940-4fc4-ac37-8dc3d5e4d2a2 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:56.765075 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16d992-c940-4fc4-ac37-8dc3d5e4d2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:56.828316 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 827/1662] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:17:56 2022] POST /identity/v3/users => generated 303 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:17:56.831773 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dbebe3-24d9-494f-842b-71274dc0897d admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:56.846097 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dbebe3-24d9-494f-842b-71274dc0897d admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:56.857631 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-8e16d992-c940-4fc4-ac37-8dc3d5e4d2a2 None None] MFA Rules not processed for user `d461f94acd3048ffad92bc382aacfc76`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:17:56.859766 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c87ed-e16d-406f-8c5f-235feb94f093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:56.860927 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c87ed-e16d-406f-8c5f-235feb94f093 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:56.860927 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c87ed-e16d-406f-8c5f-235feb94f093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:56.861101 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c87ed-e16d-406f-8c5f-235feb94f093 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:56.861662 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-8e16d992-c940-4fc4-ac37-8dc3d5e4d2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:56.861772 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c87ed-e16d-406f-8c5f-235feb94f093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:56.866740 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c87ed-e16d-406f-8c5f-235feb94f093 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:56.902762 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 828/1663] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:17:56.903704 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c87ed-e16d-406f-8c5f-235feb94f093 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:56.942834 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c87ed-e16d-406f-8c5f-235feb94f093 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:56.952987 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430fd5f-504e-4df1-851a-7d9accca178c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:56.954627 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430fd5f-504e-4df1-851a-7d9accca178c admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:56.955089 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430fd5f-504e-4df1-851a-7d9accca178c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:56.955530 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430fd5f-504e-4df1-851a-7d9accca178c admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:56.958246 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430fd5f-504e-4df1-851a-7d9accca178c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:56.961343 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430fd5f-504e-4df1-851a-7d9accca178c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:57.000608 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 829/1664] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:17:57.003537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430fd5f-504e-4df1-851a-7d9accca178c admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:57.014944 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:57.031036 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430fd5f-504e-4df1-851a-7d9accca178c admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:57.038617 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa76ea8-ad21-4735-b31e-eaaf280d62ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:57.040282 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa76ea8-ad21-4735-b31e-eaaf280d62ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:57.040842 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa76ea8-ad21-4735-b31e-eaaf280d62ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:57.041874 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa76ea8-ad21-4735-b31e-eaaf280d62ec admin admin] PATH_INFO: `/v3/projects/63fa6e8a0fac4baea9edaa53f44bb659/users/19ae0ec3fdf4400da7db58d99a6937a9/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:57.070839 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa76ea8-ad21-4735-b31e-eaaf280d62ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=63fa6e8a0fac4baea9edaa53f44bb659, user_id=19ae0ec3fdf4400da7db58d99a6937a9, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:57.076953 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa76ea8-ad21-4735-b31e-eaaf280d62ec admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:57.108201 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 830/1665] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:17:57 2022] PUT /identity/v3/projects/63fa6e8a0fac4baea9edaa53f44bb659/users/19ae0ec3fdf4400da7db58d99a6937a9/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:17:57.112169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59555d9-5091-45ba-b60c-c36caa1926c1 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:57.113172 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59555d9-5091-45ba-b60c-c36caa1926c1 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:57.113916 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59555d9-5091-45ba-b60c-c36caa1926c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:57.123265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 836/1666] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:17:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:17:57.128624 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dedc28-74cf-4522-ab00-0441826b35ec None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:57.131493 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dedc28-74cf-4522-ab00-0441826b35ec None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:57.132059 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dedc28-74cf-4522-ab00-0441826b35ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:57.178499 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-f59555d9-5091-45ba-b60c-c36caa1926c1 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:17:57.178499 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f59555d9-5091-45ba-b60c-c36caa1926c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:57.202888 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-34dedc28-74cf-4522-ab00-0441826b35ec None None] MFA Rules not processed for user `d461f94acd3048ffad92bc382aacfc76`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:17:57.204694 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-34dedc28-74cf-4522-ab00-0441826b35ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:57.365969 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 831/1667] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:17:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:17:57.399464 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 837/1668] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:17:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:17:57.416846 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59555d9-5091-45ba-b60c-c36caa1926c1 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:57.417778 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dedc28-74cf-4522-ab00-0441826b35ec None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:57.418094 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f59555d9-5091-45ba-b60c-c36caa1926c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:57.424019 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-34dedc28-74cf-4522-ab00-0441826b35ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:57.472907 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:57.664036 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dedc28-74cf-4522-ab00-0441826b35ec None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:57.681989 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59555d9-5091-45ba-b60c-c36caa1926c1 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:57.682431 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315992fd-458e-4e07-9380-04721c0b9e20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:57.683092 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315992fd-458e-4e07-9380-04721c0b9e20 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:57.683368 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315992fd-458e-4e07-9380-04721c0b9e20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:57.683761 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315992fd-458e-4e07-9380-04721c0b9e20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:57.690664 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e1529-a823-46bc-b1b8-6354a3cc263c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:57.691871 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e1529-a823-46bc-b1b8-6354a3cc263c service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:57.692368 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e1529-a823-46bc-b1b8-6354a3cc263c service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:57.693614 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e1529-a823-46bc-b1b8-6354a3cc263c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:57.698670 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315992fd-458e-4e07-9380-04721c0b9e20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:57.700126 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315992fd-458e-4e07-9380-04721c0b9e20 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:57.705981 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822e1529-a823-46bc-b1b8-6354a3cc263c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:57.710378 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822e1529-a823-46bc-b1b8-6354a3cc263c service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:57.724236 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 838/1669] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:17:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:17:57.725153 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315992fd-458e-4e07-9380-04721c0b9e20 service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:57.725927 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 832/1670] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:17:57 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:17:57.727313 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-315992fd-458e-4e07-9380-04721c0b9e20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:57.755117 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315992fd-458e-4e07-9380-04721c0b9e20 service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:57.765618 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dec40d-cc16-4d08-a000-f1f99aeedff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:57.766339 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dec40d-cc16-4d08-a000-f1f99aeedff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:57.766623 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dec40d-cc16-4d08-a000-f1f99aeedff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:57.766901 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dec40d-cc16-4d08-a000-f1f99aeedff4 admin admin] PATH_INFO: `/v3/users/39b6d3defb914283968dbbf18dfdb0ae` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:57.770978 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dec40d-cc16-4d08-a000-f1f99aeedff4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39b6d3defb914283968dbbf18dfdb0ae)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:57.773130 dv-cinder-852210-6-smb devstack@keystone.service[81682]: WARNING py.warnings [None req-e2dec40d-cc16-4d08-a000-f1f99aeedff4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:17:57.773130 dv-cinder-852210-6-smb devstack@keystone.service[81682]: warnings.warn(msg) Aug 31 19:17:57.773130 dv-cinder-852210-6-smb devstack@keystone.service[81682]: Aug 31 19:17:57.776962 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dec40d-cc16-4d08-a000-f1f99aeedff4 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:57.965258 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-e2dec40d-cc16-4d08-a000-f1f99aeedff4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39b6d3defb914283968dbbf18dfdb0ae'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:17:57.966434 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-e2dec40d-cc16-4d08-a000-f1f99aeedff4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39b6d3defb914283968dbbf18dfdb0ae'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:17:58.016350 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-e2dec40d-cc16-4d08-a000-f1f99aeedff4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39b6d3defb914283968dbbf18dfdb0ae'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:17:58.042583 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-e2dec40d-cc16-4d08-a000-f1f99aeedff4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39b6d3defb914283968dbbf18dfdb0ae'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:17:58.059757 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-e2dec40d-cc16-4d08-a000-f1f99aeedff4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39b6d3defb914283968dbbf18dfdb0ae'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:17:58.074171 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 839/1671] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:17:57 2022] DELETE /identity/v3/users/39b6d3defb914283968dbbf18dfdb0ae => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:17:58.076296 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e49013-d54a-4047-b6c4-93bb9dee831e None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:58.076768 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e49013-d54a-4047-b6c4-93bb9dee831e None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:58.076841 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e49013-d54a-4047-b6c4-93bb9dee831e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:58.121432 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-e5e49013-d54a-4047-b6c4-93bb9dee831e None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:17:58.122713 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e5e49013-d54a-4047-b6c4-93bb9dee831e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:58.281597 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 833/1672] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:17:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:17:58.295959 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dec40d-cc16-4d08-a000-f1f99aeedff4 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:58.297928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-e2dec40d-cc16-4d08-a000-f1f99aeedff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:58.442445 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dec40d-cc16-4d08-a000-f1f99aeedff4 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:58.454798 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e2921-31e8-4d7d-ae05-d50ad108520e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:58.455438 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e2921-31e8-4d7d-ae05-d50ad108520e service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:58.455767 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e2921-31e8-4d7d-ae05-d50ad108520e service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:58.456049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e2921-31e8-4d7d-ae05-d50ad108520e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:58.484807 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e2921-31e8-4d7d-ae05-d50ad108520e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:58.488283 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e2921-31e8-4d7d-ae05-d50ad108520e service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:58.514430 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 840/1673] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:17:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:17:59.240801 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bee31c-46ba-4353-ba78-7bd24b17dff3 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:59.241295 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bee31c-46ba-4353-ba78-7bd24b17dff3 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:59.241394 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bee31c-46ba-4353-ba78-7bd24b17dff3 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:59.243731 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 834/1674] 10.222.0.79 () {54 vars in 912 bytes} [Wed Aug 31 19:17:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:17:59.255981 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507eb27-c4e8-4f3e-bcd2-b3fab7384d71 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:59.257265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507eb27-c4e8-4f3e-bcd2-b3fab7384d71 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:59.257450 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507eb27-c4e8-4f3e-bcd2-b3fab7384d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:59.367341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-e507eb27-c4e8-4f3e-bcd2-b3fab7384d71 None None] MFA Rules not processed for user `a91998a2818444a595adc06f1f481fe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:17:59.369011 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-e507eb27-c4e8-4f3e-bcd2-b3fab7384d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:59.392535 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 841/1675] 10.222.0.79 () {58 vars in 1009 bytes} [Wed Aug 31 19:17:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:17:59.439711 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bee31c-46ba-4353-ba78-7bd24b17dff3 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:59.442573 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-27bee31c-46ba-4353-ba78-7bd24b17dff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:59.459750 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:59.470370 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bee31c-46ba-4353-ba78-7bd24b17dff3 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:59.481119 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae559285-58e7-4e81-86ce-826d9780396a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:59.482224 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae559285-58e7-4e81-86ce-826d9780396a service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:59.483222 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae559285-58e7-4e81-86ce-826d9780396a service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:59.483706 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae559285-58e7-4e81-86ce-826d9780396a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:59.502406 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae559285-58e7-4e81-86ce-826d9780396a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:59.507451 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae559285-58e7-4e81-86ce-826d9780396a service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:59.509868 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507eb27-c4e8-4f3e-bcd2-b3fab7384d71 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:17:59.511840 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-e507eb27-c4e8-4f3e-bcd2-b3fab7384d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:17:59.537863 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 835/1676] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:17:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:17:59.548893 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507eb27-c4e8-4f3e-bcd2-b3fab7384d71 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:17:59.573590 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea1c54-aa34-46c1-9092-63cb5e8e25e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:17:59.575247 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea1c54-aa34-46c1-9092-63cb5e8e25e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:59.575647 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea1c54-aa34-46c1-9092-63cb5e8e25e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:59.576031 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea1c54-aa34-46c1-9092-63cb5e8e25e4 admin admin] PATH_INFO: `/v3/projects/1d53efe7d22341c68e74832d8d7e5dc2` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:59.578346 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea1c54-aa34-46c1-9092-63cb5e8e25e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d53efe7d22341c68e74832d8d7e5dc2)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:17:59.583569 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea1c54-aa34-46c1-9092-63cb5e8e25e4 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:17:59.604028 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:59.723854 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3aea1c54-aa34-46c1-9092-63cb5e8e25e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d53efe7d22341c68e74832d8d7e5dc2', 'request_id': 'req-3aea1c54-aa34-46c1-9092-63cb5e8e25e4'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:17:59.740087 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3aea1c54-aa34-46c1-9092-63cb5e8e25e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d53efe7d22341c68e74832d8d7e5dc2', 'request_id': 'req-3aea1c54-aa34-46c1-9092-63cb5e8e25e4'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:17:59.795281 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3aea1c54-aa34-46c1-9092-63cb5e8e25e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d53efe7d22341c68e74832d8d7e5dc2', 'request_id': 'req-3aea1c54-aa34-46c1-9092-63cb5e8e25e4'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:17:59.831734 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3aea1c54-aa34-46c1-9092-63cb5e8e25e4 admin admin] The token cache is being invalidate because project 1d53efe7d22341c68e74832d8d7e5dc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:17:59.832069 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3aea1c54-aa34-46c1-9092-63cb5e8e25e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:17:59.834904 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3aea1c54-aa34-46c1-9092-63cb5e8e25e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:17:59.841616 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 842/1677] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:17:59 2022] DELETE /identity/v3/projects/1d53efe7d22341c68e74832d8d7e5dc2 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:17:59.847904 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8367cc-043f-49ed-9c45-7823e56cce5d None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:17:59.848380 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8367cc-043f-49ed-9c45-7823e56cce5d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:17:59.848858 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8367cc-043f-49ed-9c45-7823e56cce5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:17:59.932055 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-4a8367cc-043f-49ed-9c45-7823e56cce5d None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:17:59.942242 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4a8367cc-043f-49ed-9c45-7823e56cce5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:00.093379 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 836/1678] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:17:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:00.094871 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709df3f-8fd9-455c-9fa3-6c1d7c338e79 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:00.095275 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709df3f-8fd9-455c-9fa3-6c1d7c338e79 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:00.095660 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709df3f-8fd9-455c-9fa3-6c1d7c338e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:00.149119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-4709df3f-8fd9-455c-9fa3-6c1d7c338e79 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:00.153393 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-4709df3f-8fd9-455c-9fa3-6c1d7c338e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:00.192626 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 843/1679] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:00.197364 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8367cc-043f-49ed-9c45-7823e56cce5d None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:00.213217 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8367cc-043f-49ed-9c45-7823e56cce5d None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:00.230023 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c08012-12ef-4627-91e4-3935df393260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:00.230804 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c08012-12ef-4627-91e4-3935df393260 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:00.231083 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c08012-12ef-4627-91e4-3935df393260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:00.231346 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c08012-12ef-4627-91e4-3935df393260 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:00.232176 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c08012-12ef-4627-91e4-3935df393260 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:18:00.232633 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c08012-12ef-4627-91e4-3935df393260 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:00.236104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c08012-12ef-4627-91e4-3935df393260 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:00.283523 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 837/1680] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:18:00.289062 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709df3f-8fd9-455c-9fa3-6c1d7c338e79 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:00.300299 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709df3f-8fd9-455c-9fa3-6c1d7c338e79 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:00.315782 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cef06-ebcd-4659-9458-1622aa69814a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:00.316586 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cef06-ebcd-4659-9458-1622aa69814a admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:00.316971 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cef06-ebcd-4659-9458-1622aa69814a admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:00.317333 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cef06-ebcd-4659-9458-1622aa69814a admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:00.322545 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76cef06-ebcd-4659-9458-1622aa69814a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:00.329771 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76cef06-ebcd-4659-9458-1622aa69814a admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:00.420940 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 844/1681] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:18:00 2022] POST /identity/v3/projects => generated 375 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:00.427275 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c08012-12ef-4627-91e4-3935df393260 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:00.452210 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c08012-12ef-4627-91e4-3935df393260 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:00.605944 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b34a12b-c484-43ff-89ad-91a87988d4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:00.606658 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34a12b-c484-43ff-89ad-91a87988d4f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:00.606933 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34a12b-c484-43ff-89ad-91a87988d4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:00.607205 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34a12b-c484-43ff-89ad-91a87988d4f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:00.607969 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b34a12b-c484-43ff-89ad-91a87988d4f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:00.612981 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b34a12b-c484-43ff-89ad-91a87988d4f5 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:00.661512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 838/1682] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:18:00 2022] POST /identity/v3/users => generated 288 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:00.662716 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cef06-ebcd-4659-9458-1622aa69814a admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:00.681209 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cef06-ebcd-4659-9458-1622aa69814a admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:00.696739 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ea8f4-e5b1-4178-a5bc-df3084a417c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:00.697663 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ea8f4-e5b1-4178-a5bc-df3084a417c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:00.698090 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ea8f4-e5b1-4178-a5bc-df3084a417c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:00.698612 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ea8f4-e5b1-4178-a5bc-df3084a417c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:00.699439 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ea8f4-e5b1-4178-a5bc-df3084a417c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:00.701473 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ea8f4-e5b1-4178-a5bc-df3084a417c0 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:00.735889 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 845/1683] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:00.737864 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b34a12b-c484-43ff-89ad-91a87988d4f5 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:00.753710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b34a12b-c484-43ff-89ad-91a87988d4f5 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:00.767645 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e52cd-981a-47ed-a5fd-16d5a27cb9e5 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:00.768282 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e52cd-981a-47ed-a5fd-16d5a27cb9e5 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:00.770055 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e52cd-981a-47ed-a5fd-16d5a27cb9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:00.782953 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03d01a-6327-4034-a53b-680d2c5fe457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:00.783588 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03d01a-6327-4034-a53b-680d2c5fe457 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:00.783872 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03d01a-6327-4034-a53b-680d2c5fe457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:00.784145 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03d01a-6327-4034-a53b-680d2c5fe457 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:00.784871 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd03d01a-6327-4034-a53b-680d2c5fe457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:00.788819 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd03d01a-6327-4034-a53b-680d2c5fe457 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:00.827669 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 839/1684] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:00.828667 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03d01a-6327-4034-a53b-680d2c5fe457 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:00.867113 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-bc9e52cd-981a-47ed-a5fd-16d5a27cb9e5 None None] MFA Rules not processed for user `f8ae8fa948c34e75a7dec755f29d5c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:00.870030 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-bc9e52cd-981a-47ed-a5fd-16d5a27cb9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:00.876908 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03d01a-6327-4034-a53b-680d2c5fe457 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:00.900633 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c97c3-6898-4adc-9aab-84845e02f73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:00.901324 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c97c3-6898-4adc-9aab-84845e02f73b admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:00.901607 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c97c3-6898-4adc-9aab-84845e02f73b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:00.901880 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c97c3-6898-4adc-9aab-84845e02f73b admin admin] PATH_INFO: `/v3/projects/f25a7720c88941a8abb425bc60a55a44/users/d10b8fc73342481da719528c75bb45ba/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:00.992105 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c97c3-6898-4adc-9aab-84845e02f73b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f25a7720c88941a8abb425bc60a55a44, user_id=d10b8fc73342481da719528c75bb45ba, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:01.005392 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c97c3-6898-4adc-9aab-84845e02f73b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:01.053228 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 840/1685] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:00 2022] PUT /identity/v3/projects/f25a7720c88941a8abb425bc60a55a44/users/d10b8fc73342481da719528c75bb45ba/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:01.054122 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c97c3-6898-4adc-9aab-84845e02f73b admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:01.068687 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e21c97c3-6898-4adc-9aab-84845e02f73b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:01.122893 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:01.127011 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 846/1686] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:01.128842 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb6a36-d531-427d-8352-35ef4abcbf0c None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:01.129147 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb6a36-d531-427d-8352-35ef4abcbf0c None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:01.129417 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb6a36-d531-427d-8352-35ef4abcbf0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:01.197259 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c97c3-6898-4adc-9aab-84845e02f73b admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:01.208008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536dfaee-971d-41e2-b1e0-f7b188e53a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:01.209303 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536dfaee-971d-41e2-b1e0-f7b188e53a9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:01.209303 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536dfaee-971d-41e2-b1e0-f7b188e53a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:01.209303 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536dfaee-971d-41e2-b1e0-f7b188e53a9e admin admin] PATH_INFO: `/v3/users/cf98518c693a414bb27b543354f78e80` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:01.212565 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536dfaee-971d-41e2-b1e0-f7b188e53a9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf98518c693a414bb27b543354f78e80)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:01.216538 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-37bb6a36-d531-427d-8352-35ef4abcbf0c None None] MFA Rules not processed for user `d10b8fc73342481da719528c75bb45ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:01.219482 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-37bb6a36-d531-427d-8352-35ef4abcbf0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:01.224562 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536dfaee-971d-41e2-b1e0-f7b188e53a9e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:01.291227 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:01.306155 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-536dfaee-971d-41e2-b1e0-f7b188e53a9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf98518c693a414bb27b543354f78e80'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:01.319442 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-536dfaee-971d-41e2-b1e0-f7b188e53a9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf98518c693a414bb27b543354f78e80'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:01.331408 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-536dfaee-971d-41e2-b1e0-f7b188e53a9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf98518c693a414bb27b543354f78e80'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:01.347988 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-536dfaee-971d-41e2-b1e0-f7b188e53a9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf98518c693a414bb27b543354f78e80'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:01.349452 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-536dfaee-971d-41e2-b1e0-f7b188e53a9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf98518c693a414bb27b543354f78e80'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:01.366816 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 847/1687] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:01.368047 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb6a36-d531-427d-8352-35ef4abcbf0c None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:01.369657 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-37bb6a36-d531-427d-8352-35ef4abcbf0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:01.372505 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 841/1688] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:18:01 2022] DELETE /identity/v3/users/cf98518c693a414bb27b543354f78e80 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:01.374152 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536dfaee-971d-41e2-b1e0-f7b188e53a9e admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:01.377084 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-536dfaee-971d-41e2-b1e0-f7b188e53a9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:01.393100 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb6a36-d531-427d-8352-35ef4abcbf0c None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:01.501407 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536dfaee-971d-41e2-b1e0-f7b188e53a9e admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:01.514249 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d051b9-1fe3-4636-9931-4e7cd223b778 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:01.515144 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d051b9-1fe3-4636-9931-4e7cd223b778 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:01.515597 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d051b9-1fe3-4636-9931-4e7cd223b778 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:01.515885 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d051b9-1fe3-4636-9931-4e7cd223b778 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:01.518525 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-25d051b9-1fe3-4636-9931-4e7cd223b778 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:01.546602 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784936d0-1deb-4e85-beef-fc1b4ad0b008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:01.547896 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784936d0-1deb-4e85-beef-fc1b4ad0b008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:01.548309 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784936d0-1deb-4e85-beef-fc1b4ad0b008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:01.548590 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784936d0-1deb-4e85-beef-fc1b4ad0b008 admin admin] PATH_INFO: `/v3/users/217c0db4963a40119eec67c947bbc38e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:01.550027 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784936d0-1deb-4e85-beef-fc1b4ad0b008 admin admin] RBAC: Authorizing `identity:delete_user(user_id=217c0db4963a40119eec67c947bbc38e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:01.552247 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784936d0-1deb-4e85-beef-fc1b4ad0b008 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:01.662054 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-784936d0-1deb-4e85-beef-fc1b4ad0b008 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '217c0db4963a40119eec67c947bbc38e'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:01.664365 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-784936d0-1deb-4e85-beef-fc1b4ad0b008 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '217c0db4963a40119eec67c947bbc38e'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:01.674530 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:01.698204 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-784936d0-1deb-4e85-beef-fc1b4ad0b008 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '217c0db4963a40119eec67c947bbc38e'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:01.707308 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d051b9-1fe3-4636-9931-4e7cd223b778 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:01.709402 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d051b9-1fe3-4636-9931-4e7cd223b778 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:01.715822 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-784936d0-1deb-4e85-beef-fc1b4ad0b008 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '217c0db4963a40119eec67c947bbc38e'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:01.736071 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-784936d0-1deb-4e85-beef-fc1b4ad0b008 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '217c0db4963a40119eec67c947bbc38e'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:01.743177 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 848/1689] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:18:01 2022] DELETE /identity/v3/users/217c0db4963a40119eec67c947bbc38e => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:01.743972 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784936d0-1deb-4e85-beef-fc1b4ad0b008 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:01.748857 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-784936d0-1deb-4e85-beef-fc1b4ad0b008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:01.760292 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 842/1690] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:01.761803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70826dcc-0368-4d35-a1ad-709197ec86af None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:01.762097 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70826dcc-0368-4d35-a1ad-709197ec86af None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:01.762374 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70826dcc-0368-4d35-a1ad-709197ec86af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:01.822084 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-70826dcc-0368-4d35-a1ad-709197ec86af None None] MFA Rules not processed for user `d461f94acd3048ffad92bc382aacfc76`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:01.823639 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-70826dcc-0368-4d35-a1ad-709197ec86af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:01.922088 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:01.935613 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 843/1691] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:01 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:01.936932 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70826dcc-0368-4d35-a1ad-709197ec86af None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:01.941431 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-70826dcc-0368-4d35-a1ad-709197ec86af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:01.982095 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784936d0-1deb-4e85-beef-fc1b4ad0b008 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:02.000448 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60f6f9-dd47-4570-a457-3eeb87d2cace service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece00ea631594381bf1c27cfc2ece6f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:02.001243 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60f6f9-dd47-4570-a457-3eeb87d2cace service placement] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:02.001530 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60f6f9-dd47-4570-a457-3eeb87d2cace service placement] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:02.001804 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60f6f9-dd47-4570-a457-3eeb87d2cace service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:02.009332 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-0e60f6f9-dd47-4570-a457-3eeb87d2cace service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:02.043213 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e60f6f9-dd47-4570-a457-3eeb87d2cace service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:02.045757 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e60f6f9-dd47-4570-a457-3eeb87d2cace service placement] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:02.080800 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 849/1692] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:02.089196 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70826dcc-0368-4d35-a1ad-709197ec86af None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:02.096255 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c0bf20-41c7-4e88-8b6e-46698e8cbe9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:02.097010 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0bf20-41c7-4e88-8b6e-46698e8cbe9c service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:02.097562 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0bf20-41c7-4e88-8b6e-46698e8cbe9c service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:02.097842 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0bf20-41c7-4e88-8b6e-46698e8cbe9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:02.101710 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0271d-ac76-4a90-bad7-606f9920e5d4 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:02.103848 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-73c0bf20-41c7-4e88-8b6e-46698e8cbe9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:02.109127 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0271d-ac76-4a90-bad7-606f9920e5d4 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:02.112440 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0271d-ac76-4a90-bad7-606f9920e5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:02.206274 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c0bf20-41c7-4e88-8b6e-46698e8cbe9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:02.209032 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c0bf20-41c7-4e88-8b6e-46698e8cbe9c service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:02.210684 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-04d0271d-ac76-4a90-bad7-606f9920e5d4 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:02.211944 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-04d0271d-ac76-4a90-bad7-606f9920e5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:02.228923 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 844/1693] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:02.231086 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1c721-3ce6-4d3e-8005-6ef114684a8b None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:02.231435 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1c721-3ce6-4d3e-8005-6ef114684a8b None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:02.231736 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1c721-3ce6-4d3e-8005-6ef114684a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:02.269613 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-4fc1c721-3ce6-4d3e-8005-6ef114684a8b None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:02.270891 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4fc1c721-3ce6-4d3e-8005-6ef114684a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:02.321033 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:02.388573 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 845/1694] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:02.390093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7c200-cbe6-463b-94c1-6624590009f4 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:02.390501 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7c200-cbe6-463b-94c1-6624590009f4 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:02.390871 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7c200-cbe6-463b-94c1-6624590009f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:02.442396 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-9fe7c200-cbe6-463b-94c1-6624590009f4 None None] MFA Rules not processed for user `19ae0ec3fdf4400da7db58d99a6937a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:02.444612 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9fe7c200-cbe6-463b-94c1-6624590009f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:02.463755 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 850/1695] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:02.464692 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0271d-ac76-4a90-bad7-606f9920e5d4 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:02.469400 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-04d0271d-ac76-4a90-bad7-606f9920e5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:02.686794 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0271d-ac76-4a90-bad7-606f9920e5d4 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:02.698013 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 846/1696] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:02 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:02.699163 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe7c200-cbe6-463b-94c1-6624590009f4 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:02.704322 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9fe7c200-cbe6-463b-94c1-6624590009f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:02.719276 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca3851-b2ab-485b-b096-ad1fbd38d2b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:02.720134 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca3851-b2ab-485b-b096-ad1fbd38d2b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:02.720552 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca3851-b2ab-485b-b096-ad1fbd38d2b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:02.720957 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca3851-b2ab-485b-b096-ad1fbd38d2b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:02.735063 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe7c200-cbe6-463b-94c1-6624590009f4 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:02.741451 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35d738-36b0-48fb-9843-f4ca570683cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:02.742097 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35d738-36b0-48fb-9843-f4ca570683cf service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:02.742382 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35d738-36b0-48fb-9843-f4ca570683cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:02.742695 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35d738-36b0-48fb-9843-f4ca570683cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:02.757820 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35d738-36b0-48fb-9843-f4ca570683cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:02.759479 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35d738-36b0-48fb-9843-f4ca570683cf service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:02.760779 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca3851-b2ab-485b-b096-ad1fbd38d2b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:02.764688 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca3851-b2ab-485b-b096-ad1fbd38d2b4 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:02.774234 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 847/1697] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:02.775021 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35d738-36b0-48fb-9843-f4ca570683cf service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:02.777107 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ee35d738-36b0-48fb-9843-f4ca570683cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:02.802385 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35d738-36b0-48fb-9843-f4ca570683cf service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:02.808259 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 851/1698] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:02.808637 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00910bfe-c7f2-4ae1-a87c-4331a6526853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:02.809423 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00910bfe-c7f2-4ae1-a87c-4331a6526853 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:02.809711 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00910bfe-c7f2-4ae1-a87c-4331a6526853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:02.809988 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00910bfe-c7f2-4ae1-a87c-4331a6526853 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:02.810670 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00910bfe-c7f2-4ae1-a87c-4331a6526853 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:02.812604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00910bfe-c7f2-4ae1-a87c-4331a6526853 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:02.813153 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca3851-b2ab-485b-b096-ad1fbd38d2b4 service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:02.818546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-54ca3851-b2ab-485b-b096-ad1fbd38d2b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:02.865222 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 848/1699] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:18:02 2022] POST /identity/v3/projects => generated 403 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:02.871667 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca3851-b2ab-485b-b096-ad1fbd38d2b4 service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:02.873060 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00910bfe-c7f2-4ae1-a87c-4331a6526853 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:03.134539 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00910bfe-c7f2-4ae1-a87c-4331a6526853 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:03.162725 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f11c674-c900-43ec-86c4-c2a68c3cbc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:03.163581 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11c674-c900-43ec-86c4-c2a68c3cbc5c admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:03.165576 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11c674-c900-43ec-86c4-c2a68c3cbc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:03.166041 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11c674-c900-43ec-86c4-c2a68c3cbc5c admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:03.167767 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f11c674-c900-43ec-86c4-c2a68c3cbc5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:03.180031 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f11c674-c900-43ec-86c4-c2a68c3cbc5c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:03.192892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b9b4a-9910-45d7-ab89-65858f7ee62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:03.193775 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b9b4a-9910-45d7-ab89-65858f7ee62d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:03.194066 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b9b4a-9910-45d7-ab89-65858f7ee62d admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:03.194343 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b9b4a-9910-45d7-ab89-65858f7ee62d admin admin] PATH_INFO: `/v3/users/d10b8fc73342481da719528c75bb45ba` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:03.201026 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501b9b4a-9910-45d7-ab89-65858f7ee62d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d10b8fc73342481da719528c75bb45ba)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:03.213620 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501b9b4a-9910-45d7-ab89-65858f7ee62d admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:03.275461 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 849/1700] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:18:02 2022] POST /identity/v3/users => generated 308 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:03.276597 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f11c674-c900-43ec-86c4-c2a68c3cbc5c admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:03.305510 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:03.325842 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f11c674-c900-43ec-86c4-c2a68c3cbc5c admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:03.349726 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-501b9b4a-9910-45d7-ab89-65858f7ee62d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd10b8fc73342481da719528c75bb45ba'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:03.350855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-501b9b4a-9910-45d7-ab89-65858f7ee62d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd10b8fc73342481da719528c75bb45ba'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:03.367332 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250d53c-0999-42fe-88bb-2c8a93a132b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:03.369329 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250d53c-0999-42fe-88bb-2c8a93a132b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:03.372268 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250d53c-0999-42fe-88bb-2c8a93a132b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:03.373686 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250d53c-0999-42fe-88bb-2c8a93a132b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:03.376706 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d250d53c-0999-42fe-88bb-2c8a93a132b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:03.384971 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d250d53c-0999-42fe-88bb-2c8a93a132b8 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:03.385969 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-501b9b4a-9910-45d7-ab89-65858f7ee62d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd10b8fc73342481da719528c75bb45ba'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:03.408937 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-501b9b4a-9910-45d7-ab89-65858f7ee62d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd10b8fc73342481da719528c75bb45ba'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:03.431435 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-501b9b4a-9910-45d7-ab89-65858f7ee62d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd10b8fc73342481da719528c75bb45ba'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:03.457357 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 852/1701] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:18:02 2022] DELETE /identity/v3/users/d10b8fc73342481da719528c75bb45ba => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:03.457748 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 850/1702] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:03.457849 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b9b4a-9910-45d7-ab89-65858f7ee62d admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:03.459465 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-501b9b4a-9910-45d7-ab89-65858f7ee62d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:03.461723 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031995f-dae6-4cc8-bd22-a4a647a47f27 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:03.463019 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031995f-dae6-4cc8-bd22-a4a647a47f27 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:03.465466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031995f-dae6-4cc8-bd22-a4a647a47f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:03.511691 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:03.560764 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-a031995f-dae6-4cc8-bd22-a4a647a47f27 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:03.567490 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a031995f-dae6-4cc8-bd22-a4a647a47f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:03.650080 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b9b4a-9910-45d7-ab89-65858f7ee62d admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:03.664449 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3eb533-b423-42b1-b0e3-4db2b6ea85dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:03.665626 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3eb533-b423-42b1-b0e3-4db2b6ea85dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:03.669420 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3eb533-b423-42b1-b0e3-4db2b6ea85dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:03.669884 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3eb533-b423-42b1-b0e3-4db2b6ea85dc admin admin] PATH_INFO: `/v3/projects/2cb9142415504d2dad5d102d85dcf37f/users/d86e6d63aac348f08779d67ec479bd34/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:03.726928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3eb533-b423-42b1-b0e3-4db2b6ea85dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cb9142415504d2dad5d102d85dcf37f, user_id=d86e6d63aac348f08779d67ec479bd34, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:03.735875 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3eb533-b423-42b1-b0e3-4db2b6ea85dc admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:03.772772 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 853/1703] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:03 2022] PUT /identity/v3/projects/2cb9142415504d2dad5d102d85dcf37f/users/d86e6d63aac348f08779d67ec479bd34/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:03.777631 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3eb533-b423-42b1-b0e3-4db2b6ea85dc admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:03.904812 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 851/1704] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:04.010448 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3eb533-b423-42b1-b0e3-4db2b6ea85dc admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:04.037554 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b9fc8-fe4f-4acd-9bde-d449f1270cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:04.039499 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b9fc8-fe4f-4acd-9bde-d449f1270cfd admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:04.041306 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b9fc8-fe4f-4acd-9bde-d449f1270cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:04.041306 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b9fc8-fe4f-4acd-9bde-d449f1270cfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:04.045223 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72b9fc8-fe4f-4acd-9bde-d449f1270cfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:04.047058 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72b9fc8-fe4f-4acd-9bde-d449f1270cfd admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:04.099682 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 854/1705] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:04.103229 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a031995f-dae6-4cc8-bd22-a4a647a47f27 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:04.145732 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a031995f-dae6-4cc8-bd22-a4a647a47f27 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:04.180135 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f86c05-dd8f-4f5b-bd45-444058508194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:04.181154 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f86c05-dd8f-4f5b-bd45-444058508194 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:04.181575 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f86c05-dd8f-4f5b-bd45-444058508194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:04.181989 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f86c05-dd8f-4f5b-bd45-444058508194 admin admin] PATH_INFO: `/v3/projects/2cb9142415504d2dad5d102d85dcf37f/users/d86e6d63aac348f08779d67ec479bd34/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:04.188760 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f86c05-dd8f-4f5b-bd45-444058508194 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cb9142415504d2dad5d102d85dcf37f, user_id=d86e6d63aac348f08779d67ec479bd34, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:04.208617 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f86c05-dd8f-4f5b-bd45-444058508194 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:04.279934 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 852/1706] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:04 2022] PUT /identity/v3/projects/2cb9142415504d2dad5d102d85dcf37f/users/d86e6d63aac348f08779d67ec479bd34/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:04.488849 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b9fc8-fe4f-4acd-9bde-d449f1270cfd admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:04.490819 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f72b9fc8-fe4f-4acd-9bde-d449f1270cfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:04.584533 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f29316-96bf-4fdd-afb1-25e9a5ab3eea None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:04.585049 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f29316-96bf-4fdd-afb1-25e9a5ab3eea None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:04.585049 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f29316-96bf-4fdd-afb1-25e9a5ab3eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:04.626647 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:04.679496 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-c2f29316-96bf-4fdd-afb1-25e9a5ab3eea None None] MFA Rules not processed for user `79d5a74b556544d5a46bf7b6d3488910`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:04.682168 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c2f29316-96bf-4fdd-afb1-25e9a5ab3eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:04.739862 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b9fc8-fe4f-4acd-9bde-d449f1270cfd admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:04.925857 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f26b1-d5a2-444b-aa75-c0ef7822dbd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:04.928506 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f26b1-d5a2-444b-aa75-c0ef7822dbd8 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:04.928787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f26b1-d5a2-444b-aa75-c0ef7822dbd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:04.929057 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f26b1-d5a2-444b-aa75-c0ef7822dbd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:04.945791 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 853/1707] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:18:04.970873 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227c10b-7a9d-4ce5-844f-b1832a5b20b3 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:04.971166 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227c10b-7a9d-4ce5-844f-b1832a5b20b3 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:04.971413 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227c10b-7a9d-4ce5-844f-b1832a5b20b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:05.016537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-d227c10b-7a9d-4ce5-844f-b1832a5b20b3 None None] MFA Rules not processed for user `79d5a74b556544d5a46bf7b6d3488910`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:05.017661 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d227c10b-7a9d-4ce5-844f-b1832a5b20b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:05.039325 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 854/1708] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:18:05.053213 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227c10b-7a9d-4ce5-844f-b1832a5b20b3 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:05.054641 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d227c10b-7a9d-4ce5-844f-b1832a5b20b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:05.130198 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993f26b1-d5a2-444b-aa75-c0ef7822dbd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:05.140629 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993f26b1-d5a2-444b-aa75-c0ef7822dbd8 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:05.229097 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 855/1709] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 741 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:05.355899 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227c10b-7a9d-4ce5-844f-b1832a5b20b3 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:05.371757 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f681d-7176-4e44-a57c-3649e61a1ca3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:05.372639 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f681d-7176-4e44-a57c-3649e61a1ca3 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:05.373059 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f681d-7176-4e44-a57c-3649e61a1ca3 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:05.373471 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f681d-7176-4e44-a57c-3649e61a1ca3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:05.395089 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f681d-7176-4e44-a57c-3649e61a1ca3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:05.396995 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f681d-7176-4e44-a57c-3649e61a1ca3 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:05.411299 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:05.412464 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f26b1-d5a2-444b-aa75-c0ef7822dbd8 service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:05.414197 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-993f26b1-d5a2-444b-aa75-c0ef7822dbd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:05.461667 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 855/1710] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:18:05.466736 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f26b1-d5a2-444b-aa75-c0ef7822dbd8 service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:05.487101 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ea8b8-7edc-46fb-a02f-803d5ef7ba42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:05.488740 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ea8b8-7edc-46fb-a02f-803d5ef7ba42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:05.499353 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ea8b8-7edc-46fb-a02f-803d5ef7ba42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:05.499955 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ea8b8-7edc-46fb-a02f-803d5ef7ba42 admin admin] PATH_INFO: `/v3/projects/843f2ea1f8d448118ac120c1631cc8f1` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:05.502194 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ea8b8-7edc-46fb-a02f-803d5ef7ba42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=843f2ea1f8d448118ac120c1631cc8f1)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:05.508836 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ea8b8-7edc-46fb-a02f-803d5ef7ba42 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:05.661433 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-838ea8b8-7edc-46fb-a02f-803d5ef7ba42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '843f2ea1f8d448118ac120c1631cc8f1', 'request_id': 'req-838ea8b8-7edc-46fb-a02f-803d5ef7ba42'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:05.679817 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-838ea8b8-7edc-46fb-a02f-803d5ef7ba42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '843f2ea1f8d448118ac120c1631cc8f1', 'request_id': 'req-838ea8b8-7edc-46fb-a02f-803d5ef7ba42'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:05.703424 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-838ea8b8-7edc-46fb-a02f-803d5ef7ba42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '843f2ea1f8d448118ac120c1631cc8f1', 'request_id': 'req-838ea8b8-7edc-46fb-a02f-803d5ef7ba42'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:05.757285 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-838ea8b8-7edc-46fb-a02f-803d5ef7ba42 admin admin] The token cache is being invalidate because project 843f2ea1f8d448118ac120c1631cc8f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:18:05.757937 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-838ea8b8-7edc-46fb-a02f-803d5ef7ba42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:05.759271 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-838ea8b8-7edc-46fb-a02f-803d5ef7ba42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:05.767730 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 856/1711] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:18:05 2022] DELETE /identity/v3/projects/843f2ea1f8d448118ac120c1631cc8f1 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:18:05.768086 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f681d-7176-4e44-a57c-3649e61a1ca3 service nova] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:05.797333 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f681d-7176-4e44-a57c-3649e61a1ca3 service nova] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:05.931083 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ea8b8-7edc-46fb-a02f-803d5ef7ba42 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:05.933956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-838ea8b8-7edc-46fb-a02f-803d5ef7ba42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:05.978155 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:06.089510 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b979c9-3051-4938-8bbb-0f47529abebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:06.090169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b979c9-3051-4938-8bbb-0f47529abebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:06.090446 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b979c9-3051-4938-8bbb-0f47529abebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:06.090740 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b979c9-3051-4938-8bbb-0f47529abebb admin admin] PATH_INFO: `/v3/users/ea96ae12a3a949bea552982ee6af4119` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:06.096822 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b979c9-3051-4938-8bbb-0f47529abebb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea96ae12a3a949bea552982ee6af4119)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:06.099295 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b979c9-3051-4938-8bbb-0f47529abebb admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:06.212409 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ea8b8-7edc-46fb-a02f-803d5ef7ba42 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:06.241265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52c778-986c-4f63-b485-64e573e10ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:06.243279 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52c778-986c-4f63-b485-64e573e10ccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:06.245166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52c778-986c-4f63-b485-64e573e10ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:06.245569 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52c778-986c-4f63-b485-64e573e10ccc admin admin] PATH_INFO: `/v3/projects/9bf42bd08d2549c390e326f22b012e5b` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:06.251168 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c52c778-986c-4f63-b485-64e573e10ccc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bf42bd08d2549c390e326f22b012e5b)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:06.258526 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c52c778-986c-4f63-b485-64e573e10ccc admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:06.339040 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a4b979c9-3051-4938-8bbb-0f47529abebb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea96ae12a3a949bea552982ee6af4119'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:06.365877 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a4b979c9-3051-4938-8bbb-0f47529abebb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea96ae12a3a949bea552982ee6af4119'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:06.389298 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a4b979c9-3051-4938-8bbb-0f47529abebb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea96ae12a3a949bea552982ee6af4119'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:06.414405 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a4b979c9-3051-4938-8bbb-0f47529abebb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea96ae12a3a949bea552982ee6af4119'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:06.415793 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a4b979c9-3051-4938-8bbb-0f47529abebb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea96ae12a3a949bea552982ee6af4119'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:06.426056 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 856/1712] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:18:05 2022] DELETE /identity/v3/users/ea96ae12a3a949bea552982ee6af4119 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:06.437561 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3c52c778-986c-4f63-b485-64e573e10ccc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bf42bd08d2549c390e326f22b012e5b', 'request_id': 'req-3c52c778-986c-4f63-b485-64e573e10ccc'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:06.460452 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3c52c778-986c-4f63-b485-64e573e10ccc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bf42bd08d2549c390e326f22b012e5b', 'request_id': 'req-3c52c778-986c-4f63-b485-64e573e10ccc'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:06.481383 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3c52c778-986c-4f63-b485-64e573e10ccc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bf42bd08d2549c390e326f22b012e5b', 'request_id': 'req-3c52c778-986c-4f63-b485-64e573e10ccc'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:06.504960 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3c52c778-986c-4f63-b485-64e573e10ccc admin admin] The token cache is being invalidate because project 9bf42bd08d2549c390e326f22b012e5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:18:06.505257 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3c52c778-986c-4f63-b485-64e573e10ccc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:06.508222 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3c52c778-986c-4f63-b485-64e573e10ccc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:06.516822 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 857/1713] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:18:05 2022] DELETE /identity/v3/projects/9bf42bd08d2549c390e326f22b012e5b => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:18:06.526863 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b979c9-3051-4938-8bbb-0f47529abebb admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:06.531177 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a4b979c9-3051-4938-8bbb-0f47529abebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:06.884546 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b979c9-3051-4938-8bbb-0f47529abebb admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:06.891335 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7042b-5501-436a-b1e3-96953efaf0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:06.891928 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7042b-5501-436a-b1e3-96953efaf0c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:06.892440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7042b-5501-436a-b1e3-96953efaf0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:06.892787 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7042b-5501-436a-b1e3-96953efaf0c9 admin admin] PATH_INFO: `/v3/users/0d8582e63be94371a5bcaeb998d92275` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:06.895461 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f7042b-5501-436a-b1e3-96953efaf0c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d8582e63be94371a5bcaeb998d92275)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:06.897988 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f7042b-5501-436a-b1e3-96953efaf0c9 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:06.954554 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:07.003121 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-11f7042b-5501-436a-b1e3-96953efaf0c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d8582e63be94371a5bcaeb998d92275'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:07.028634 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-11f7042b-5501-436a-b1e3-96953efaf0c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d8582e63be94371a5bcaeb998d92275'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:07.075253 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-11f7042b-5501-436a-b1e3-96953efaf0c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d8582e63be94371a5bcaeb998d92275'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:07.150968 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-11f7042b-5501-436a-b1e3-96953efaf0c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d8582e63be94371a5bcaeb998d92275'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:07.158025 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-11f7042b-5501-436a-b1e3-96953efaf0c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d8582e63be94371a5bcaeb998d92275'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:07.180914 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 857/1714] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:18:06 2022] DELETE /identity/v3/users/0d8582e63be94371a5bcaeb998d92275 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:08.319978 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1cbdf0-0509-4536-82b7-0bfc200e67d2 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:08.324134 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1cbdf0-0509-4536-82b7-0bfc200e67d2 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:08.324603 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1cbdf0-0509-4536-82b7-0bfc200e67d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:08.404489 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-7c1cbdf0-0509-4536-82b7-0bfc200e67d2 None None] MFA Rules not processed for user `f8ae8fa948c34e75a7dec755f29d5c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:08.406580 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-7c1cbdf0-0509-4536-82b7-0bfc200e67d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:08.507156 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc68e8-1f75-4b59-9c14-a6706ef8f065 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:08.507769 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc68e8-1f75-4b59-9c14-a6706ef8f065 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:08.507769 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc68e8-1f75-4b59-9c14-a6706ef8f065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:08.642836 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 858/1715] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:08.678499 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-9dcc68e8-1f75-4b59-9c14-a6706ef8f065 None None] MFA Rules not processed for user `3e070c93f47045ecb5bf0a1622395091`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:08.682102 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9dcc68e8-1f75-4b59-9c14-a6706ef8f065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:08.877284 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 858/1716] 10.222.0.79 () {58 vars in 1009 bytes} [Wed Aug 31 19:18:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 31 19:18:09.113051 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1cbdf0-0509-4536-82b7-0bfc200e67d2 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:09.114629 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-7c1cbdf0-0509-4536-82b7-0bfc200e67d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:09.132306 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc68e8-1f75-4b59-9c14-a6706ef8f065 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:09.134481 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9dcc68e8-1f75-4b59-9c14-a6706ef8f065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:09.242108 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:09.280601 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1cbdf0-0509-4536-82b7-0bfc200e67d2 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:09.311680 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe59f1-b7ca-47cf-afe0-3566f3ce19a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:09.312415 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe59f1-b7ca-47cf-afe0-3566f3ce19a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:09.312787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe59f1-b7ca-47cf-afe0-3566f3ce19a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:09.313017 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe59f1-b7ca-47cf-afe0-3566f3ce19a6 admin admin] PATH_INFO: `/v3/projects/f25a7720c88941a8abb425bc60a55a44` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:09.318903 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe59f1-b7ca-47cf-afe0-3566f3ce19a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f25a7720c88941a8abb425bc60a55a44)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:09.323667 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe59f1-b7ca-47cf-afe0-3566f3ce19a6 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:09.372896 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:09.418891 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc68e8-1f75-4b59-9c14-a6706ef8f065 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:09.438685 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7cad17-3694-4c0a-b793-e753bcae619a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b289a0bef53460ca5173ad946394d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:09.443373 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7cad17-3694-4c0a-b793-e753bcae619a service swift] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:09.443677 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7cad17-3694-4c0a-b793-e753bcae619a service swift] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:09.444127 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7cad17-3694-4c0a-b793-e753bcae619a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:09.464160 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a1fe59f1-b7ca-47cf-afe0-3566f3ce19a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f25a7720c88941a8abb425bc60a55a44', 'request_id': 'req-a1fe59f1-b7ca-47cf-afe0-3566f3ce19a6'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:09.471099 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7cad17-3694-4c0a-b793-e753bcae619a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:09.477906 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7cad17-3694-4c0a-b793-e753bcae619a service swift] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:09.488204 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a1fe59f1-b7ca-47cf-afe0-3566f3ce19a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f25a7720c88941a8abb425bc60a55a44', 'request_id': 'req-a1fe59f1-b7ca-47cf-afe0-3566f3ce19a6'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:09.501947 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 859/1717] 10.222.0.79 () {60 vars in 1384 bytes} [Wed Aug 31 19:18:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 19:18:09.504252 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7cad17-3694-4c0a-b793-e753bcae619a service swift] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:09.509853 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ad7cad17-3694-4c0a-b793-e753bcae619a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:09.511720 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a1fe59f1-b7ca-47cf-afe0-3566f3ce19a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f25a7720c88941a8abb425bc60a55a44', 'request_id': 'req-a1fe59f1-b7ca-47cf-afe0-3566f3ce19a6'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:09.548085 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a1fe59f1-b7ca-47cf-afe0-3566f3ce19a6 admin admin] The token cache is being invalidate because project f25a7720c88941a8abb425bc60a55a44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:18:09.548667 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a1fe59f1-b7ca-47cf-afe0-3566f3ce19a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:09.553110 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a1fe59f1-b7ca-47cf-afe0-3566f3ce19a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:09.555872 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 859/1718] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:18:09 2022] DELETE /identity/v3/projects/f25a7720c88941a8abb425bc60a55a44 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:09.558314 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe59f1-b7ca-47cf-afe0-3566f3ce19a6 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:09.564720 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-a1fe59f1-b7ca-47cf-afe0-3566f3ce19a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:09.572786 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7cad17-3694-4c0a-b793-e753bcae619a service swift] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:09.711949 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe59f1-b7ca-47cf-afe0-3566f3ce19a6 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:09.735238 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee841fd-3511-4211-99a0-9c3c6ff972cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:09.736056 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee841fd-3511-4211-99a0-9c3c6ff972cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:09.736438 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee841fd-3511-4211-99a0-9c3c6ff972cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:09.736808 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee841fd-3511-4211-99a0-9c3c6ff972cc admin admin] PATH_INFO: `/v3/projects/30007d24212742869aa10b798d254e52` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:09.742727 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee841fd-3511-4211-99a0-9c3c6ff972cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=30007d24212742869aa10b798d254e52)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:09.744854 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee841fd-3511-4211-99a0-9c3c6ff972cc admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:09.853317 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-eee841fd-3511-4211-99a0-9c3c6ff972cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30007d24212742869aa10b798d254e52', 'request_id': 'req-eee841fd-3511-4211-99a0-9c3c6ff972cc'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:09.859275 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4abd8-5931-4ec3-b472-ada804fae2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:09.863580 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4abd8-5931-4ec3-b472-ada804fae2f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:09.866244 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4abd8-5931-4ec3-b472-ada804fae2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:09.866922 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4abd8-5931-4ec3-b472-ada804fae2f1 admin admin] PATH_INFO: `/v3/projects/c46de8e45b1048529995515d417c4be8` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:09.872975 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4abd8-5931-4ec3-b472-ada804fae2f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c46de8e45b1048529995515d417c4be8)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:09.874446 dv-cinder-852210-6-smb devstack@keystone.service[81683]: WARNING py.warnings [None req-8bc4abd8-5931-4ec3-b472-ada804fae2f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 19:18:09.874446 dv-cinder-852210-6-smb devstack@keystone.service[81683]: warnings.warn(msg) Aug 31 19:18:09.874446 dv-cinder-852210-6-smb devstack@keystone.service[81683]: Aug 31 19:18:09.875410 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-eee841fd-3511-4211-99a0-9c3c6ff972cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30007d24212742869aa10b798d254e52', 'request_id': 'req-eee841fd-3511-4211-99a0-9c3c6ff972cc'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:09.879588 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4abd8-5931-4ec3-b472-ada804fae2f1 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:09.902683 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-eee841fd-3511-4211-99a0-9c3c6ff972cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30007d24212742869aa10b798d254e52', 'request_id': 'req-eee841fd-3511-4211-99a0-9c3c6ff972cc'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:09.947846 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-eee841fd-3511-4211-99a0-9c3c6ff972cc admin admin] The token cache is being invalidate because project 30007d24212742869aa10b798d254e52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:18:09.948194 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-eee841fd-3511-4211-99a0-9c3c6ff972cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:09.949659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-eee841fd-3511-4211-99a0-9c3c6ff972cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:09.964445 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 860/1719] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:18:09 2022] DELETE /identity/v3/projects/30007d24212742869aa10b798d254e52 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:09.966271 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35c366-149b-4d3c-8d9e-e14ff239232c None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:09.966621 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35c366-149b-4d3c-8d9e-e14ff239232c None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:09.967867 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35c366-149b-4d3c-8d9e-e14ff239232c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:10.011582 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-8f35c366-149b-4d3c-8d9e-e14ff239232c None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:10.012865 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-8f35c366-149b-4d3c-8d9e-e14ff239232c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:10.037708 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:10.049014 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8bc4abd8-5931-4ec3-b472-ada804fae2f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c46de8e45b1048529995515d417c4be8', 'request_id': 'req-8bc4abd8-5931-4ec3-b472-ada804fae2f1'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:10.068775 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8bc4abd8-5931-4ec3-b472-ada804fae2f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c46de8e45b1048529995515d417c4be8', 'request_id': 'req-8bc4abd8-5931-4ec3-b472-ada804fae2f1'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:10.102795 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8bc4abd8-5931-4ec3-b472-ada804fae2f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c46de8e45b1048529995515d417c4be8', 'request_id': 'req-8bc4abd8-5931-4ec3-b472-ada804fae2f1'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:10.125445 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8bc4abd8-5931-4ec3-b472-ada804fae2f1 admin admin] The token cache is being invalidate because project c46de8e45b1048529995515d417c4be8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:18:10.125802 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8bc4abd8-5931-4ec3-b472-ada804fae2f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:10.126876 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8bc4abd8-5931-4ec3-b472-ada804fae2f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:10.131794 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 860/1720] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:18:09 2022] DELETE /identity/v3/projects/c46de8e45b1048529995515d417c4be8 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:10.136756 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb6999-67b8-4ec4-9ad1-d292cb278712 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:10.136756 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb6999-67b8-4ec4-9ad1-d292cb278712 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:10.137243 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb6999-67b8-4ec4-9ad1-d292cb278712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:10.171882 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 861/1721] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:10.171882 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0822bbc-01e9-4562-b475-a806f989e1b7 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:10.171882 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0822bbc-01e9-4562-b475-a806f989e1b7 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:10.171882 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0822bbc-01e9-4562-b475-a806f989e1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:10.210502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-d0822bbc-01e9-4562-b475-a806f989e1b7 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:10.219777 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-ffdb6999-67b8-4ec4-9ad1-d292cb278712 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:10.219976 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d0822bbc-01e9-4562-b475-a806f989e1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:10.222775 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ffdb6999-67b8-4ec4-9ad1-d292cb278712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:10.245714 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 862/1722] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:10.245931 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb0e5f-3c3c-4468-aec1-d45c48bd6d06 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:10.263439 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb0e5f-3c3c-4468-aec1-d45c48bd6d06 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:10.263439 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb0e5f-3c3c-4468-aec1-d45c48bd6d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:10.290694 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 861/1723] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:10.290694 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a150d6-9d2d-49d4-8101-06925c200c41 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:10.292047 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a150d6-9d2d-49d4-8101-06925c200c41 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:10.292047 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a150d6-9d2d-49d4-8101-06925c200c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:10.295530 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-20fb0e5f-3c3c-4468-aec1-d45c48bd6d06 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:10.296784 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-20fb0e5f-3c3c-4468-aec1-d45c48bd6d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:10.317396 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 863/1724] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:10.317396 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418988e-a0c8-4158-b07a-8f4ea80e24d8 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:10.317396 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418988e-a0c8-4158-b07a-8f4ea80e24d8 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:10.317396 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418988e-a0c8-4158-b07a-8f4ea80e24d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:10.359541 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-8418988e-a0c8-4158-b07a-8f4ea80e24d8 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:10.360381 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-e0a150d6-9d2d-49d4-8101-06925c200c41 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:10.360770 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-8418988e-a0c8-4158-b07a-8f4ea80e24d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:10.360928 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e0a150d6-9d2d-49d4-8101-06925c200c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:10.405596 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 862/1725] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:10.405596 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a150d6-9d2d-49d4-8101-06925c200c41 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:10.406636 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 864/1726] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:10.407702 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418988e-a0c8-4158-b07a-8f4ea80e24d8 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:10.434353 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418988e-a0c8-4158-b07a-8f4ea80e24d8 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:10.442839 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a150d6-9d2d-49d4-8101-06925c200c41 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:10.451182 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f157e3-0cc4-408f-a4ff-a62495614cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:10.451890 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f157e3-0cc4-408f-a4ff-a62495614cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:10.452157 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f157e3-0cc4-408f-a4ff-a62495614cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:10.452497 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f157e3-0cc4-408f-a4ff-a62495614cc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:10.453174 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f157e3-0cc4-408f-a4ff-a62495614cc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:18:10.453483 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f157e3-0cc4-408f-a4ff-a62495614cc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:10.454838 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fdddff-c771-4a43-b654-c679b049f15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:10.455258 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f157e3-0cc4-408f-a4ff-a62495614cc9 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:10.456076 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdddff-c771-4a43-b654-c679b049f15d admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:10.456661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdddff-c771-4a43-b654-c679b049f15d admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:10.457230 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdddff-c771-4a43-b654-c679b049f15d admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:10.458174 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fdddff-c771-4a43-b654-c679b049f15d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:18:10.458700 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fdddff-c771-4a43-b654-c679b049f15d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:10.460587 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fdddff-c771-4a43-b654-c679b049f15d admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:10.485988 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 863/1727] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:18:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:18:10.487401 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f157e3-0cc4-408f-a4ff-a62495614cc9 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:10.500475 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 865/1728] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:18:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:18:10.501668 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fdddff-c771-4a43-b654-c679b049f15d admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:10.521762 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f157e3-0cc4-408f-a4ff-a62495614cc9 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:10.533722 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fdddff-c771-4a43-b654-c679b049f15d admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:10.545963 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc22949-3e0d-4f3f-bf45-ef2277433bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:10.546859 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc22949-3e0d-4f3f-bf45-ef2277433bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:10.547330 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc22949-3e0d-4f3f-bf45-ef2277433bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:10.547789 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc22949-3e0d-4f3f-bf45-ef2277433bb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:10.548676 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc22949-3e0d-4f3f-bf45-ef2277433bb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:18:10.549168 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc22949-3e0d-4f3f-bf45-ef2277433bb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:10.551047 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc22949-3e0d-4f3f-bf45-ef2277433bb8 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:10.551156 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a54ba9-21e2-485e-b950-73e69ccf07d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:10.551721 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a54ba9-21e2-485e-b950-73e69ccf07d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:10.552003 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a54ba9-21e2-485e-b950-73e69ccf07d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:10.552276 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a54ba9-21e2-485e-b950-73e69ccf07d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:10.553051 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a54ba9-21e2-485e-b950-73e69ccf07d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:10.557765 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a54ba9-21e2-485e-b950-73e69ccf07d9 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:10.579109 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 864/1729] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:18:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:18:10.580210 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc22949-3e0d-4f3f-bf45-ef2277433bb8 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:10.617497 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc22949-3e0d-4f3f-bf45-ef2277433bb8 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:10.651536 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861059a-5f8e-4e0c-818f-04bbed63a837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:10.652231 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861059a-5f8e-4e0c-818f-04bbed63a837 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:10.652505 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861059a-5f8e-4e0c-818f-04bbed63a837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:10.656001 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861059a-5f8e-4e0c-818f-04bbed63a837 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:10.657005 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 866/1730] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:18:10 2022] POST /identity/v3/projects => generated 379 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:10.657533 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861059a-5f8e-4e0c-818f-04bbed63a837 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:10.657969 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a54ba9-21e2-485e-b950-73e69ccf07d9 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:10.661297 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861059a-5f8e-4e0c-818f-04bbed63a837 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:10.773317 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 865/1731] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:18:10 2022] POST /identity/v3/projects => generated 365 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:10.780009 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439f9a8-fc48-4b6d-b070-69543514276a None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:10.780514 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439f9a8-fc48-4b6d-b070-69543514276a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:10.780930 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439f9a8-fc48-4b6d-b070-69543514276a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:10.853866 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:10.888652 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-6439f9a8-fc48-4b6d-b070-69543514276a None None] MFA Rules not processed for user `d86e6d63aac348f08779d67ec479bd34`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:10.889799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6439f9a8-fc48-4b6d-b070-69543514276a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:10.952766 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a54ba9-21e2-485e-b950-73e69ccf07d9 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:11.126878 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 866/1732] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:10 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:11.133112 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439f9a8-fc48-4b6d-b070-69543514276a None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:11.137371 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031fb67-230e-4066-bf0b-62a838c3ca77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:11.138005 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031fb67-230e-4066-bf0b-62a838c3ca77 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:11.138285 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031fb67-230e-4066-bf0b-62a838c3ca77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:11.138581 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031fb67-230e-4066-bf0b-62a838c3ca77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:11.139285 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c031fb67-230e-4066-bf0b-62a838c3ca77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:11.141785 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c031fb67-230e-4066-bf0b-62a838c3ca77 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:11.162711 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:11.169292 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439f9a8-fc48-4b6d-b070-69543514276a None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:11.186796 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c83d14d-b6ba-429c-a2de-f145dc30c758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:11.187429 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83d14d-b6ba-429c-a2de-f145dc30c758 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:11.187703 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83d14d-b6ba-429c-a2de-f145dc30c758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:11.187973 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83d14d-b6ba-429c-a2de-f145dc30c758 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:11.188613 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c83d14d-b6ba-429c-a2de-f145dc30c758 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:11.191104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c83d14d-b6ba-429c-a2de-f145dc30c758 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:11.224334 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 867/1733] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:18:10 2022] POST /identity/v3/projects => generated 369 bytes in 567 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:11.229333 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd569d-1c6a-4bd2-bf27-9691f810360f None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:11.229620 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd569d-1c6a-4bd2-bf27-9691f810360f None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:11.231217 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd569d-1c6a-4bd2-bf27-9691f810360f None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:11.235721 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 868/1734] 10.222.0.79 () {54 vars in 912 bytes} [Wed Aug 31 19:18:11 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:18:11.243847 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd569d-1c6a-4bd2-bf27-9691f810360f None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:11.262025 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 867/1735] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:18:11 2022] POST /identity/v3/users => generated 290 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:11.264003 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c83d14d-b6ba-429c-a2de-f145dc30c758 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:11.297993 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c83d14d-b6ba-429c-a2de-f145dc30c758 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:11.429711 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd569d-1c6a-4bd2-bf27-9691f810360f None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:11.450668 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d84c4a-2a0f-4762-aa1f-5bfb494ec46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:11.451294 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d84c4a-2a0f-4762-aa1f-5bfb494ec46d admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:11.451574 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d84c4a-2a0f-4762-aa1f-5bfb494ec46d admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:11.451839 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d84c4a-2a0f-4762-aa1f-5bfb494ec46d admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:11.452648 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d84c4a-2a0f-4762-aa1f-5bfb494ec46d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:11.454766 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d84c4a-2a0f-4762-aa1f-5bfb494ec46d admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:11.504173 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 869/1736] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:18:11 2022] POST /identity/v3/users => generated 283 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:11.506599 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fb4fc-53ec-4718-a8fb-b522a991ee9d None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:11.512264 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fb4fc-53ec-4718-a8fb-b522a991ee9d None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:11.512761 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fb4fc-53ec-4718-a8fb-b522a991ee9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:11.516938 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1706b-1ffc-44c4-ad76-080c2f4102c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:11.518959 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1706b-1ffc-44c4-ad76-080c2f4102c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:11.521460 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1706b-1ffc-44c4-ad76-080c2f4102c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:11.521845 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1706b-1ffc-44c4-ad76-080c2f4102c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:11.523170 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1706b-1ffc-44c4-ad76-080c2f4102c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:11.544492 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1706b-1ffc-44c4-ad76-080c2f4102c9 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:11.571899 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-0d0fb4fc-53ec-4718-a8fb-b522a991ee9d None None] MFA Rules not processed for user `a91998a2818444a595adc06f1f481fe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:11.573376 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-0d0fb4fc-53ec-4718-a8fb-b522a991ee9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:11.610301 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 868/1737] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:18:11 2022] POST /identity/v3/users => generated 285 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:11.615800 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1706b-1ffc-44c4-ad76-080c2f4102c9 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:11.643762 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1706b-1ffc-44c4-ad76-080c2f4102c9 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:11.651182 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc50124-250b-41b3-8d98-f8fbef6ed33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:11.655272 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc50124-250b-41b3-8d98-f8fbef6ed33b admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:11.655962 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc50124-250b-41b3-8d98-f8fbef6ed33b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:11.658233 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc50124-250b-41b3-8d98-f8fbef6ed33b admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:11.660753 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc50124-250b-41b3-8d98-f8fbef6ed33b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:11.673975 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc50124-250b-41b3-8d98-f8fbef6ed33b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:11.731821 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 869/1738] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:11.735034 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc50124-250b-41b3-8d98-f8fbef6ed33b admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:11.739995 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 870/1739] 10.222.0.79 () {58 vars in 1009 bytes} [Wed Aug 31 19:18:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:11.741194 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0fb4fc-53ec-4718-a8fb-b522a991ee9d None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:11.784548 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc50124-250b-41b3-8d98-f8fbef6ed33b admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:11.791247 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0fb4fc-53ec-4718-a8fb-b522a991ee9d None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:11.800086 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67bf26-b723-42ac-a9f4-d35bf0a67917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:11.800929 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67bf26-b723-42ac-a9f4-d35bf0a67917 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:11.801636 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67bf26-b723-42ac-a9f4-d35bf0a67917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:11.801750 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2608905e-397b-4dbb-9d45-8c781bfd5d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:11.802170 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67bf26-b723-42ac-a9f4-d35bf0a67917 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:11.802371 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608905e-397b-4dbb-9d45-8c781bfd5d87 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:11.802695 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608905e-397b-4dbb-9d45-8c781bfd5d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:11.802965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608905e-397b-4dbb-9d45-8c781bfd5d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:11.803488 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d67bf26-b723-42ac-a9f4-d35bf0a67917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:11.803604 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2608905e-397b-4dbb-9d45-8c781bfd5d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:11.805187 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2608905e-397b-4dbb-9d45-8c781bfd5d87 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:11.823570 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d67bf26-b723-42ac-a9f4-d35bf0a67917 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:11.837847 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 871/1740] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:11.839020 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2608905e-397b-4dbb-9d45-8c781bfd5d87 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:11.866026 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2608905e-397b-4dbb-9d45-8c781bfd5d87 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:11.876873 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 870/1741] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:11.877832 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67bf26-b723-42ac-a9f4-d35bf0a67917 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:11.896900 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7688e9-20e0-4048-bc13-985da63c9998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:11.906747 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67bf26-b723-42ac-a9f4-d35bf0a67917 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:11.908438 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7688e9-20e0-4048-bc13-985da63c9998 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:11.921413 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7688e9-20e0-4048-bc13-985da63c9998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:11.921979 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7688e9-20e0-4048-bc13-985da63c9998 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:11.922948 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7688e9-20e0-4048-bc13-985da63c9998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:11.924780 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7688e9-20e0-4048-bc13-985da63c9998 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:11.930492 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98753b4-fa7f-4d60-a259-fd9178ac9cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:11.930492 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98753b4-fa7f-4d60-a259-fd9178ac9cfc admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:11.930492 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98753b4-fa7f-4d60-a259-fd9178ac9cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:11.930492 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98753b4-fa7f-4d60-a259-fd9178ac9cfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:11.930870 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98753b4-fa7f-4d60-a259-fd9178ac9cfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:11.930870 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98753b4-fa7f-4d60-a259-fd9178ac9cfc admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:11.954385 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 871/1742] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:11.955844 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98753b4-fa7f-4d60-a259-fd9178ac9cfc admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:11.978553 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 872/1743] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:11.981008 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7688e9-20e0-4048-bc13-985da63c9998 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:12.018171 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7688e9-20e0-4048-bc13-985da63c9998 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:12.024484 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952444f8-c158-4b53-bbc3-6a6811c36279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:12.025281 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952444f8-c158-4b53-bbc3-6a6811c36279 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:12.025630 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952444f8-c158-4b53-bbc3-6a6811c36279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:12.026041 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952444f8-c158-4b53-bbc3-6a6811c36279 admin admin] PATH_INFO: `/v3/projects/acc885ee83d34f68bcd8221b979c59b5/users/6180fd09a9c547a9b4e01b24706a0c10/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:12.041929 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98753b4-fa7f-4d60-a259-fd9178ac9cfc admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:12.073963 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749424e8-9996-4305-84a9-d16795dca2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:12.077629 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749424e8-9996-4305-84a9-d16795dca2be admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:12.079081 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749424e8-9996-4305-84a9-d16795dca2be admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:12.080429 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749424e8-9996-4305-84a9-d16795dca2be admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:12.085168 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749424e8-9996-4305-84a9-d16795dca2be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:12.093837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749424e8-9996-4305-84a9-d16795dca2be admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:12.114007 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952444f8-c158-4b53-bbc3-6a6811c36279 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acc885ee83d34f68bcd8221b979c59b5, user_id=6180fd09a9c547a9b4e01b24706a0c10, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:12.118068 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952444f8-c158-4b53-bbc3-6a6811c36279 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:12.149548 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 873/1744] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:11 2022] PUT /identity/v3/projects/acc885ee83d34f68bcd8221b979c59b5/users/6180fd09a9c547a9b4e01b24706a0c10/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:12.149548 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952444f8-c158-4b53-bbc3-6a6811c36279 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:12.214141 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 872/1745] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:12.215561 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e54d72-7084-4917-9b37-ec9f3100f4d7 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:12.215849 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e54d72-7084-4917-9b37-ec9f3100f4d7 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:12.216125 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e54d72-7084-4917-9b37-ec9f3100f4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:12.335926 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:12.361294 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952444f8-c158-4b53-bbc3-6a6811c36279 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:12.371377 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfafb9-b0f8-4865-97b3-6b99ad022112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:12.372410 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfafb9-b0f8-4865-97b3-6b99ad022112 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:12.372969 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfafb9-b0f8-4865-97b3-6b99ad022112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:12.373465 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfafb9-b0f8-4865-97b3-6b99ad022112 admin admin] PATH_INFO: `/v3/projects/5083f4b5f1b2498d8b64a0e3a9855ee4/users/8643604d508c4f35bba713c79dc119b1/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:12.422360 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debfafb9-b0f8-4865-97b3-6b99ad022112 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5083f4b5f1b2498d8b64a0e3a9855ee4, user_id=8643604d508c4f35bba713c79dc119b1, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:12.428553 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debfafb9-b0f8-4865-97b3-6b99ad022112 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:12.433233 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-39e54d72-7084-4917-9b37-ec9f3100f4d7 None None] MFA Rules not processed for user `6180fd09a9c547a9b4e01b24706a0c10`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:12.436536 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-39e54d72-7084-4917-9b37-ec9f3100f4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:12.495276 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 874/1746] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:12 2022] PUT /identity/v3/projects/5083f4b5f1b2498d8b64a0e3a9855ee4/users/8643604d508c4f35bba713c79dc119b1/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:12.496611 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfafb9-b0f8-4865-97b3-6b99ad022112 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:12.546663 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:12.662011 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfafb9-b0f8-4865-97b3-6b99ad022112 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:12.676455 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdedde2-083e-49bf-92f0-bcc9edeec9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:12.677505 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdedde2-083e-49bf-92f0-bcc9edeec9fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:12.677877 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdedde2-083e-49bf-92f0-bcc9edeec9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:12.678243 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdedde2-083e-49bf-92f0-bcc9edeec9fd admin admin] PATH_INFO: `/v3/projects/3beac8443bc74e889e35057b2f6fd650/users/92ea93cb79574b2a9301b645675cd79e/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:12.713236 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdedde2-083e-49bf-92f0-bcc9edeec9fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3beac8443bc74e889e35057b2f6fd650, user_id=92ea93cb79574b2a9301b645675cd79e, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:12.719033 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdedde2-083e-49bf-92f0-bcc9edeec9fd admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:12.745483 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 875/1747] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:12 2022] PUT /identity/v3/projects/3beac8443bc74e889e35057b2f6fd650/users/92ea93cb79574b2a9301b645675cd79e/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:12.747668 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e6f76-c3a9-4817-995d-94c966164d36 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:12.747963 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e6f76-c3a9-4817-995d-94c966164d36 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:12.748234 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e6f76-c3a9-4817-995d-94c966164d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:12.796700 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-ea6e6f76-c3a9-4817-995d-94c966164d36 None None] MFA Rules not processed for user `a91998a2818444a595adc06f1f481fe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:12.798153 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-ea6e6f76-c3a9-4817-995d-94c966164d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:12.828132 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 873/1748] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 613 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:12.829384 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e54d72-7084-4917-9b37-ec9f3100f4d7 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:12.842661 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-39e54d72-7084-4917-9b37-ec9f3100f4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:12.924257 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 876/1749] 10.222.0.91 () {58 vars in 1015 bytes} [Wed Aug 31 19:18:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:12.926502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b88a8-559d-4949-b6f0-fefce9da3239 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:12.927364 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b88a8-559d-4949-b6f0-fefce9da3239 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:12.927364 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b88a8-559d-4949-b6f0-fefce9da3239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:13.022568 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e54d72-7084-4917-9b37-ec9f3100f4d7 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:13.024419 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-1b9b88a8-559d-4949-b6f0-fefce9da3239 None None] MFA Rules not processed for user `8643604d508c4f35bba713c79dc119b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:13.025807 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1b9b88a8-559d-4949-b6f0-fefce9da3239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:13.029396 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e1f011-5dd6-45c0-80a3-a8e76e798900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:13.030038 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1f011-5dd6-45c0-80a3-a8e76e798900 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:13.030382 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1f011-5dd6-45c0-80a3-a8e76e798900 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:13.030619 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1f011-5dd6-45c0-80a3-a8e76e798900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:13.051183 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e1f011-5dd6-45c0-80a3-a8e76e798900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:13.053303 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e1f011-5dd6-45c0-80a3-a8e76e798900 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:13.073585 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 874/1750] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:13.082604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5ba9b-b293-4d2e-ae27-10de7e1d815c None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:13.082893 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5ba9b-b293-4d2e-ae27-10de7e1d815c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:13.083174 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5ba9b-b293-4d2e-ae27-10de7e1d815c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:13.133458 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:13.183204 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 877/1751] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:13.183392 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-18e5ba9b-b293-4d2e-ae27-10de7e1d815c None None] MFA Rules not processed for user `92ea93cb79574b2a9301b645675cd79e`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:13.183551 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b88a8-559d-4949-b6f0-fefce9da3239 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:13.187271 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-18e5ba9b-b293-4d2e-ae27-10de7e1d815c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:13.370370 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 875/1752] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:13.372988 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5ba9b-b293-4d2e-ae27-10de7e1d815c None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:13.386369 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b88a8-559d-4949-b6f0-fefce9da3239 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:13.398269 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2741bb3-01d8-43fb-be9f-97f123c24100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:13.398948 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2741bb3-01d8-43fb-be9f-97f123c24100 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:13.399237 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2741bb3-01d8-43fb-be9f-97f123c24100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:13.399511 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2741bb3-01d8-43fb-be9f-97f123c24100 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:13.400163 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2741bb3-01d8-43fb-be9f-97f123c24100 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:13.402931 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5ba9b-b293-4d2e-ae27-10de7e1d815c None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:13.408416 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2741bb3-01d8-43fb-be9f-97f123c24100 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:13.416239 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec77ff5-4a08-4436-bb1e-1ea7211ff3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:13.418679 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec77ff5-4a08-4436-bb1e-1ea7211ff3c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:13.419207 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec77ff5-4a08-4436-bb1e-1ea7211ff3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:13.431238 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec77ff5-4a08-4436-bb1e-1ea7211ff3c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:13.432282 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec77ff5-4a08-4436-bb1e-1ea7211ff3c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:13.439688 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec77ff5-4a08-4436-bb1e-1ea7211ff3c3 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:13.491088 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 878/1753] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:18:13 2022] POST /identity/v3/projects => generated 369 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:13.496524 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2741bb3-01d8-43fb-be9f-97f123c24100 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:13.518021 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 876/1754] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:18:13 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:13.519752 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec77ff5-4a08-4436-bb1e-1ea7211ff3c3 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:13.559907 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:13.667153 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec77ff5-4a08-4436-bb1e-1ea7211ff3c3 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:13.682477 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2741bb3-01d8-43fb-be9f-97f123c24100 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:13.684508 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e36a0b-ea61-44eb-b3b4-495407576bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:13.685489 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e36a0b-ea61-44eb-b3b4-495407576bb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:13.685938 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e36a0b-ea61-44eb-b3b4-495407576bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:13.686348 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e36a0b-ea61-44eb-b3b4-495407576bb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:13.687188 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e36a0b-ea61-44eb-b3b4-495407576bb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:13.688802 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d7941-ee31-490c-82dd-eef8653d2a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:13.690389 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d7941-ee31-490c-82dd-eef8653d2a2f admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:13.690875 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d7941-ee31-490c-82dd-eef8653d2a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:13.691231 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d7941-ee31-490c-82dd-eef8653d2a2f admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:13.692541 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d7941-ee31-490c-82dd-eef8653d2a2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:13.694723 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d7941-ee31-490c-82dd-eef8653d2a2f admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:13.696203 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e36a0b-ea61-44eb-b3b4-495407576bb9 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:13.755018 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 879/1755] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:18:13 2022] POST /identity/v3/projects => generated 365 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:13.755018 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d7941-ee31-490c-82dd-eef8653d2a2f admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:13.755616 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 877/1756] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:18:13 2022] POST /identity/v3/users => generated 291 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:13.756470 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e36a0b-ea61-44eb-b3b4-495407576bb9 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:13.875232 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e36a0b-ea61-44eb-b3b4-495407576bb9 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:13.879956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:13.896086 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d7941-ee31-490c-82dd-eef8653d2a2f admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:13.911763 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b0632-d46a-49ea-bee5-a6ec0cc7d65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:13.912915 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b0632-d46a-49ea-bee5-a6ec0cc7d65b admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:13.913469 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b0632-d46a-49ea-bee5-a6ec0cc7d65b admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:13.913979 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b0632-d46a-49ea-bee5-a6ec0cc7d65b admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:13.914892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b0632-d46a-49ea-bee5-a6ec0cc7d65b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:13.920770 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b0632-d46a-49ea-bee5-a6ec0cc7d65b admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:13.971404 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7339255-0bab-47a3-a40c-eed5553ec9cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:13.973292 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7339255-0bab-47a3-a40c-eed5553ec9cb service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:13.973593 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7339255-0bab-47a3-a40c-eed5553ec9cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:13.973985 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7339255-0bab-47a3-a40c-eed5553ec9cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:13.987848 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7339255-0bab-47a3-a40c-eed5553ec9cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:13.989607 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7339255-0bab-47a3-a40c-eed5553ec9cb service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:14.002679 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 878/1757] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:14.002679 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7339255-0bab-47a3-a40c-eed5553ec9cb service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:14.004741 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 880/1758] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:18:13 2022] POST /identity/v3/users => generated 295 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:14.011356 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b0632-d46a-49ea-bee5-a6ec0cc7d65b admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:14.013302 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7339255-0bab-47a3-a40c-eed5553ec9cb service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:14.017881 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e37cd-8bb7-4fc2-ab29-271a69997c13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:14.018548 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e37cd-8bb7-4fc2-ab29-271a69997c13 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:14.019330 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e37cd-8bb7-4fc2-ab29-271a69997c13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:14.019330 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e37cd-8bb7-4fc2-ab29-271a69997c13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:14.028833 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e37cd-8bb7-4fc2-ab29-271a69997c13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:14.030290 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e37cd-8bb7-4fc2-ab29-271a69997c13 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:14.044524 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b0632-d46a-49ea-bee5-a6ec0cc7d65b admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:14.060499 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 879/1759] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:14.061374 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98caedb0-e357-4d10-be90-426a90fbacae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:14.061510 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e37cd-8bb7-4fc2-ab29-271a69997c13 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:14.062326 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98caedb0-e357-4d10-be90-426a90fbacae admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:14.062874 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98caedb0-e357-4d10-be90-426a90fbacae admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:14.063948 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98caedb0-e357-4d10-be90-426a90fbacae admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:14.068749 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98caedb0-e357-4d10-be90-426a90fbacae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:14.071543 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98caedb0-e357-4d10-be90-426a90fbacae admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:14.086723 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e37cd-8bb7-4fc2-ab29-271a69997c13 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:14.093403 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8cc04-8530-4c49-b982-6a274d3ef311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:14.093953 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8cc04-8530-4c49-b982-6a274d3ef311 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:14.094237 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8cc04-8530-4c49-b982-6a274d3ef311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:14.094652 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8cc04-8530-4c49-b982-6a274d3ef311 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:14.095319 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add8cc04-8530-4c49-b982-6a274d3ef311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:14.097960 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add8cc04-8530-4c49-b982-6a274d3ef311 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:14.118351 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 880/1760] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:14.119389 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8cc04-8530-4c49-b982-6a274d3ef311 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:14.134393 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8cc04-8530-4c49-b982-6a274d3ef311 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:14.136364 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 881/1761] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:18:14 2022] POST /identity/v3/users => generated 289 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:14.137490 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98caedb0-e357-4d10-be90-426a90fbacae admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:14.140527 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b9337-5fbc-449c-82b5-9a4eefe5d49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:14.141207 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b9337-5fbc-449c-82b5-9a4eefe5d49a admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:14.141493 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b9337-5fbc-449c-82b5-9a4eefe5d49a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:14.141768 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b9337-5fbc-449c-82b5-9a4eefe5d49a admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:14.142425 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b9337-5fbc-449c-82b5-9a4eefe5d49a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:14.144998 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b9337-5fbc-449c-82b5-9a4eefe5d49a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:14.150735 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98caedb0-e357-4d10-be90-426a90fbacae admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:14.164993 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 881/1762] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:14.164993 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b9337-5fbc-449c-82b5-9a4eefe5d49a admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:14.167428 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3dcd5f-e60b-4ed4-9cf0-d3070face72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:14.168346 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3dcd5f-e60b-4ed4-9cf0-d3070face72c admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:14.168838 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3dcd5f-e60b-4ed4-9cf0-d3070face72c admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:14.169346 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3dcd5f-e60b-4ed4-9cf0-d3070face72c admin admin] PATH_INFO: `/v3/projects/838f71ebc97f4966bd646486c327020f/users/470c2aa6f2aa4d899c3e7ac7ea2760aa/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:14.189626 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b9337-5fbc-449c-82b5-9a4eefe5d49a admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:14.196915 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fc558-bcc0-43bc-a099-846e0c1489b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:14.197465 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fc558-bcc0-43bc-a099-846e0c1489b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:14.197751 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fc558-bcc0-43bc-a099-846e0c1489b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:14.198065 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fc558-bcc0-43bc-a099-846e0c1489b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:14.198707 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39fc558-bcc0-43bc-a099-846e0c1489b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:14.200371 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39fc558-bcc0-43bc-a099-846e0c1489b3 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:14.207098 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3dcd5f-e60b-4ed4-9cf0-d3070face72c admin admin] RBAC: Authorizing `identity:create_grant(project_id=838f71ebc97f4966bd646486c327020f, user_id=470c2aa6f2aa4d899c3e7ac7ea2760aa, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:14.210800 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3dcd5f-e60b-4ed4-9cf0-d3070face72c admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:14.218863 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 882/1763] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:14.219778 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fc558-bcc0-43bc-a099-846e0c1489b3 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:14.235666 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fc558-bcc0-43bc-a099-846e0c1489b3 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:14.251539 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 882/1764] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:14 2022] PUT /identity/v3/projects/838f71ebc97f4966bd646486c327020f/users/470c2aa6f2aa4d899c3e7ac7ea2760aa/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:14.252988 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3dcd5f-e60b-4ed4-9cf0-d3070face72c admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:14.289647 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:14.340977 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aabb77f-7bde-4b17-969c-1924b3c1ff66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:14.341656 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aabb77f-7bde-4b17-969c-1924b3c1ff66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:14.341936 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aabb77f-7bde-4b17-969c-1924b3c1ff66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:14.342210 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aabb77f-7bde-4b17-969c-1924b3c1ff66 admin admin] PATH_INFO: `/v3/projects/9b2b89af0976439aa1335aaf06fdf571/users/6108af0472744b9396258d75830e4c44/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:14.363914 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aabb77f-7bde-4b17-969c-1924b3c1ff66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b2b89af0976439aa1335aaf06fdf571, user_id=6108af0472744b9396258d75830e4c44, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:14.366969 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aabb77f-7bde-4b17-969c-1924b3c1ff66 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:14.390966 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3dcd5f-e60b-4ed4-9cf0-d3070face72c admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:14.406095 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 883/1765] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:14 2022] PUT /identity/v3/projects/9b2b89af0976439aa1335aaf06fdf571/users/6108af0472744b9396258d75830e4c44/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:14.407442 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aabb77f-7bde-4b17-969c-1924b3c1ff66 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:14.474371 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42597386-3c48-4ee7-b333-dda24b120b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:14.475188 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42597386-3c48-4ee7-b333-dda24b120b5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:14.475574 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42597386-3c48-4ee7-b333-dda24b120b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:14.475952 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42597386-3c48-4ee7-b333-dda24b120b5a admin admin] PATH_INFO: `/v3/projects/cc03f8c7634843a681558a9223d133d9/users/8781da97d51942028cfaed5d2d7c5205/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:14.498838 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42597386-3c48-4ee7-b333-dda24b120b5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc03f8c7634843a681558a9223d133d9, user_id=8781da97d51942028cfaed5d2d7c5205, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:14.504726 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42597386-3c48-4ee7-b333-dda24b120b5a admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:14.551765 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 883/1766] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:14 2022] PUT /identity/v3/projects/cc03f8c7634843a681558a9223d133d9/users/8781da97d51942028cfaed5d2d7c5205/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:14.555808 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42597386-3c48-4ee7-b333-dda24b120b5a admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:14.640968 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:14.644825 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aabb77f-7bde-4b17-969c-1924b3c1ff66 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:14.715537 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42597386-3c48-4ee7-b333-dda24b120b5a admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:14.751591 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d051e16-190e-459b-aace-f764efae6813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:14.752380 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d051e16-190e-459b-aace-f764efae6813 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:14.758786 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d051e16-190e-459b-aace-f764efae6813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:14.759123 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d051e16-190e-459b-aace-f764efae6813 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:14.762266 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d051e16-190e-459b-aace-f764efae6813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:14.774408 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d051e16-190e-459b-aace-f764efae6813 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:14.831420 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 884/1767] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:14.839644 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d051e16-190e-459b-aace-f764efae6813 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:14.895695 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d051e16-190e-459b-aace-f764efae6813 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:14.916242 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716db8f3-3e30-42e6-8b24-667d612bea33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:14.918630 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716db8f3-3e30-42e6-8b24-667d612bea33 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:14.918630 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716db8f3-3e30-42e6-8b24-667d612bea33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:14.921953 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716db8f3-3e30-42e6-8b24-667d612bea33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:14.925629 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716db8f3-3e30-42e6-8b24-667d612bea33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:14.928015 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716db8f3-3e30-42e6-8b24-667d612bea33 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:14.936860 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5403a-31db-4215-b216-fd3b96a730cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:14.939628 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5403a-31db-4215-b216-fd3b96a730cc admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:14.939977 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5403a-31db-4215-b216-fd3b96a730cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:14.940216 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5403a-31db-4215-b216-fd3b96a730cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:14.941486 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5403a-31db-4215-b216-fd3b96a730cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:14.952728 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5403a-31db-4215-b216-fd3b96a730cc admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:14.982892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 885/1768] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:14.983864 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716db8f3-3e30-42e6-8b24-667d612bea33 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:15.007169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 884/1769] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 600 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:15.008134 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5403a-31db-4215-b216-fd3b96a730cc admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:15.045494 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716db8f3-3e30-42e6-8b24-667d612bea33 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:15.063866 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d345c-5895-4a52-9dd4-2fd66cd8fced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:15.064415 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5403a-31db-4215-b216-fd3b96a730cc admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:15.068214 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d345c-5895-4a52-9dd4-2fd66cd8fced admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:15.070871 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d345c-5895-4a52-9dd4-2fd66cd8fced admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:15.071312 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d345c-5895-4a52-9dd4-2fd66cd8fced admin admin] PATH_INFO: `/v3/projects/9b2b89af0976439aa1335aaf06fdf571/users/6108af0472744b9396258d75830e4c44/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:15.084855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d345c-5895-4a52-9dd4-2fd66cd8fced admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b2b89af0976439aa1335aaf06fdf571, user_id=6108af0472744b9396258d75830e4c44, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:15.091127 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb5cb9-5b80-4435-8090-58fe83dddd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:15.094900 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb5cb9-5b80-4435-8090-58fe83dddd85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:15.095405 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb5cb9-5b80-4435-8090-58fe83dddd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:15.096306 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d345c-5895-4a52-9dd4-2fd66cd8fced admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:15.096765 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb5cb9-5b80-4435-8090-58fe83dddd85 admin admin] PATH_INFO: `/v3/projects/cc03f8c7634843a681558a9223d133d9/users/8781da97d51942028cfaed5d2d7c5205/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:15.111607 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb5cb9-5b80-4435-8090-58fe83dddd85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc03f8c7634843a681558a9223d133d9, user_id=8781da97d51942028cfaed5d2d7c5205, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:15.127510 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb5cb9-5b80-4435-8090-58fe83dddd85 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:15.170065 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 886/1770] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:14 2022] PUT /identity/v3/projects/9b2b89af0976439aa1335aaf06fdf571/users/6108af0472744b9396258d75830e4c44/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:15.170065 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d345c-5895-4a52-9dd4-2fd66cd8fced admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:15.175813 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 885/1771] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:15 2022] PUT /identity/v3/projects/cc03f8c7634843a681558a9223d133d9/users/8781da97d51942028cfaed5d2d7c5205/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:15.177442 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3f77e-c991-4b0e-a7ae-e7cd5c914da1 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:15.177738 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3f77e-c991-4b0e-a7ae-e7cd5c914da1 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:15.178076 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3f77e-c991-4b0e-a7ae-e7cd5c914da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:15.270304 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-c6f3f77e-c991-4b0e-a7ae-e7cd5c914da1 None None] MFA Rules not processed for user `6108af0472744b9396258d75830e4c44`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:15.280813 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c6f3f77e-c991-4b0e-a7ae-e7cd5c914da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:15.378489 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d345c-5895-4a52-9dd4-2fd66cd8fced admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:15.385723 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:15.591475 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 886/1772] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:15.592965 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc5448-1981-4087-9358-38db4e005353 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:15.593143 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc5448-1981-4087-9358-38db4e005353 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:15.593472 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc5448-1981-4087-9358-38db4e005353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:15.677115 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2167bbea-9454-4938-9565-7a18e4854b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:15.677923 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167bbea-9454-4938-9565-7a18e4854b66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:15.678203 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167bbea-9454-4938-9565-7a18e4854b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:15.678570 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167bbea-9454-4938-9565-7a18e4854b66 admin admin] PATH_INFO: `/v3/projects/838f71ebc97f4966bd646486c327020f/users/470c2aa6f2aa4d899c3e7ac7ea2760aa/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:15.683419 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2167bbea-9454-4938-9565-7a18e4854b66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=838f71ebc97f4966bd646486c327020f, user_id=470c2aa6f2aa4d899c3e7ac7ea2760aa, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:15.686437 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2167bbea-9454-4938-9565-7a18e4854b66 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:15.730150 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-25cc5448-1981-4087-9358-38db4e005353 None None] MFA Rules not processed for user `8781da97d51942028cfaed5d2d7c5205`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:15.735970 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-25cc5448-1981-4087-9358-38db4e005353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:15.745590 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 887/1773] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:15 2022] PUT /identity/v3/projects/838f71ebc97f4966bd646486c327020f/users/470c2aa6f2aa4d899c3e7ac7ea2760aa/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:15.747002 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d35140-d708-4c70-9164-c6344487a52d None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:15.755388 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d35140-d708-4c70-9164-c6344487a52d None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:15.755693 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d35140-d708-4c70-9164-c6344487a52d None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:15.757343 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 888/1774] 10.222.0.79 () {54 vars in 921 bytes} [Wed Aug 31 19:18:15 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:18:15.758031 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d35140-d708-4c70-9164-c6344487a52d None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:15.765576 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-49d35140-d708-4c70-9164-c6344487a52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:16.015485 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:16.031851 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d35140-d708-4c70-9164-c6344487a52d None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:16.036234 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed1406-5506-4378-ae28-14b931fdda67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:16.037168 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed1406-5506-4378-ae28-14b931fdda67 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:16.037168 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed1406-5506-4378-ae28-14b931fdda67 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:16.037598 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed1406-5506-4378-ae28-14b931fdda67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:16.039940 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 887/1775] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:15 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:16.064493 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2c5a0-1d77-4cfc-90c3-d891203e4f9e None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:16.064923 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2c5a0-1d77-4cfc-90c3-d891203e4f9e None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:16.065213 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2c5a0-1d77-4cfc-90c3-d891203e4f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:16.142743 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-d8c2c5a0-1d77-4cfc-90c3-d891203e4f9e None None] MFA Rules not processed for user `470c2aa6f2aa4d899c3e7ac7ea2760aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:16.144235 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d8c2c5a0-1d77-4cfc-90c3-d891203e4f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:16.225912 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed1406-5506-4378-ae28-14b931fdda67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:16.227427 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed1406-5506-4378-ae28-14b931fdda67 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:16.250491 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 889/1776] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:16.251907 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c957a-f4d9-4b15-9a33-e6f7832d343d None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:16.252198 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c957a-f4d9-4b15-9a33-e6f7832d343d None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:16.252474 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c957a-f4d9-4b15-9a33-e6f7832d343d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:16.283644 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-5c4c957a-f4d9-4b15-9a33-e6f7832d343d None None] MFA Rules not processed for user `ece00ea631594381bf1c27cfc2ece6f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:16.286602 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-5c4c957a-f4d9-4b15-9a33-e6f7832d343d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:16.317002 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 888/1777] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:16 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:16.321863 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2c5a0-1d77-4cfc-90c3-d891203e4f9e None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:16.326280 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d8c2c5a0-1d77-4cfc-90c3-d891203e4f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:16.352138 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2c5a0-1d77-4cfc-90c3-d891203e4f9e None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:16.367880 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb85be-2798-43a6-85bc-22ee070b3640 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:16.371740 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb85be-2798-43a6-85bc-22ee070b3640 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:16.372683 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb85be-2798-43a6-85bc-22ee070b3640 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:16.376008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb85be-2798-43a6-85bc-22ee070b3640 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:16.413368 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb85be-2798-43a6-85bc-22ee070b3640 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:16.417326 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb85be-2798-43a6-85bc-22ee070b3640 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:16.452341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 890/1778] 10.222.0.79 () {58 vars in 1018 bytes} [Wed Aug 31 19:18:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:16.485343 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c957a-f4d9-4b15-9a33-e6f7832d343d None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:16.487011 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-5c4c957a-f4d9-4b15-9a33-e6f7832d343d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:16.491274 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 889/1779] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:16 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:16.541838 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c957a-f4d9-4b15-9a33-e6f7832d343d None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:16.569383 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730dd16e-9011-401d-b253-d2d6d88f6e1a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece00ea631594381bf1c27cfc2ece6f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:16.570105 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730dd16e-9011-401d-b253-d2d6d88f6e1a service placement] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:16.570385 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730dd16e-9011-401d-b253-d2d6d88f6e1a service placement] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:16.573999 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730dd16e-9011-401d-b253-d2d6d88f6e1a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:16.604906 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730dd16e-9011-401d-b253-d2d6d88f6e1a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:16.611290 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730dd16e-9011-401d-b253-d2d6d88f6e1a service placement] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:16.641692 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 891/1780] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:18:16.839253 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb85be-2798-43a6-85bc-22ee070b3640 service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:16.859239 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb85be-2798-43a6-85bc-22ee070b3640 service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:16.865981 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf9026-1c0d-4d83-affc-c61213344e17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:16.867341 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf9026-1c0d-4d83-affc-c61213344e17 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:16.867923 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf9026-1c0d-4d83-affc-c61213344e17 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:16.868492 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf9026-1c0d-4d83-affc-c61213344e17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:16.886949 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf9026-1c0d-4d83-affc-c61213344e17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:16.890023 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf9026-1c0d-4d83-affc-c61213344e17 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:16.920631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 890/1781] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:16 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:18.024063 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730dd16e-9011-401d-b253-d2d6d88f6e1a service placement] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:18.057965 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d25ec-9298-4f1a-a54a-0cc44eb6f2a1 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:18.058488 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d25ec-9298-4f1a-a54a-0cc44eb6f2a1 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:18.058664 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d25ec-9298-4f1a-a54a-0cc44eb6f2a1 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:18.060545 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 891/1782] 10.222.0.79 () {54 vars in 921 bytes} [Wed Aug 31 19:18:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:18:18.094739 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef58b51-6938-464e-90cb-dbcc50760d25 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:18.095206 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef58b51-6938-464e-90cb-dbcc50760d25 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:18.095978 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef58b51-6938-464e-90cb-dbcc50760d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:18.127871 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:18.132435 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730dd16e-9011-401d-b253-d2d6d88f6e1a service placement] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:18.138324 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a165f-c8fc-4c4d-9f19-65202924f070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:18.139089 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a165f-c8fc-4c4d-9f19-65202924f070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:18.139562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a165f-c8fc-4c4d-9f19-65202924f070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:18.140290 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a165f-c8fc-4c4d-9f19-65202924f070 admin admin] PATH_INFO: `/v3/users/92ea93cb79574b2a9301b645675cd79e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:18.141497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8a165f-c8fc-4c4d-9f19-65202924f070 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92ea93cb79574b2a9301b645675cd79e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:18.144295 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8a165f-c8fc-4c4d-9f19-65202924f070 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:18.145733 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-eef58b51-6938-464e-90cb-dbcc50760d25 None None] MFA Rules not processed for user `1fd6d45d1bc3479da72cb1a1990a6137`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:18.158256 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-eef58b51-6938-464e-90cb-dbcc50760d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:18.199784 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:18.259723 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6c8a165f-c8fc-4c4d-9f19-65202924f070 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92ea93cb79574b2a9301b645675cd79e'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:18.260546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6c8a165f-c8fc-4c4d-9f19-65202924f070 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92ea93cb79574b2a9301b645675cd79e'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:18.314385 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6c8a165f-c8fc-4c4d-9f19-65202924f070 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92ea93cb79574b2a9301b645675cd79e'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:18.335026 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6c8a165f-c8fc-4c4d-9f19-65202924f070 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92ea93cb79574b2a9301b645675cd79e'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:18.357454 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6c8a165f-c8fc-4c4d-9f19-65202924f070 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92ea93cb79574b2a9301b645675cd79e'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:18.373895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 892/1783] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:18:18 2022] DELETE /identity/v3/users/92ea93cb79574b2a9301b645675cd79e => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:18.375147 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a165f-c8fc-4c4d-9f19-65202924f070 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:18.377115 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-6c8a165f-c8fc-4c4d-9f19-65202924f070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:18.424097 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 892/1784] 10.222.0.79 () {58 vars in 1018 bytes} [Wed Aug 31 19:18:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:18.425866 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef58b51-6938-464e-90cb-dbcc50760d25 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:18.434551 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-eef58b51-6938-464e-90cb-dbcc50760d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:18.459974 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef58b51-6938-464e-90cb-dbcc50760d25 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:18.580335 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a165f-c8fc-4c4d-9f19-65202924f070 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:18.587915 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd8893-755c-41f7-9e47-6d5785b300a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:18.589051 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd8893-755c-41f7-9e47-6d5785b300a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:18.589738 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd8893-755c-41f7-9e47-6d5785b300a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:18.590280 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd8893-755c-41f7-9e47-6d5785b300a3 admin admin] PATH_INFO: `/v3/users/19ae0ec3fdf4400da7db58d99a6937a9` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:18.592360 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fd8893-755c-41f7-9e47-6d5785b300a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19ae0ec3fdf4400da7db58d99a6937a9)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:18.596447 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8630647b-84d6-407f-9094-9a2c27a7669f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:18.597525 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fd8893-755c-41f7-9e47-6d5785b300a3 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:18.599531 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630647b-84d6-407f-9094-9a2c27a7669f service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:18.599851 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630647b-84d6-407f-9094-9a2c27a7669f service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:18.600123 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630647b-84d6-407f-9094-9a2c27a7669f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:18.604433 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8630647b-84d6-407f-9094-9a2c27a7669f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:18.693498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-f8fd8893-755c-41f7-9e47-6d5785b300a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19ae0ec3fdf4400da7db58d99a6937a9'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:18.694429 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-f8fd8893-755c-41f7-9e47-6d5785b300a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19ae0ec3fdf4400da7db58d99a6937a9'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:18.738469 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-f8fd8893-755c-41f7-9e47-6d5785b300a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19ae0ec3fdf4400da7db58d99a6937a9'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:18.775475 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8630647b-84d6-407f-9094-9a2c27a7669f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:18.779183 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8630647b-84d6-407f-9094-9a2c27a7669f service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:18.781957 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-f8fd8893-755c-41f7-9e47-6d5785b300a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19ae0ec3fdf4400da7db58d99a6937a9'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:18.795357 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 893/1785] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:18.804701 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-f8fd8893-755c-41f7-9e47-6d5785b300a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19ae0ec3fdf4400da7db58d99a6937a9'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:18.812910 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e66a88-7f49-472a-be15-383f58543534 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:18.814900 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e66a88-7f49-472a-be15-383f58543534 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:18.815563 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e66a88-7f49-472a-be15-383f58543534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:18.828248 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 893/1786] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:18:18 2022] DELETE /identity/v3/users/19ae0ec3fdf4400da7db58d99a6937a9 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:18.834805 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd8893-755c-41f7-9e47-6d5785b300a3 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:18.838926 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f8fd8893-755c-41f7-9e47-6d5785b300a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:18.870314 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-c3e66a88-7f49-472a-be15-383f58543534 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:18.872527 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c3e66a88-7f49-472a-be15-383f58543534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:18.942349 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:19.064688 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:19.146023 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd8893-755c-41f7-9e47-6d5785b300a3 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:19.158013 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 894/1787] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:19.168794 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7f5d0-6da6-45d1-8b13-089b9a81da30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:19.169498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7f5d0-6da6-45d1-8b13-089b9a81da30 service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:19.169886 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7f5d0-6da6-45d1-8b13-089b9a81da30 service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:19.170223 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7f5d0-6da6-45d1-8b13-089b9a81da30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:19.175946 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-97b7f5d0-6da6-45d1-8b13-089b9a81da30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:19.197208 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7f5d0-6da6-45d1-8b13-089b9a81da30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:19.200851 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7f5d0-6da6-45d1-8b13-089b9a81da30 service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:19.240379 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 894/1788] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:19.246034 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e66a88-7f49-472a-be15-383f58543534 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:19.248550 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c3e66a88-7f49-472a-be15-383f58543534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:19.440988 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e66a88-7f49-472a-be15-383f58543534 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:19.456379 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463aba8-8825-4c2d-be9c-c8f29af006a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:19.457813 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463aba8-8825-4c2d-be9c-c8f29af006a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:19.460323 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463aba8-8825-4c2d-be9c-c8f29af006a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:19.461454 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463aba8-8825-4c2d-be9c-c8f29af006a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:19.520878 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463aba8-8825-4c2d-be9c-c8f29af006a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:19.527158 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463aba8-8825-4c2d-be9c-c8f29af006a0 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:19.611148 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 895/1789] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:20.293981 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7f5d0-6da6-45d1-8b13-089b9a81da30 service nova] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:20.300107 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-97b7f5d0-6da6-45d1-8b13-089b9a81da30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:20.390214 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7f5d0-6da6-45d1-8b13-089b9a81da30 service nova] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:20.416080 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505178c-a9e8-4c34-b093-1d989a27864b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:20.419344 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505178c-a9e8-4c34-b093-1d989a27864b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:20.419645 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505178c-a9e8-4c34-b093-1d989a27864b admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:20.419921 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505178c-a9e8-4c34-b093-1d989a27864b admin admin] PATH_INFO: `/v3/projects/63fa6e8a0fac4baea9edaa53f44bb659` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:20.427319 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c505178c-a9e8-4c34-b093-1d989a27864b admin admin] RBAC: Authorizing `identity:delete_project(project_id=63fa6e8a0fac4baea9edaa53f44bb659)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:20.429276 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c505178c-a9e8-4c34-b093-1d989a27864b admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:20.592478 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-c505178c-a9e8-4c34-b093-1d989a27864b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63fa6e8a0fac4baea9edaa53f44bb659', 'request_id': 'req-c505178c-a9e8-4c34-b093-1d989a27864b'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:20.619116 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-c505178c-a9e8-4c34-b093-1d989a27864b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63fa6e8a0fac4baea9edaa53f44bb659', 'request_id': 'req-c505178c-a9e8-4c34-b093-1d989a27864b'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:20.632970 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-c505178c-a9e8-4c34-b093-1d989a27864b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63fa6e8a0fac4baea9edaa53f44bb659', 'request_id': 'req-c505178c-a9e8-4c34-b093-1d989a27864b'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:20.674556 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-c505178c-a9e8-4c34-b093-1d989a27864b admin admin] The token cache is being invalidate because project 63fa6e8a0fac4baea9edaa53f44bb659 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:18:20.675350 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-c505178c-a9e8-4c34-b093-1d989a27864b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:20.684477 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-c505178c-a9e8-4c34-b093-1d989a27864b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:20.688266 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 895/1790] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:18:20 2022] DELETE /identity/v3/projects/63fa6e8a0fac4baea9edaa53f44bb659 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:20.692717 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463aba8-8825-4c2d-be9c-c8f29af006a0 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:20.728924 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463aba8-8825-4c2d-be9c-c8f29af006a0 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:20.927101 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38bddd-72d0-491d-a824-99c79d216808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:20.927768 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38bddd-72d0-491d-a824-99c79d216808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:20.928052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38bddd-72d0-491d-a824-99c79d216808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:20.928322 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38bddd-72d0-491d-a824-99c79d216808 admin admin] PATH_INFO: `/v3/users/d86e6d63aac348f08779d67ec479bd34` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:20.933072 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38bddd-72d0-491d-a824-99c79d216808 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d86e6d63aac348f08779d67ec479bd34)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:20.938127 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38bddd-72d0-491d-a824-99c79d216808 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:21.093763 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4d38bddd-72d0-491d-a824-99c79d216808 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd86e6d63aac348f08779d67ec479bd34'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:21.110037 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4d38bddd-72d0-491d-a824-99c79d216808 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd86e6d63aac348f08779d67ec479bd34'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:21.129149 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4d38bddd-72d0-491d-a824-99c79d216808 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd86e6d63aac348f08779d67ec479bd34'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:21.159126 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4d38bddd-72d0-491d-a824-99c79d216808 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd86e6d63aac348f08779d67ec479bd34'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:21.161262 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4d38bddd-72d0-491d-a824-99c79d216808 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd86e6d63aac348f08779d67ec479bd34'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:21.184158 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 896/1791] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:18:20 2022] DELETE /identity/v3/users/d86e6d63aac348f08779d67ec479bd34 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:21.459086 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505178c-a9e8-4c34-b093-1d989a27864b admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:21.460892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-c505178c-a9e8-4c34-b093-1d989a27864b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:21.485604 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505178c-a9e8-4c34-b093-1d989a27864b admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:21.657933 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c641c7-e08a-46af-ac5b-df80f1f62f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:21.659062 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c641c7-e08a-46af-ac5b-df80f1f62f1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:21.659585 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c641c7-e08a-46af-ac5b-df80f1f62f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:21.660301 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c641c7-e08a-46af-ac5b-df80f1f62f1e admin admin] PATH_INFO: `/v3/users/6180fd09a9c547a9b4e01b24706a0c10` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:21.662489 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c641c7-e08a-46af-ac5b-df80f1f62f1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6180fd09a9c547a9b4e01b24706a0c10)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:21.665288 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c641c7-e08a-46af-ac5b-df80f1f62f1e admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:21.723933 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38bddd-72d0-491d-a824-99c79d216808 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:21.726651 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4d38bddd-72d0-491d-a824-99c79d216808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:21.755624 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38bddd-72d0-491d-a824-99c79d216808 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:21.769959 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:21.773286 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95e6ef-cdd6-4a6d-aa70-0fcdc3b52c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:21.774534 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95e6ef-cdd6-4a6d-aa70-0fcdc3b52c55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:21.775463 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95e6ef-cdd6-4a6d-aa70-0fcdc3b52c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:21.777369 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95e6ef-cdd6-4a6d-aa70-0fcdc3b52c55 admin admin] PATH_INFO: `/v3/projects/3beac8443bc74e889e35057b2f6fd650` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:21.781089 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f95e6ef-cdd6-4a6d-aa70-0fcdc3b52c55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3beac8443bc74e889e35057b2f6fd650)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:21.786434 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f95e6ef-cdd6-4a6d-aa70-0fcdc3b52c55 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:21.803685 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:21.821690 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-01c641c7-e08a-46af-ac5b-df80f1f62f1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6180fd09a9c547a9b4e01b24706a0c10'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:21.837267 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-01c641c7-e08a-46af-ac5b-df80f1f62f1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6180fd09a9c547a9b4e01b24706a0c10'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:21.876844 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-01c641c7-e08a-46af-ac5b-df80f1f62f1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6180fd09a9c547a9b4e01b24706a0c10'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:21.894673 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-01c641c7-e08a-46af-ac5b-df80f1f62f1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6180fd09a9c547a9b4e01b24706a0c10'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:21.908742 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-01c641c7-e08a-46af-ac5b-df80f1f62f1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6180fd09a9c547a9b4e01b24706a0c10'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:21.932725 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 896/1792] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:18:21 2022] DELETE /identity/v3/users/6180fd09a9c547a9b4e01b24706a0c10 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:21.939547 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6f95e6ef-cdd6-4a6d-aa70-0fcdc3b52c55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3beac8443bc74e889e35057b2f6fd650', 'request_id': 'req-6f95e6ef-cdd6-4a6d-aa70-0fcdc3b52c55'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:21.944815 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b00e4b-1e27-4331-8a73-da2421441a12 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:21.945113 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b00e4b-1e27-4331-8a73-da2421441a12 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:21.945394 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b00e4b-1e27-4331-8a73-da2421441a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:21.956824 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6f95e6ef-cdd6-4a6d-aa70-0fcdc3b52c55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3beac8443bc74e889e35057b2f6fd650', 'request_id': 'req-6f95e6ef-cdd6-4a6d-aa70-0fcdc3b52c55'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:21.991417 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6f95e6ef-cdd6-4a6d-aa70-0fcdc3b52c55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3beac8443bc74e889e35057b2f6fd650', 'request_id': 'req-6f95e6ef-cdd6-4a6d-aa70-0fcdc3b52c55'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:22.012465 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-66b00e4b-1e27-4331-8a73-da2421441a12 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:22.015163 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-66b00e4b-1e27-4331-8a73-da2421441a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:22.021056 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6f95e6ef-cdd6-4a6d-aa70-0fcdc3b52c55 admin admin] The token cache is being invalidate because project 3beac8443bc74e889e35057b2f6fd650 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:18:22.023768 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6f95e6ef-cdd6-4a6d-aa70-0fcdc3b52c55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:22.027878 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6f95e6ef-cdd6-4a6d-aa70-0fcdc3b52c55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:22.030511 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 897/1793] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:18:21 2022] DELETE /identity/v3/projects/3beac8443bc74e889e35057b2f6fd650 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:22.033993 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd4fc8-e9b3-46a5-8fb8-869a7bb10b5f None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:22.034378 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd4fc8-e9b3-46a5-8fb8-869a7bb10b5f None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:22.035112 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd4fc8-e9b3-46a5-8fb8-869a7bb10b5f None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:22.040251 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 898/1794] 10.222.0.79 () {54 vars in 921 bytes} [Wed Aug 31 19:18:22 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:18:22.041200 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd4fc8-e9b3-46a5-8fb8-869a7bb10b5f None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:22.046359 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7bdd4fc8-e9b3-46a5-8fb8-869a7bb10b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:22.172464 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 897/1795] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:22.174184 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1620746-7511-4764-b4ca-5b8a3f28a412 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:22.176232 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1620746-7511-4764-b4ca-5b8a3f28a412 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:22.176774 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1620746-7511-4764-b4ca-5b8a3f28a412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:22.189318 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd4fc8-e9b3-46a5-8fb8-869a7bb10b5f None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:22.194283 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b900e10-9908-40e2-a96d-7ad3d8b6f981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:22.195299 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b900e10-9908-40e2-a96d-7ad3d8b6f981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:22.195720 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b900e10-9908-40e2-a96d-7ad3d8b6f981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:22.196071 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b900e10-9908-40e2-a96d-7ad3d8b6f981 admin admin] PATH_INFO: `/v3/users/8781da97d51942028cfaed5d2d7c5205` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:22.198222 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b900e10-9908-40e2-a96d-7ad3d8b6f981 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8781da97d51942028cfaed5d2d7c5205)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:22.204228 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-b1620746-7511-4764-b4ca-5b8a3f28a412 None None] MFA Rules not processed for user `1fd6d45d1bc3479da72cb1a1990a6137`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:22.205481 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-b1620746-7511-4764-b4ca-5b8a3f28a412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:22.207593 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b900e10-9908-40e2-a96d-7ad3d8b6f981 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:22.336931 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3b900e10-9908-40e2-a96d-7ad3d8b6f981 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8781da97d51942028cfaed5d2d7c5205'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:22.349320 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3b900e10-9908-40e2-a96d-7ad3d8b6f981 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8781da97d51942028cfaed5d2d7c5205'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:22.372629 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3b900e10-9908-40e2-a96d-7ad3d8b6f981 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8781da97d51942028cfaed5d2d7c5205'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:22.390354 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 898/1796] 10.222.0.79 () {58 vars in 1018 bytes} [Wed Aug 31 19:18:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:22.392532 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1620746-7511-4764-b4ca-5b8a3f28a412 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:22.395268 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-b1620746-7511-4764-b4ca-5b8a3f28a412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:22.402333 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3b900e10-9908-40e2-a96d-7ad3d8b6f981 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8781da97d51942028cfaed5d2d7c5205'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:22.404319 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3b900e10-9908-40e2-a96d-7ad3d8b6f981 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8781da97d51942028cfaed5d2d7c5205'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:22.415237 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1620746-7511-4764-b4ca-5b8a3f28a412 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:22.431542 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 899/1797] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:18:22 2022] DELETE /identity/v3/users/8781da97d51942028cfaed5d2d7c5205 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:22.432227 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02ce07-a6e8-4d76-842f-a8d9224ae575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:22.432789 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02ce07-a6e8-4d76-842f-a8d9224ae575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:22.433145 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02ce07-a6e8-4d76-842f-a8d9224ae575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:22.433492 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02ce07-a6e8-4d76-842f-a8d9224ae575 admin admin] PATH_INFO: `/v3/projects/2cb9142415504d2dad5d102d85dcf37f` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:22.434528 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b900e10-9908-40e2-a96d-7ad3d8b6f981 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:22.435729 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02ce07-a6e8-4d76-842f-a8d9224ae575 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cb9142415504d2dad5d102d85dcf37f)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:22.436671 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3b900e10-9908-40e2-a96d-7ad3d8b6f981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:22.438776 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02ce07-a6e8-4d76-842f-a8d9224ae575 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:22.458010 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:22.548503 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:22.565210 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b900e10-9908-40e2-a96d-7ad3d8b6f981 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:22.592882 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6f02ce07-a6e8-4d76-842f-a8d9224ae575 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cb9142415504d2dad5d102d85dcf37f', 'request_id': 'req-6f02ce07-a6e8-4d76-842f-a8d9224ae575'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:22.610077 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6f02ce07-a6e8-4d76-842f-a8d9224ae575 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cb9142415504d2dad5d102d85dcf37f', 'request_id': 'req-6f02ce07-a6e8-4d76-842f-a8d9224ae575'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:22.618376 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6f02ce07-a6e8-4d76-842f-a8d9224ae575 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cb9142415504d2dad5d102d85dcf37f', 'request_id': 'req-6f02ce07-a6e8-4d76-842f-a8d9224ae575'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:22.653324 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6f02ce07-a6e8-4d76-842f-a8d9224ae575 admin admin] The token cache is being invalidate because project 2cb9142415504d2dad5d102d85dcf37f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:18:22.653684 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6f02ce07-a6e8-4d76-842f-a8d9224ae575 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:22.654749 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6f02ce07-a6e8-4d76-842f-a8d9224ae575 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:22.658803 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 899/1798] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:18:22 2022] DELETE /identity/v3/projects/2cb9142415504d2dad5d102d85dcf37f => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:22.660343 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02ce07-a6e8-4d76-842f-a8d9224ae575 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:22.664129 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-6f02ce07-a6e8-4d76-842f-a8d9224ae575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:22.677836 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a202bf-8a22-46e0-ac06-370eff381068 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:22.678528 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a202bf-8a22-46e0-ac06-370eff381068 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:22.679023 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a202bf-8a22-46e0-ac06-370eff381068 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:22.679149 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a202bf-8a22-46e0-ac06-370eff381068 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:22.701902 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-59a202bf-8a22-46e0-ac06-370eff381068 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:22.813094 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a202bf-8a22-46e0-ac06-370eff381068 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:22.815739 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a202bf-8a22-46e0-ac06-370eff381068 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:22.829660 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 900/1799] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:22.832402 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd303a3c-00b9-423e-bf3e-563cdd9e3fd3 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:22.833020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd303a3c-00b9-423e-bf3e-563cdd9e3fd3 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:22.833491 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd303a3c-00b9-423e-bf3e-563cdd9e3fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:22.858283 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-cd303a3c-00b9-423e-bf3e-563cdd9e3fd3 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:22.859816 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-cd303a3c-00b9-423e-bf3e-563cdd9e3fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:22.875593 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02ce07-a6e8-4d76-842f-a8d9224ae575 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:22.878176 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 901/1800] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:22.879694 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63e723-bfe6-4369-941b-9838ce562201 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:22.880110 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63e723-bfe6-4369-941b-9838ce562201 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:22.880389 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63e723-bfe6-4369-941b-9838ce562201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:22.888953 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6686b9-3ac1-46c9-8285-44f23f59702c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:22.890287 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6686b9-3ac1-46c9-8285-44f23f59702c service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:22.890635 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6686b9-3ac1-46c9-8285-44f23f59702c service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:22.890907 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6686b9-3ac1-46c9-8285-44f23f59702c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:22.895825 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-0b6686b9-3ac1-46c9-8285-44f23f59702c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:22.924310 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-cf63e723-bfe6-4369-941b-9838ce562201 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:22.925956 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-cf63e723-bfe6-4369-941b-9838ce562201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:22.927643 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6686b9-3ac1-46c9-8285-44f23f59702c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:22.930088 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6686b9-3ac1-46c9-8285-44f23f59702c service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:22.947662 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 902/1801] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:22.952562 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf63e723-bfe6-4369-941b-9838ce562201 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:22.954746 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 900/1802] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:22.955572 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6686b9-3ac1-46c9-8285-44f23f59702c service nova] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:22.959710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-cf63e723-bfe6-4369-941b-9838ce562201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:22.970771 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6686b9-3ac1-46c9-8285-44f23f59702c service nova] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:22.992236 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf63e723-bfe6-4369-941b-9838ce562201 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:23.009625 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b8ec9-aa89-4b1f-88c8-12b1ce065d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:23.010261 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b8ec9-aa89-4b1f-88c8-12b1ce065d03 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:23.010618 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b8ec9-aa89-4b1f-88c8-12b1ce065d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:23.010836 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b8ec9-aa89-4b1f-88c8-12b1ce065d03 admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:23.011176 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf6806-5866-4673-91fa-97b3cbf2d593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:23.011500 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b8ec9-aa89-4b1f-88c8-12b1ce065d03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:18:23.012325 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf6806-5866-4673-91fa-97b3cbf2d593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:23.012779 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf6806-5866-4673-91fa-97b3cbf2d593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:23.013224 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf6806-5866-4673-91fa-97b3cbf2d593 admin admin] PATH_INFO: `/v3/projects/cc03f8c7634843a681558a9223d133d9` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:23.014809 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf6806-5866-4673-91fa-97b3cbf2d593 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc03f8c7634843a681558a9223d133d9)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:23.017027 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf6806-5866-4673-91fa-97b3cbf2d593 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:23.017621 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b8ec9-aa89-4b1f-88c8-12b1ce065d03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:23.034774 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b8ec9-aa89-4b1f-88c8-12b1ce065d03 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:23.086905 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 901/1803] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:18:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:18:23.088140 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b8ec9-aa89-4b1f-88c8-12b1ce065d03 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:23.109367 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b8ec9-aa89-4b1f-88c8-12b1ce065d03 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:23.123190 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755da575-d4b1-494a-9484-d8583df37ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:23.124187 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755da575-d4b1-494a-9484-d8583df37ab2 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:23.125050 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755da575-d4b1-494a-9484-d8583df37ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:23.125735 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755da575-d4b1-494a-9484-d8583df37ab2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:23.128279 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755da575-d4b1-494a-9484-d8583df37ab2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:23.132140 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755da575-d4b1-494a-9484-d8583df37ab2 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:23.147237 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-77bf6806-5866-4673-91fa-97b3cbf2d593 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc03f8c7634843a681558a9223d133d9', 'request_id': 'req-77bf6806-5866-4673-91fa-97b3cbf2d593'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:23.179994 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-77bf6806-5866-4673-91fa-97b3cbf2d593 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc03f8c7634843a681558a9223d133d9', 'request_id': 'req-77bf6806-5866-4673-91fa-97b3cbf2d593'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:23.185479 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:23.202132 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-77bf6806-5866-4673-91fa-97b3cbf2d593 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc03f8c7634843a681558a9223d133d9', 'request_id': 'req-77bf6806-5866-4673-91fa-97b3cbf2d593'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:23.222580 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 902/1804] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:18:23 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:23.226298 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755da575-d4b1-494a-9484-d8583df37ab2 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:23.239566 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-77bf6806-5866-4673-91fa-97b3cbf2d593 admin admin] The token cache is being invalidate because project cc03f8c7634843a681558a9223d133d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:18:23.241156 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-77bf6806-5866-4673-91fa-97b3cbf2d593 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:23.244550 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-77bf6806-5866-4673-91fa-97b3cbf2d593 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:23.248269 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 903/1805] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:18:22 2022] DELETE /identity/v3/projects/cc03f8c7634843a681558a9223d133d9 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:23.254111 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344fe20-cc86-4765-b0c9-3422696d0170 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:23.254390 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344fe20-cc86-4765-b0c9-3422696d0170 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:23.254769 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344fe20-cc86-4765-b0c9-3422696d0170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:23.327076 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-0344fe20-cc86-4765-b0c9-3422696d0170 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:23.332722 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0344fe20-cc86-4765-b0c9-3422696d0170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:23.395214 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755da575-d4b1-494a-9484-d8583df37ab2 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:23.409520 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65b832-87e5-4ccf-a235-f535c5d55aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:23.412499 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65b832-87e5-4ccf-a235-f535c5d55aaf admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:23.413143 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65b832-87e5-4ccf-a235-f535c5d55aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:23.414154 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65b832-87e5-4ccf-a235-f535c5d55aaf admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:23.416754 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d65b832-87e5-4ccf-a235-f535c5d55aaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:23.424088 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d65b832-87e5-4ccf-a235-f535c5d55aaf admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:23.479570 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 903/1806] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:18:23 2022] POST /identity/v3/users => generated 287 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:23.479570 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65b832-87e5-4ccf-a235-f535c5d55aaf admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:23.485363 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-3d65b832-87e5-4ccf-a235-f535c5d55aaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:23.541324 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 904/1807] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:23.541324 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344fe20-cc86-4765-b0c9-3422696d0170 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:23.541324 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0344fe20-cc86-4765-b0c9-3422696d0170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:23.547409 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:23.552248 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65b832-87e5-4ccf-a235-f535c5d55aaf admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:23.568130 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ae96d-e2ea-4f37-8f4f-6a6ed3312c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:23.569663 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ae96d-e2ea-4f37-8f4f-6a6ed3312c7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:23.571531 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ae96d-e2ea-4f37-8f4f-6a6ed3312c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:23.572209 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ae96d-e2ea-4f37-8f4f-6a6ed3312c7c admin admin] PATH_INFO: `/v3/users/8643604d508c4f35bba713c79dc119b1` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:23.573557 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344fe20-cc86-4765-b0c9-3422696d0170 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:23.577202 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7ae96d-e2ea-4f37-8f4f-6a6ed3312c7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8643604d508c4f35bba713c79dc119b1)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:23.585163 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79685df5-e86b-46f3-9692-2f5af5e1d7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:23.585695 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79685df5-e86b-46f3-9692-2f5af5e1d7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:23.585976 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79685df5-e86b-46f3-9692-2f5af5e1d7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:23.586247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79685df5-e86b-46f3-9692-2f5af5e1d7f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:23.586986 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79685df5-e86b-46f3-9692-2f5af5e1d7f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:23.588618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79685df5-e86b-46f3-9692-2f5af5e1d7f4 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:23.600448 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7ae96d-e2ea-4f37-8f4f-6a6ed3312c7c admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:23.609447 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 905/1808] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:23.615739 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f0435-e5c4-4a9d-8a43-781154ae1e17 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:23.616025 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f0435-e5c4-4a9d-8a43-781154ae1e17 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:23.616820 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f0435-e5c4-4a9d-8a43-781154ae1e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:23.676275 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-a24f0435-e5c4-4a9d-8a43-781154ae1e17 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:23.679270 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a24f0435-e5c4-4a9d-8a43-781154ae1e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:23.701906 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 906/1809] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:23.703171 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f0435-e5c4-4a9d-8a43-781154ae1e17 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:23.724300 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f0435-e5c4-4a9d-8a43-781154ae1e17 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:23.731707 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-be7ae96d-e2ea-4f37-8f4f-6a6ed3312c7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8643604d508c4f35bba713c79dc119b1'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:23.732836 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-be7ae96d-e2ea-4f37-8f4f-6a6ed3312c7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8643604d508c4f35bba713c79dc119b1'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:23.739285 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d8c9b-cbb5-47f7-a130-795aa89c84f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:23.739573 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d8c9b-cbb5-47f7-a130-795aa89c84f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:23.739856 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d8c9b-cbb5-47f7-a130-795aa89c84f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:23.740126 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d8c9b-cbb5-47f7-a130-795aa89c84f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:23.740775 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128d8c9b-cbb5-47f7-a130-795aa89c84f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:23.742381 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128d8c9b-cbb5-47f7-a130-795aa89c84f4 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:23.761626 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 907/1810] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:23.763227 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-be7ae96d-e2ea-4f37-8f4f-6a6ed3312c7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8643604d508c4f35bba713c79dc119b1'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:23.767624 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d8c9b-cbb5-47f7-a130-795aa89c84f4 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:23.774316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-be7ae96d-e2ea-4f37-8f4f-6a6ed3312c7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8643604d508c4f35bba713c79dc119b1'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:23.787445 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-be7ae96d-e2ea-4f37-8f4f-6a6ed3312c7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8643604d508c4f35bba713c79dc119b1'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:23.790852 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d8c9b-cbb5-47f7-a130-795aa89c84f4 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:23.798241 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 904/1811] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:18:23 2022] DELETE /identity/v3/users/8643604d508c4f35bba713c79dc119b1 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:23.801901 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ae96d-e2ea-4f37-8f4f-6a6ed3312c7c admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:23.804493 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-be7ae96d-e2ea-4f37-8f4f-6a6ed3312c7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:23.805597 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5834d7-7041-40b3-88d6-0ef361ff19d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:23.807104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5834d7-7041-40b3-88d6-0ef361ff19d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:23.807452 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5834d7-7041-40b3-88d6-0ef361ff19d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:23.808324 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5834d7-7041-40b3-88d6-0ef361ff19d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:23.809054 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5834d7-7041-40b3-88d6-0ef361ff19d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:18:23.809361 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5834d7-7041-40b3-88d6-0ef361ff19d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:23.811143 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5834d7-7041-40b3-88d6-0ef361ff19d3 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:23.829684 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 908/1812] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:18:23.831156 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbaed96-905a-4589-aabf-d62596ecf9e0 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:23.831444 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbaed96-905a-4589-aabf-d62596ecf9e0 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:23.831851 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbaed96-905a-4589-aabf-d62596ecf9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:23.860944 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-ffbaed96-905a-4589-aabf-d62596ecf9e0 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:23.862238 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ffbaed96-905a-4589-aabf-d62596ecf9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:23.891178 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ae96d-e2ea-4f37-8f4f-6a6ed3312c7c admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:23.895724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ce801-e544-4276-9891-bc7157fb8f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:23.896397 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ce801-e544-4276-9891-bc7157fb8f53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:23.896702 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ce801-e544-4276-9891-bc7157fb8f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:23.896976 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ce801-e544-4276-9891-bc7157fb8f53 admin admin] PATH_INFO: `/v3/projects/ef00d8437ff64996b72766146d2e4c9d/users/6a02bea81a684da6bb2e7e20ea224d1e/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:23.914309 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ce801-e544-4276-9891-bc7157fb8f53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef00d8437ff64996b72766146d2e4c9d, user_id=6a02bea81a684da6bb2e7e20ea224d1e, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:23.917209 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ce801-e544-4276-9891-bc7157fb8f53 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:23.929682 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 909/1813] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:23.930551 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbaed96-905a-4589-aabf-d62596ecf9e0 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:23.931874 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ffbaed96-905a-4589-aabf-d62596ecf9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:23.933732 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 905/1814] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:23 2022] PUT /identity/v3/projects/ef00d8437ff64996b72766146d2e4c9d/users/6a02bea81a684da6bb2e7e20ea224d1e/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:23.939736 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ce801-e544-4276-9891-bc7157fb8f53 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:23.943967 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-767ce801-e544-4276-9891-bc7157fb8f53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:23.954204 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbaed96-905a-4589-aabf-d62596ecf9e0 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:24.009981 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:24.021511 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ce801-e544-4276-9891-bc7157fb8f53 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:24.025435 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f7aae-8a63-4b80-a6d2-a89cec994dc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:24.026085 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f7aae-8a63-4b80-a6d2-a89cec994dc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:24.026351 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f7aae-8a63-4b80-a6d2-a89cec994dc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:24.026653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f7aae-8a63-4b80-a6d2-a89cec994dc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:24.029660 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87079abc-9906-4026-bf9f-53b40e89660c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:24.030638 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87079abc-9906-4026-bf9f-53b40e89660c admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:24.030926 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87079abc-9906-4026-bf9f-53b40e89660c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:24.031202 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87079abc-9906-4026-bf9f-53b40e89660c admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:24.031849 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87079abc-9906-4026-bf9f-53b40e89660c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:24.033978 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87079abc-9906-4026-bf9f-53b40e89660c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:24.039330 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611f7aae-8a63-4b80-a6d2-a89cec994dc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:24.041630 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611f7aae-8a63-4b80-a6d2-a89cec994dc4 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:24.062504 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 906/1815] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:18:24.063803 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba02cf9-be8a-407d-9c47-58ebe69659ad None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:24.064091 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba02cf9-be8a-407d-9c47-58ebe69659ad None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:24.064432 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba02cf9-be8a-407d-9c47-58ebe69659ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:24.070010 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 910/1816] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:18:23 2022] POST /identity/v3/projects => generated 375 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:24.071763 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87079abc-9906-4026-bf9f-53b40e89660c admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:24.087080 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:24.123068 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-bba02cf9-be8a-407d-9c47-58ebe69659ad None None] MFA Rules not processed for user `6a02bea81a684da6bb2e7e20ea224d1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:24.126216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-bba02cf9-be8a-407d-9c47-58ebe69659ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:24.163923 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87079abc-9906-4026-bf9f-53b40e89660c admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:24.170150 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f76b8-6798-477e-91ac-7f2512cf4ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:24.170881 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f76b8-6798-477e-91ac-7f2512cf4ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:24.171231 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f76b8-6798-477e-91ac-7f2512cf4ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:24.171649 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f76b8-6798-477e-91ac-7f2512cf4ba6 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:24.175846 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f76b8-6798-477e-91ac-7f2512cf4ba6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:24.178086 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f76b8-6798-477e-91ac-7f2512cf4ba6 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:24.217004 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 911/1817] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:18:24 2022] POST /identity/v3/users => generated 288 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:18:24.217004 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f76b8-6798-477e-91ac-7f2512cf4ba6 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:24.219247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-163f76b8-6798-477e-91ac-7f2512cf4ba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:24.234360 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f76b8-6798-477e-91ac-7f2512cf4ba6 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:24.243045 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaecd5c-8ecc-4bbb-8076-28e330c2cd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:24.243974 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaecd5c-8ecc-4bbb-8076-28e330c2cd2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:24.244466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaecd5c-8ecc-4bbb-8076-28e330c2cd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:24.245143 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaecd5c-8ecc-4bbb-8076-28e330c2cd2c admin admin] PATH_INFO: `/v3/projects/acc885ee83d34f68bcd8221b979c59b5` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:24.246835 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaecd5c-8ecc-4bbb-8076-28e330c2cd2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=acc885ee83d34f68bcd8221b979c59b5)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:24.249719 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaecd5c-8ecc-4bbb-8076-28e330c2cd2c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:24.285216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 907/1818] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:24.285216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba02cf9-be8a-407d-9c47-58ebe69659ad None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:24.317096 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba02cf9-be8a-407d-9c47-58ebe69659ad None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:24.324330 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eedbb1-6023-4567-ac42-f5d931a08da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:24.325165 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eedbb1-6023-4567-ac42-f5d931a08da0 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:24.325605 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eedbb1-6023-4567-ac42-f5d931a08da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:24.326023 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eedbb1-6023-4567-ac42-f5d931a08da0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:24.327001 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eedbb1-6023-4567-ac42-f5d931a08da0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:24.328828 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eedbb1-6023-4567-ac42-f5d931a08da0 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:24.338685 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9eaecd5c-8ecc-4bbb-8076-28e330c2cd2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acc885ee83d34f68bcd8221b979c59b5', 'request_id': 'req-9eaecd5c-8ecc-4bbb-8076-28e330c2cd2c'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:24.344196 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 908/1819] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:24.345275 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eedbb1-6023-4567-ac42-f5d931a08da0 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:24.347524 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9eaecd5c-8ecc-4bbb-8076-28e330c2cd2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acc885ee83d34f68bcd8221b979c59b5', 'request_id': 'req-9eaecd5c-8ecc-4bbb-8076-28e330c2cd2c'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:24.358612 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9eaecd5c-8ecc-4bbb-8076-28e330c2cd2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acc885ee83d34f68bcd8221b979c59b5', 'request_id': 'req-9eaecd5c-8ecc-4bbb-8076-28e330c2cd2c'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:24.359648 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eedbb1-6023-4567-ac42-f5d931a08da0 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:24.379542 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9eaecd5c-8ecc-4bbb-8076-28e330c2cd2c admin admin] The token cache is being invalidate because project acc885ee83d34f68bcd8221b979c59b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:18:24.380106 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9eaecd5c-8ecc-4bbb-8076-28e330c2cd2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:24.381055 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9eaecd5c-8ecc-4bbb-8076-28e330c2cd2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:24.386541 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 912/1820] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:18:24 2022] DELETE /identity/v3/projects/acc885ee83d34f68bcd8221b979c59b5 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:24.389036 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaecd5c-8ecc-4bbb-8076-28e330c2cd2c admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:24.394762 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9eaecd5c-8ecc-4bbb-8076-28e330c2cd2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:24.464422 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:24.468632 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c1332-06bc-4ec4-a263-2ff402a8f060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:24.469291 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c1332-06bc-4ec4-a263-2ff402a8f060 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:24.469606 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c1332-06bc-4ec4-a263-2ff402a8f060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:24.469889 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c1332-06bc-4ec4-a263-2ff402a8f060 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:24.470959 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c1332-06bc-4ec4-a263-2ff402a8f060 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:24.474204 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c1332-06bc-4ec4-a263-2ff402a8f060 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:24.501139 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaecd5c-8ecc-4bbb-8076-28e330c2cd2c admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:24.514739 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 909/1821] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:18:24 2022] POST /identity/v3/projects => generated 373 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:24.515712 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c1332-06bc-4ec4-a263-2ff402a8f060 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:24.517130 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4bc5d7-6a3f-43fd-b5a0-97beec5a3aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:24.517408 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-cb5c1332-06bc-4ec4-a263-2ff402a8f060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:24.519047 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bc5d7-6a3f-43fd-b5a0-97beec5a3aec admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:24.520127 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bc5d7-6a3f-43fd-b5a0-97beec5a3aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:24.520619 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bc5d7-6a3f-43fd-b5a0-97beec5a3aec admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:24.521490 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4bc5d7-6a3f-43fd-b5a0-97beec5a3aec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:24.523589 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4bc5d7-6a3f-43fd-b5a0-97beec5a3aec admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:24.564310 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 913/1822] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:24.569825 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4bc5d7-6a3f-43fd-b5a0-97beec5a3aec admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:24.574618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1f4bc5d7-6a3f-43fd-b5a0-97beec5a3aec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:24.603950 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4bc5d7-6a3f-43fd-b5a0-97beec5a3aec admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:24.625997 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c1332-06bc-4ec4-a263-2ff402a8f060 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:24.639906 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a6b010-3699-4a77-9526-1beaf64e4f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:24.639906 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6b010-3699-4a77-9526-1beaf64e4f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:24.639906 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6b010-3699-4a77-9526-1beaf64e4f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:24.639906 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6b010-3699-4a77-9526-1beaf64e4f03 admin admin] PATH_INFO: `/v3/users/470c2aa6f2aa4d899c3e7ac7ea2760aa` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:24.641344 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a6b010-3699-4a77-9526-1beaf64e4f03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=470c2aa6f2aa4d899c3e7ac7ea2760aa)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:24.648190 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a6b010-3699-4a77-9526-1beaf64e4f03 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:24.658317 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:24.689533 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25180d-296c-4452-a93c-4b379c5c2a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:24.690951 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25180d-296c-4452-a93c-4b379c5c2a31 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:24.691280 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25180d-296c-4452-a93c-4b379c5c2a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:24.691617 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25180d-296c-4452-a93c-4b379c5c2a31 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:24.692322 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25180d-296c-4452-a93c-4b379c5c2a31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:24.694586 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25180d-296c-4452-a93c-4b379c5c2a31 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:24.726973 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 914/1823] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:18:24 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:24.727977 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25180d-296c-4452-a93c-4b379c5c2a31 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:24.734153 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a4a6b010-3699-4a77-9526-1beaf64e4f03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '470c2aa6f2aa4d899c3e7ac7ea2760aa'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:24.735316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a4a6b010-3699-4a77-9526-1beaf64e4f03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '470c2aa6f2aa4d899c3e7ac7ea2760aa'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:24.742052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25180d-296c-4452-a93c-4b379c5c2a31 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:24.747555 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87926371-40d0-40e8-8bcf-0caefa93fb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:24.748164 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87926371-40d0-40e8-8bcf-0caefa93fb14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:24.748446 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87926371-40d0-40e8-8bcf-0caefa93fb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:24.748723 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87926371-40d0-40e8-8bcf-0caefa93fb14 admin admin] PATH_INFO: `/v3/projects/1860198bac1b4dff94ee086d2e858665/users/c861c35f9c51480b887310b6dae5d04b/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:24.758712 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a4a6b010-3699-4a77-9526-1beaf64e4f03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '470c2aa6f2aa4d899c3e7ac7ea2760aa'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:24.767084 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a4a6b010-3699-4a77-9526-1beaf64e4f03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '470c2aa6f2aa4d899c3e7ac7ea2760aa'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:24.768928 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87926371-40d0-40e8-8bcf-0caefa93fb14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1860198bac1b4dff94ee086d2e858665, user_id=c861c35f9c51480b887310b6dae5d04b, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:24.772656 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87926371-40d0-40e8-8bcf-0caefa93fb14 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:24.778663 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a4a6b010-3699-4a77-9526-1beaf64e4f03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '470c2aa6f2aa4d899c3e7ac7ea2760aa'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:24.789941 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 910/1824] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:18:24 2022] DELETE /identity/v3/users/470c2aa6f2aa4d899c3e7ac7ea2760aa => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:24.790691 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a6b010-3699-4a77-9526-1beaf64e4f03 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:24.793733 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-a4a6b010-3699-4a77-9526-1beaf64e4f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:24.820579 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 915/1825] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:24 2022] PUT /identity/v3/projects/1860198bac1b4dff94ee086d2e858665/users/c861c35f9c51480b887310b6dae5d04b/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:24.824187 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87926371-40d0-40e8-8bcf-0caefa93fb14 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:24.826602 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-87926371-40d0-40e8-8bcf-0caefa93fb14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:24.901622 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a6b010-3699-4a77-9526-1beaf64e4f03 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:24.949748 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87926371-40d0-40e8-8bcf-0caefa93fb14 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:24.957308 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13805ac1-a993-434b-b7b1-03aa01e00135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:24.958834 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13805ac1-a993-434b-b7b1-03aa01e00135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:24.959245 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13805ac1-a993-434b-b7b1-03aa01e00135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:24.959954 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13805ac1-a993-434b-b7b1-03aa01e00135 admin admin] PATH_INFO: `/v3/projects/5083f4b5f1b2498d8b64a0e3a9855ee4` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:24.962653 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13805ac1-a993-434b-b7b1-03aa01e00135 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5083f4b5f1b2498d8b64a0e3a9855ee4)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:24.964837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13805ac1-a993-434b-b7b1-03aa01e00135 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:25.010716 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b7cb7-3124-48d1-9065-a1ee704a6796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:25.011785 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b7cb7-3124-48d1-9065-a1ee704a6796 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:25.012063 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b7cb7-3124-48d1-9065-a1ee704a6796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:25.012530 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b7cb7-3124-48d1-9065-a1ee704a6796 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:25.013418 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b7cb7-3124-48d1-9065-a1ee704a6796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:25.015677 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b7cb7-3124-48d1-9065-a1ee704a6796 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:25.029086 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 911/1826] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:25.030359 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d51169-92a6-4ba0-852d-f4d7485d7239 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:25.030676 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d51169-92a6-4ba0-852d-f4d7485d7239 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:25.030952 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d51169-92a6-4ba0-852d-f4d7485d7239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:25.042417 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-13805ac1-a993-434b-b7b1-03aa01e00135 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5083f4b5f1b2498d8b64a0e3a9855ee4', 'request_id': 'req-13805ac1-a993-434b-b7b1-03aa01e00135'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:25.044766 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:25.053148 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-13805ac1-a993-434b-b7b1-03aa01e00135 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5083f4b5f1b2498d8b64a0e3a9855ee4', 'request_id': 'req-13805ac1-a993-434b-b7b1-03aa01e00135'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:25.063414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-13805ac1-a993-434b-b7b1-03aa01e00135 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5083f4b5f1b2498d8b64a0e3a9855ee4', 'request_id': 'req-13805ac1-a993-434b-b7b1-03aa01e00135'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:25.077044 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-44d51169-92a6-4ba0-852d-f4d7485d7239 None None] MFA Rules not processed for user `c861c35f9c51480b887310b6dae5d04b`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:25.078666 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-44d51169-92a6-4ba0-852d-f4d7485d7239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:25.083598 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-13805ac1-a993-434b-b7b1-03aa01e00135 admin admin] The token cache is being invalidate because project 5083f4b5f1b2498d8b64a0e3a9855ee4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:18:25.084153 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-13805ac1-a993-434b-b7b1-03aa01e00135 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:25.085837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-13805ac1-a993-434b-b7b1-03aa01e00135 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:25.091113 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 916/1827] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:18:24 2022] DELETE /identity/v3/projects/5083f4b5f1b2498d8b64a0e3a9855ee4 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:25.091113 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13805ac1-a993-434b-b7b1-03aa01e00135 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:25.091511 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-13805ac1-a993-434b-b7b1-03aa01e00135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:25.117295 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:25.230296 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 912/1828] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:25.231703 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d51169-92a6-4ba0-852d-f4d7485d7239 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:25.232728 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13805ac1-a993-434b-b7b1-03aa01e00135 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:25.232849 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-44d51169-92a6-4ba0-852d-f4d7485d7239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:25.245972 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88706504-6ba1-4a5c-971d-df69eb70b658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:25.247417 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88706504-6ba1-4a5c-971d-df69eb70b658 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:25.247704 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88706504-6ba1-4a5c-971d-df69eb70b658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:25.248750 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88706504-6ba1-4a5c-971d-df69eb70b658 admin admin] PATH_INFO: `/v3/projects/714f7f86014d45d48206bcc59e814a92/users/85373384f7bc4d84b9b6cc62d72d8e45/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:25.249353 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d51169-92a6-4ba0-852d-f4d7485d7239 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:25.260017 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a4d34e-e21a-461d-b223-16204c5e33f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:25.260724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4d34e-e21a-461d-b223-16204c5e33f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:25.261007 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4d34e-e21a-461d-b223-16204c5e33f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:25.261308 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4d34e-e21a-461d-b223-16204c5e33f5 admin admin] PATH_INFO: `/v3/users/6108af0472744b9396258d75830e4c44` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:25.262566 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a4d34e-e21a-461d-b223-16204c5e33f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6108af0472744b9396258d75830e4c44)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:25.264618 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a4d34e-e21a-461d-b223-16204c5e33f5 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:25.293977 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88706504-6ba1-4a5c-971d-df69eb70b658 admin admin] RBAC: Authorizing `identity:create_grant(project_id=714f7f86014d45d48206bcc59e814a92, user_id=85373384f7bc4d84b9b6cc62d72d8e45, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:25.298549 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88706504-6ba1-4a5c-971d-df69eb70b658 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:25.342499 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 917/1829] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:25 2022] PUT /identity/v3/projects/714f7f86014d45d48206bcc59e814a92/users/85373384f7bc4d84b9b6cc62d72d8e45/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:25.342697 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88706504-6ba1-4a5c-971d-df69eb70b658 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:25.351731 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-88706504-6ba1-4a5c-971d-df69eb70b658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:25.389153 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-80a4d34e-e21a-461d-b223-16204c5e33f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6108af0472744b9396258d75830e4c44'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:25.391665 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-80a4d34e-e21a-461d-b223-16204c5e33f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6108af0472744b9396258d75830e4c44'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:25.409841 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-80a4d34e-e21a-461d-b223-16204c5e33f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6108af0472744b9396258d75830e4c44'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:25.423666 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-80a4d34e-e21a-461d-b223-16204c5e33f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6108af0472744b9396258d75830e4c44'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:25.434160 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-80a4d34e-e21a-461d-b223-16204c5e33f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6108af0472744b9396258d75830e4c44'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:25.441915 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88706504-6ba1-4a5c-971d-df69eb70b658 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:25.446572 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 913/1830] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:18:25 2022] DELETE /identity/v3/users/6108af0472744b9396258d75830e4c44 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:25.446572 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a4d34e-e21a-461d-b223-16204c5e33f5 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:25.448041 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-80a4d34e-e21a-461d-b223-16204c5e33f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:25.525806 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd8786-2b82-451a-aac7-d7ff196a1743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:25.527234 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd8786-2b82-451a-aac7-d7ff196a1743 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:25.527865 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd8786-2b82-451a-aac7-d7ff196a1743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:25.528518 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd8786-2b82-451a-aac7-d7ff196a1743 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:25.530295 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd8786-2b82-451a-aac7-d7ff196a1743 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:25.533207 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd8786-2b82-451a-aac7-d7ff196a1743 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:25.538128 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a4d34e-e21a-461d-b223-16204c5e33f5 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:25.544767 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb7611-9ab6-4ae3-9a49-e91845e54f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:25.546788 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb7611-9ab6-4ae3-9a49-e91845e54f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:25.548361 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb7611-9ab6-4ae3-9a49-e91845e54f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:25.549033 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb7611-9ab6-4ae3-9a49-e91845e54f06 admin admin] PATH_INFO: `/v3/projects/838f71ebc97f4966bd646486c327020f` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:25.550998 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb7611-9ab6-4ae3-9a49-e91845e54f06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=838f71ebc97f4966bd646486c327020f)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:25.554526 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb7611-9ab6-4ae3-9a49-e91845e54f06 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:25.554773 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:25.574614 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 918/1831] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:18:25 2022] POST /identity/v3/projects => generated 375 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:25.574614 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd8786-2b82-451a-aac7-d7ff196a1743 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:25.574614 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-63dd8786-2b82-451a-aac7-d7ff196a1743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:25.607345 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:25.634898 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-e1bb7611-9ab6-4ae3-9a49-e91845e54f06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '838f71ebc97f4966bd646486c327020f', 'request_id': 'req-e1bb7611-9ab6-4ae3-9a49-e91845e54f06'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:25.644227 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-e1bb7611-9ab6-4ae3-9a49-e91845e54f06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '838f71ebc97f4966bd646486c327020f', 'request_id': 'req-e1bb7611-9ab6-4ae3-9a49-e91845e54f06'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:25.651549 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-e1bb7611-9ab6-4ae3-9a49-e91845e54f06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '838f71ebc97f4966bd646486c327020f', 'request_id': 'req-e1bb7611-9ab6-4ae3-9a49-e91845e54f06'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:25.670728 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-e1bb7611-9ab6-4ae3-9a49-e91845e54f06 admin admin] The token cache is being invalidate because project 838f71ebc97f4966bd646486c327020f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:18:25.671037 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-e1bb7611-9ab6-4ae3-9a49-e91845e54f06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:25.671784 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-e1bb7611-9ab6-4ae3-9a49-e91845e54f06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:25.678029 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 914/1832] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:18:25 2022] DELETE /identity/v3/projects/838f71ebc97f4966bd646486c327020f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:25.679109 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb7611-9ab6-4ae3-9a49-e91845e54f06 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:25.680557 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-e1bb7611-9ab6-4ae3-9a49-e91845e54f06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:25.711662 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd8786-2b82-451a-aac7-d7ff196a1743 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:25.760451 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb7611-9ab6-4ae3-9a49-e91845e54f06 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:25.765852 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229742c-4737-4d4c-886e-c2a724a93f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:25.766507 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229742c-4737-4d4c-886e-c2a724a93f9d admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:25.766784 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229742c-4737-4d4c-886e-c2a724a93f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:25.767061 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229742c-4737-4d4c-886e-c2a724a93f9d admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:25.767710 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229742c-4737-4d4c-886e-c2a724a93f9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:25.770188 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229742c-4737-4d4c-886e-c2a724a93f9d admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:25.797712 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 915/1833] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:18:25 2022] POST /identity/v3/users => generated 294 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:25.799145 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae1b20-cd95-4c4b-8a62-36eb67ccf216 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:25.799469 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae1b20-cd95-4c4b-8a62-36eb67ccf216 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:25.799756 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae1b20-cd95-4c4b-8a62-36eb67ccf216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:25.802415 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37d7b9-c694-43bd-8f2e-3e07b6546d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:25.803281 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37d7b9-c694-43bd-8f2e-3e07b6546d3d admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:25.803565 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37d7b9-c694-43bd-8f2e-3e07b6546d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:25.803835 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37d7b9-c694-43bd-8f2e-3e07b6546d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:25.804479 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e37d7b9-c694-43bd-8f2e-3e07b6546d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:25.806168 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e37d7b9-c694-43bd-8f2e-3e07b6546d3d admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:25.822224 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 919/1834] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:25.823099 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-3dae1b20-cd95-4c4b-8a62-36eb67ccf216 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:25.824520 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-3dae1b20-cd95-4c4b-8a62-36eb67ccf216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:25.824750 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37d7b9-c694-43bd-8f2e-3e07b6546d3d admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:25.835910 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 916/1835] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:25.836584 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae1b20-cd95-4c4b-8a62-36eb67ccf216 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:25.838018 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-3dae1b20-cd95-4c4b-8a62-36eb67ccf216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:25.846184 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37d7b9-c694-43bd-8f2e-3e07b6546d3d admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:25.852417 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe7da3-e82a-4d38-b898-1f9ecc91699e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:25.852924 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae1b20-cd95-4c4b-8a62-36eb67ccf216 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:25.853062 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe7da3-e82a-4d38-b898-1f9ecc91699e admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:25.853470 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe7da3-e82a-4d38-b898-1f9ecc91699e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:25.853960 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe7da3-e82a-4d38-b898-1f9ecc91699e admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:25.854653 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe7da3-e82a-4d38-b898-1f9ecc91699e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:25.856287 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe7da3-e82a-4d38-b898-1f9ecc91699e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:25.858924 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade3e91-7c61-4f3e-895d-f3bd52e451f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:25.859731 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade3e91-7c61-4f3e-895d-f3bd52e451f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:25.860018 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade3e91-7c61-4f3e-895d-f3bd52e451f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:25.860295 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade3e91-7c61-4f3e-895d-f3bd52e451f5 admin admin] PATH_INFO: `/v3/projects/714f7f86014d45d48206bcc59e814a92/users/85373384f7bc4d84b9b6cc62d72d8e45/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:25.862413 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade3e91-7c61-4f3e-895d-f3bd52e451f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=714f7f86014d45d48206bcc59e814a92, user_id=85373384f7bc4d84b9b6cc62d72d8e45, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:25.865228 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade3e91-7c61-4f3e-895d-f3bd52e451f5 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:25.870241 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 920/1836] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:25.871868 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637891a2-cfe1-4f87-86df-caae49576f14 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:25.872855 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637891a2-cfe1-4f87-86df-caae49576f14 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:25.873365 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637891a2-cfe1-4f87-86df-caae49576f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:25.889980 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 917/1837] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:25 2022] PUT /identity/v3/projects/714f7f86014d45d48206bcc59e814a92/users/85373384f7bc4d84b9b6cc62d72d8e45/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:25.890892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade3e91-7c61-4f3e-895d-f3bd52e451f5 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:25.909032 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-637891a2-cfe1-4f87-86df-caae49576f14 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:25.911434 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-637891a2-cfe1-4f87-86df-caae49576f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:25.994538 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 921/1838] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:25.995177 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26371860-6285-4fec-afa2-febd8310246a None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:25.995177 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26371860-6285-4fec-afa2-febd8310246a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:25.995309 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26371860-6285-4fec-afa2-febd8310246a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:26.003955 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade3e91-7c61-4f3e-895d-f3bd52e451f5 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:26.009547 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d3436-9035-4723-a947-e46412e09e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:26.010229 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d3436-9035-4723-a947-e46412e09e80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:26.010537 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d3436-9035-4723-a947-e46412e09e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:26.010868 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d3436-9035-4723-a947-e46412e09e80 admin admin] PATH_INFO: `/v3/projects/8f1ccd5bf814440d8cf2d7d5f3801eef/users/5150d54de81142ccbb4fecbada9bc05a/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:26.031277 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-26371860-6285-4fec-afa2-febd8310246a None None] MFA Rules not processed for user `85373384f7bc4d84b9b6cc62d72d8e45`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:26.034687 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-26371860-6285-4fec-afa2-febd8310246a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:26.049018 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63d3436-9035-4723-a947-e46412e09e80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f1ccd5bf814440d8cf2d7d5f3801eef, user_id=5150d54de81142ccbb4fecbada9bc05a, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:26.052617 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63d3436-9035-4723-a947-e46412e09e80 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:26.054370 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:26.071643 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 918/1839] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:25 2022] PUT /identity/v3/projects/8f1ccd5bf814440d8cf2d7d5f3801eef/users/5150d54de81142ccbb4fecbada9bc05a/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:26.071643 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d3436-9035-4723-a947-e46412e09e80 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:26.086405 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:26.135480 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 922/1840] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:26.136540 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26371860-6285-4fec-afa2-febd8310246a None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:26.147832 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26371860-6285-4fec-afa2-febd8310246a None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:26.164666 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d3436-9035-4723-a947-e46412e09e80 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:26.169613 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe42f9f-42f1-4f84-aa0e-53e9fd3f1d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:26.170218 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe42f9f-42f1-4f84-aa0e-53e9fd3f1d00 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:26.170533 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe42f9f-42f1-4f84-aa0e-53e9fd3f1d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:26.170810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe42f9f-42f1-4f84-aa0e-53e9fd3f1d00 admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:26.171453 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe42f9f-42f1-4f84-aa0e-53e9fd3f1d00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:18:26.171763 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe42f9f-42f1-4f84-aa0e-53e9fd3f1d00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:26.173437 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe42f9f-42f1-4f84-aa0e-53e9fd3f1d00 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:26.186626 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 919/1841] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:18:26.187505 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe42f9f-42f1-4f84-aa0e-53e9fd3f1d00 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:26.189464 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-bfe42f9f-42f1-4f84-aa0e-53e9fd3f1d00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:26.202440 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe42f9f-42f1-4f84-aa0e-53e9fd3f1d00 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:26.208174 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fbc6a-0b29-4bd6-b1a9-fd004b5eb4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:26.208390 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fbc6a-0b29-4bd6-b1a9-fd004b5eb4dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:26.208741 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fbc6a-0b29-4bd6-b1a9-fd004b5eb4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:26.209019 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fbc6a-0b29-4bd6-b1a9-fd004b5eb4dc admin admin] PATH_INFO: `/v3/projects/9b2b89af0976439aa1335aaf06fdf571` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:26.210128 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320fbc6a-0b29-4bd6-b1a9-fd004b5eb4dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b2b89af0976439aa1335aaf06fdf571)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:26.212185 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320fbc6a-0b29-4bd6-b1a9-fd004b5eb4dc admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:26.212505 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b12620-5854-4eae-90e4-72d9ec508ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:26.213230 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b12620-5854-4eae-90e4-72d9ec508ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:26.213519 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b12620-5854-4eae-90e4-72d9ec508ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:26.213788 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b12620-5854-4eae-90e4-72d9ec508ff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:26.214426 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b12620-5854-4eae-90e4-72d9ec508ff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:26.216033 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b12620-5854-4eae-90e4-72d9ec508ff7 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:26.226135 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 923/1842] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:26.226954 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b12620-5854-4eae-90e4-72d9ec508ff7 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:26.228561 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d6b12620-5854-4eae-90e4-72d9ec508ff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:26.263688 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-320fbc6a-0b29-4bd6-b1a9-fd004b5eb4dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b2b89af0976439aa1335aaf06fdf571', 'request_id': 'req-320fbc6a-0b29-4bd6-b1a9-fd004b5eb4dc'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:26.271000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-320fbc6a-0b29-4bd6-b1a9-fd004b5eb4dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b2b89af0976439aa1335aaf06fdf571', 'request_id': 'req-320fbc6a-0b29-4bd6-b1a9-fd004b5eb4dc'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:26.278510 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-320fbc6a-0b29-4bd6-b1a9-fd004b5eb4dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b2b89af0976439aa1335aaf06fdf571', 'request_id': 'req-320fbc6a-0b29-4bd6-b1a9-fd004b5eb4dc'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:26.293702 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-320fbc6a-0b29-4bd6-b1a9-fd004b5eb4dc admin admin] The token cache is being invalidate because project 9b2b89af0976439aa1335aaf06fdf571 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:18:26.294020 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-320fbc6a-0b29-4bd6-b1a9-fd004b5eb4dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:26.294896 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-320fbc6a-0b29-4bd6-b1a9-fd004b5eb4dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:26.296478 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 920/1843] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:18:26 2022] DELETE /identity/v3/projects/9b2b89af0976439aa1335aaf06fdf571 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:26.296715 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b12620-5854-4eae-90e4-72d9ec508ff7 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:26.297140 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fbc6a-0b29-4bd6-b1a9-fd004b5eb4dc admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:26.301238 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-320fbc6a-0b29-4bd6-b1a9-fd004b5eb4dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:26.357907 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71276fd-05d0-448f-8cdf-39ec47b8f676 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:26.358552 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71276fd-05d0-448f-8cdf-39ec47b8f676 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:26.358830 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71276fd-05d0-448f-8cdf-39ec47b8f676 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:26.359098 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71276fd-05d0-448f-8cdf-39ec47b8f676 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:26.361378 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d71276fd-05d0-448f-8cdf-39ec47b8f676 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:26.381581 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fbc6a-0b29-4bd6-b1a9-fd004b5eb4dc admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:26.387274 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e53f9-d861-45ef-b257-db88a5726528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:26.388045 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e53f9-d861-45ef-b257-db88a5726528 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:26.388296 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e53f9-d861-45ef-b257-db88a5726528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:26.388645 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e53f9-d861-45ef-b257-db88a5726528 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:26.389364 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e53f9-d861-45ef-b257-db88a5726528 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:26.390956 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:26.391602 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e53f9-d861-45ef-b257-db88a5726528 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:26.432299 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 921/1844] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:18:26 2022] POST /identity/v3/projects => generated 401 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:26.433255 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e53f9-d861-45ef-b257-db88a5726528 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:26.436635 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-3b9e53f9-d861-45ef-b257-db88a5726528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:26.470973 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:26.474671 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71276fd-05d0-448f-8cdf-39ec47b8f676 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:26.476466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71276fd-05d0-448f-8cdf-39ec47b8f676 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:26.490217 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 924/1845] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:26.491794 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee36a0-23e2-4796-a846-4a95d6766050 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:26.492091 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee36a0-23e2-4796-a846-4a95d6766050 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:26.492444 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee36a0-23e2-4796-a846-4a95d6766050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:26.515610 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-0eee36a0-23e2-4796-a846-4a95d6766050 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:26.518013 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0eee36a0-23e2-4796-a846-4a95d6766050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:26.554232 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e53f9-d861-45ef-b257-db88a5726528 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:26.570315 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf801bf-18f6-432e-9d3c-2ad30dd58f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:26.572436 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf801bf-18f6-432e-9d3c-2ad30dd58f20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:26.572716 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf801bf-18f6-432e-9d3c-2ad30dd58f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:26.573988 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf801bf-18f6-432e-9d3c-2ad30dd58f20 admin admin] PATH_INFO: `/v3/projects/8f1ccd5bf814440d8cf2d7d5f3801eef/users/5150d54de81142ccbb4fecbada9bc05a/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:26.577826 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf801bf-18f6-432e-9d3c-2ad30dd58f20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f1ccd5bf814440d8cf2d7d5f3801eef, user_id=5150d54de81142ccbb4fecbada9bc05a, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:26.586198 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf801bf-18f6-432e-9d3c-2ad30dd58f20 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:26.624905 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 922/1846] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:26 2022] PUT /identity/v3/projects/8f1ccd5bf814440d8cf2d7d5f3801eef/users/5150d54de81142ccbb4fecbada9bc05a/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:26.626146 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf801bf-18f6-432e-9d3c-2ad30dd58f20 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:26.656516 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 925/1847] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:26.682404 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b184c0f-b6bf-4c3d-9a75-5db83e05f61f None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:26.682919 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b184c0f-b6bf-4c3d-9a75-5db83e05f61f None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:26.683308 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b184c0f-b6bf-4c3d-9a75-5db83e05f61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:26.762546 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-8b184c0f-b6bf-4c3d-9a75-5db83e05f61f None None] MFA Rules not processed for user `5150d54de81142ccbb4fecbada9bc05a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:26.765660 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8b184c0f-b6bf-4c3d-9a75-5db83e05f61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:26.804955 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf801bf-18f6-432e-9d3c-2ad30dd58f20 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:26.827483 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628223e7-6ee3-4bf0-a04f-13aafeb13599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:26.828118 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628223e7-6ee3-4bf0-a04f-13aafeb13599 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:26.828399 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628223e7-6ee3-4bf0-a04f-13aafeb13599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:26.828676 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628223e7-6ee3-4bf0-a04f-13aafeb13599 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:26.833208 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628223e7-6ee3-4bf0-a04f-13aafeb13599 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:26.837378 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628223e7-6ee3-4bf0-a04f-13aafeb13599 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:26.879704 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 926/1848] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:26 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:26.879704 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fabe06-7cbd-4dbe-bc4f-c25b7c6e607a None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:26.879704 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fabe06-7cbd-4dbe-bc4f-c25b7c6e607a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:26.879704 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fabe06-7cbd-4dbe-bc4f-c25b7c6e607a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:26.894604 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 923/1849] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:18:26 2022] POST /identity/v3/users => generated 301 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:26.896139 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628223e7-6ee3-4bf0-a04f-13aafeb13599 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:26.905223 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-80fabe06-7cbd-4dbe-bc4f-c25b7c6e607a None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:26.906820 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-80fabe06-7cbd-4dbe-bc4f-c25b7c6e607a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:26.911257 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628223e7-6ee3-4bf0-a04f-13aafeb13599 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:26.919976 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 927/1850] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:26.921411 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fabe06-7cbd-4dbe-bc4f-c25b7c6e607a None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:26.926192 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9ad31-2c72-4e50-9639-dbd89d2e555e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:26.926885 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9ad31-2c72-4e50-9639-dbd89d2e555e admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:26.927169 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9ad31-2c72-4e50-9639-dbd89d2e555e admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:26.927451 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9ad31-2c72-4e50-9639-dbd89d2e555e admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:26.928132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9ad31-2c72-4e50-9639-dbd89d2e555e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:26.929672 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9ad31-2c72-4e50-9639-dbd89d2e555e admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:26.931947 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fabe06-7cbd-4dbe-bc4f-c25b7c6e607a None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:26.936859 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5c38f-3acd-48cc-bcc5-148350b32997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:26.937509 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5c38f-3acd-48cc-bcc5-148350b32997 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:26.937791 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5c38f-3acd-48cc-bcc5-148350b32997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:26.938066 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5c38f-3acd-48cc-bcc5-148350b32997 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:26.938759 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5c38f-3acd-48cc-bcc5-148350b32997 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:18:26.939063 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5c38f-3acd-48cc-bcc5-148350b32997 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:26.941340 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5c38f-3acd-48cc-bcc5-148350b32997 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:26.953509 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 924/1851] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:26.954382 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9ad31-2c72-4e50-9639-dbd89d2e555e admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:26.954990 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 928/1852] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:18:26.959177 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5c38f-3acd-48cc-bcc5-148350b32997 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:26.960958 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-73b9ad31-2c72-4e50-9639-dbd89d2e555e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:26.972784 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5c38f-3acd-48cc-bcc5-148350b32997 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:26.979656 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72d6c6-0c7e-475d-9f53-f0d28ad0adcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:26.980642 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72d6c6-0c7e-475d-9f53-f0d28ad0adcb admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:26.981625 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72d6c6-0c7e-475d-9f53-f0d28ad0adcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:26.982347 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72d6c6-0c7e-475d-9f53-f0d28ad0adcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:26.983164 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72d6c6-0c7e-475d-9f53-f0d28ad0adcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:26.985370 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72d6c6-0c7e-475d-9f53-f0d28ad0adcb admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:27.001411 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 929/1853] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:27.003549 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72d6c6-0c7e-475d-9f53-f0d28ad0adcb admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:27.018442 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72d6c6-0c7e-475d-9f53-f0d28ad0adcb admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:27.024651 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51edbb2b-b2bd-4648-a1d8-4d6d0836f08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:27.026190 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edbb2b-b2bd-4648-a1d8-4d6d0836f08c admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:27.026819 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edbb2b-b2bd-4648-a1d8-4d6d0836f08c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:27.027261 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edbb2b-b2bd-4648-a1d8-4d6d0836f08c admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:27.028045 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51edbb2b-b2bd-4648-a1d8-4d6d0836f08c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:27.030121 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51edbb2b-b2bd-4648-a1d8-4d6d0836f08c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:27.037933 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:27.090496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9ad31-2c72-4e50-9639-dbd89d2e555e admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:27.090630 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 930/1854] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:18:27 2022] POST /identity/v3/projects => generated 367 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:27.090630 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51edbb2b-b2bd-4648-a1d8-4d6d0836f08c admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:27.143402 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:27.155169 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d5111-00d0-439d-97fa-c65e2fc5b612 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:27.155814 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d5111-00d0-439d-97fa-c65e2fc5b612 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:27.156099 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d5111-00d0-439d-97fa-c65e2fc5b612 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:27.156373 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d5111-00d0-439d-97fa-c65e2fc5b612 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:27.159134 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-e98d5111-00d0-439d-97fa-c65e2fc5b612 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:27.231912 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51edbb2b-b2bd-4648-a1d8-4d6d0836f08c admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:27.244506 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d5111-00d0-439d-97fa-c65e2fc5b612 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:27.247571 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d5111-00d0-439d-97fa-c65e2fc5b612 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:27.247788 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac708e-cb96-417d-bd8a-6ef8217fa897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:27.248499 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac708e-cb96-417d-bd8a-6ef8217fa897 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:27.248784 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac708e-cb96-417d-bd8a-6ef8217fa897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:27.249063 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac708e-cb96-417d-bd8a-6ef8217fa897 admin admin] PATH_INFO: `/v3/projects/46e403fa48dc4a30a55b4ce4684754dd/users/90eb7167ce5b45cf80f6310cde13aa64/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:27.267454 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 925/1855] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:27.267454 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d5111-00d0-439d-97fa-c65e2fc5b612 service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:27.278644 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdac708e-cb96-417d-bd8a-6ef8217fa897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46e403fa48dc4a30a55b4ce4684754dd, user_id=90eb7167ce5b45cf80f6310cde13aa64, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:27.279586 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d5111-00d0-439d-97fa-c65e2fc5b612 service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:27.282677 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdac708e-cb96-417d-bd8a-6ef8217fa897 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:27.289423 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2a9a1-c8ed-467b-9861-5dd56805cf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:27.290048 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2a9a1-c8ed-467b-9861-5dd56805cf1e admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:27.290337 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2a9a1-c8ed-467b-9861-5dd56805cf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:27.290684 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2a9a1-c8ed-467b-9861-5dd56805cf1e admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:27.291280 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d2a9a1-c8ed-467b-9861-5dd56805cf1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:27.293686 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d2a9a1-c8ed-467b-9861-5dd56805cf1e admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:27.301763 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 931/1856] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:27 2022] PUT /identity/v3/projects/46e403fa48dc4a30a55b4ce4684754dd/users/90eb7167ce5b45cf80f6310cde13aa64/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:27.311015 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac708e-cb96-417d-bd8a-6ef8217fa897 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:27.312416 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-cdac708e-cb96-417d-bd8a-6ef8217fa897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:27.332443 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 926/1857] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:18:27 2022] POST /identity/v3/users => generated 284 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:27.334703 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdc05a-2c82-49e6-81e1-42a4e5ce9e31 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:27.335165 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdc05a-2c82-49e6-81e1-42a4e5ce9e31 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:27.335624 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdc05a-2c82-49e6-81e1-42a4e5ce9e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:27.379393 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-6cfdc05a-2c82-49e6-81e1-42a4e5ce9e31 None None] MFA Rules not processed for user `90eb7167ce5b45cf80f6310cde13aa64`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:27.381845 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-6cfdc05a-2c82-49e6-81e1-42a4e5ce9e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:27.420334 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac708e-cb96-417d-bd8a-6ef8217fa897 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:27.426979 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd7d2c-5fea-4818-ad39-4b3b15dd6f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:27.427715 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd7d2c-5fea-4818-ad39-4b3b15dd6f10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:27.428448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd7d2c-5fea-4818-ad39-4b3b15dd6f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:27.428448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd7d2c-5fea-4818-ad39-4b3b15dd6f10 admin admin] PATH_INFO: `/v3/users/6a02bea81a684da6bb2e7e20ea224d1e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:27.429786 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd7d2c-5fea-4818-ad39-4b3b15dd6f10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a02bea81a684da6bb2e7e20ea224d1e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:27.432142 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd7d2c-5fea-4818-ad39-4b3b15dd6f10 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:27.495805 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 927/1858] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:27 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:27.496827 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfdc05a-2c82-49e6-81e1-42a4e5ce9e31 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:27.517830 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-fadd7d2c-5fea-4818-ad39-4b3b15dd6f10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a02bea81a684da6bb2e7e20ea224d1e'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:27.521396 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfdc05a-2c82-49e6-81e1-42a4e5ce9e31 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:27.529932 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad194ae0-6d86-4a07-8f81-32fe358c57ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:27.530716 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad194ae0-6d86-4a07-8f81-32fe358c57ad admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:27.531070 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad194ae0-6d86-4a07-8f81-32fe358c57ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:27.531416 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad194ae0-6d86-4a07-8f81-32fe358c57ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:27.532177 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad194ae0-6d86-4a07-8f81-32fe358c57ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:27.534621 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad194ae0-6d86-4a07-8f81-32fe358c57ad admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:27.547668 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-fadd7d2c-5fea-4818-ad39-4b3b15dd6f10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a02bea81a684da6bb2e7e20ea224d1e'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:27.561861 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-fadd7d2c-5fea-4818-ad39-4b3b15dd6f10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a02bea81a684da6bb2e7e20ea224d1e'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:27.566899 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 928/1859] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:27.567886 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad194ae0-6d86-4a07-8f81-32fe358c57ad admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:27.579221 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:27.593036 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-fadd7d2c-5fea-4818-ad39-4b3b15dd6f10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a02bea81a684da6bb2e7e20ea224d1e'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:27.594033 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-fadd7d2c-5fea-4818-ad39-4b3b15dd6f10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a02bea81a684da6bb2e7e20ea224d1e'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:27.594962 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad194ae0-6d86-4a07-8f81-32fe358c57ad admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:27.603451 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd8d91-ea52-4367-af50-d167dad0d26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:27.604308 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd8d91-ea52-4367-af50-d167dad0d26d admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:27.604740 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd8d91-ea52-4367-af50-d167dad0d26d admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:27.605187 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd8d91-ea52-4367-af50-d167dad0d26d admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:27.606024 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd8d91-ea52-4367-af50-d167dad0d26d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:27.608289 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd8d91-ea52-4367-af50-d167dad0d26d admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:27.624358 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 932/1860] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:18:27 2022] DELETE /identity/v3/users/6a02bea81a684da6bb2e7e20ea224d1e => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:27.624358 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd7d2c-5fea-4818-ad39-4b3b15dd6f10 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:27.627276 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-fadd7d2c-5fea-4818-ad39-4b3b15dd6f10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:27.650617 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 929/1861] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:18:27 2022] POST /identity/v3/projects => generated 399 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:27.656830 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786c359-4a81-4698-ae02-7792f3d18622 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:27.657277 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786c359-4a81-4698-ae02-7792f3d18622 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:27.657894 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786c359-4a81-4698-ae02-7792f3d18622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:27.683976 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-5786c359-4a81-4698-ae02-7792f3d18622 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:27.685312 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-5786c359-4a81-4698-ae02-7792f3d18622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:27.731008 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:27.794720 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd7d2c-5fea-4818-ad39-4b3b15dd6f10 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:27.848152 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 930/1862] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:27.848897 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786c359-4a81-4698-ae02-7792f3d18622 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:27.861366 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-5786c359-4a81-4698-ae02-7792f3d18622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:27.888918 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786c359-4a81-4698-ae02-7792f3d18622 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:27.898479 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71cd55-0000-4411-b208-e828ee57331f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:27.899105 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71cd55-0000-4411-b208-e828ee57331f admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:27.899714 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71cd55-0000-4411-b208-e828ee57331f admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:27.900014 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71cd55-0000-4411-b208-e828ee57331f admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:27.901312 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc71cd55-0000-4411-b208-e828ee57331f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:27.902968 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc71cd55-0000-4411-b208-e828ee57331f admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:27.910758 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480c87d-e1cb-486d-a25b-fd32131b9d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:27.911274 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480c87d-e1cb-486d-a25b-fd32131b9d9c admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:27.911569 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480c87d-e1cb-486d-a25b-fd32131b9d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:27.911825 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480c87d-e1cb-486d-a25b-fd32131b9d9c admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:27.912472 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480c87d-e1cb-486d-a25b-fd32131b9d9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:27.914399 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480c87d-e1cb-486d-a25b-fd32131b9d9c admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:27.928772 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 933/1863] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:27.929893 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71cd55-0000-4411-b208-e828ee57331f admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:27.934399 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-dc71cd55-0000-4411-b208-e828ee57331f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:27.966871 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 931/1864] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:18:27 2022] POST /identity/v3/users => generated 306 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:27.970997 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480c87d-e1cb-486d-a25b-fd32131b9d9c admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:27.996878 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480c87d-e1cb-486d-a25b-fd32131b9d9c admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:28.012155 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea235c0-9ffc-4971-96ad-e14f12b05ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:28.013066 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea235c0-9ffc-4971-96ad-e14f12b05ab1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:28.014186 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea235c0-9ffc-4971-96ad-e14f12b05ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:28.015643 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea235c0-9ffc-4971-96ad-e14f12b05ab1 admin admin] PATH_INFO: `/v3/projects/f84ac1a024b34a18b4fb967f00274388/users/3ba7651f73de447c986fd17c565191c1/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:28.041031 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea235c0-9ffc-4971-96ad-e14f12b05ab1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f84ac1a024b34a18b4fb967f00274388, user_id=3ba7651f73de447c986fd17c565191c1, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:28.044519 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea235c0-9ffc-4971-96ad-e14f12b05ab1 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:28.073889 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 932/1865] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:27 2022] PUT /identity/v3/projects/f84ac1a024b34a18b4fb967f00274388/users/3ba7651f73de447c986fd17c565191c1/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:28.075221 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea235c0-9ffc-4971-96ad-e14f12b05ab1 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:28.085592 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71cd55-0000-4411-b208-e828ee57331f admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:28.179805 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea235c0-9ffc-4971-96ad-e14f12b05ab1 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:28.192107 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965b737-287c-4cd3-b816-9bdc4efa27da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:28.192744 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965b737-287c-4cd3-b816-9bdc4efa27da admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:28.193024 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965b737-287c-4cd3-b816-9bdc4efa27da admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:28.195528 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965b737-287c-4cd3-b816-9bdc4efa27da admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:28.197052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:28.198409 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e965b737-287c-4cd3-b816-9bdc4efa27da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:28.207982 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e965b737-287c-4cd3-b816-9bdc4efa27da admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:28.227217 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5adb6f-bc4e-492f-9af4-19c005e34e74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:28.229786 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5adb6f-bc4e-492f-9af4-19c005e34e74 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:28.231214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5adb6f-bc4e-492f-9af4-19c005e34e74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:28.231592 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5adb6f-bc4e-492f-9af4-19c005e34e74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:28.255735 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 933/1866] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:28.272710 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a5c09-4134-4d1b-8fb7-6d90539da5a4 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:28.273196 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a5c09-4134-4d1b-8fb7-6d90539da5a4 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:28.273736 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a5c09-4134-4d1b-8fb7-6d90539da5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:28.294525 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5adb6f-bc4e-492f-9af4-19c005e34e74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:28.298530 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5adb6f-bc4e-492f-9af4-19c005e34e74 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:28.318000 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 934/1867] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:28.320703 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5adb6f-bc4e-492f-9af4-19c005e34e74 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:28.348264 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5adb6f-bc4e-492f-9af4-19c005e34e74 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:28.365277 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-871a5c09-4134-4d1b-8fb7-6d90539da5a4 None None] MFA Rules not processed for user `3ba7651f73de447c986fd17c565191c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:28.365887 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-871a5c09-4134-4d1b-8fb7-6d90539da5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:28.375397 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e2af3-c9e6-4104-9e91-d044e67a5903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:28.375397 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e2af3-c9e6-4104-9e91-d044e67a5903 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:28.375397 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e2af3-c9e6-4104-9e91-d044e67a5903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:28.375397 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e2af3-c9e6-4104-9e91-d044e67a5903 admin admin] PATH_INFO: `/v3/projects/82112d0d83ca444483c5b304e25ce3a5/users/2bd3e6c11f724aaba81949e35db249b2/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:28.404308 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e2af3-c9e6-4104-9e91-d044e67a5903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82112d0d83ca444483c5b304e25ce3a5, user_id=2bd3e6c11f724aaba81949e35db249b2, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:28.407331 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e2af3-c9e6-4104-9e91-d044e67a5903 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:28.463150 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 935/1868] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:28 2022] PUT /identity/v3/projects/82112d0d83ca444483c5b304e25ce3a5/users/2bd3e6c11f724aaba81949e35db249b2/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:28.468070 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e2af3-c9e6-4104-9e91-d044e67a5903 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:28.493926 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 934/1869] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:28.499243 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a5c09-4134-4d1b-8fb7-6d90539da5a4 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:28.523295 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a5c09-4134-4d1b-8fb7-6d90539da5a4 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:28.599598 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e2af3-c9e6-4104-9e91-d044e67a5903 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:28.617663 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:28.618778 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f35c7-81ba-40c2-9360-7f67adc043a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:28.620006 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f35c7-81ba-40c2-9360-7f67adc043a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:28.620006 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f35c7-81ba-40c2-9360-7f67adc043a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:28.620381 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f35c7-81ba-40c2-9360-7f67adc043a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:28.622001 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f35c7-81ba-40c2-9360-7f67adc043a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:28.637153 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f35c7-81ba-40c2-9360-7f67adc043a6 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:28.655888 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 936/1870] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:28.661400 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f35c7-81ba-40c2-9360-7f67adc043a6 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:28.672564 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f35c7-81ba-40c2-9360-7f67adc043a6 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:28.680620 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcfc939-f68f-47d4-9a9c-84e1b9f5aa27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:28.681514 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfc939-f68f-47d4-9a9c-84e1b9f5aa27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:28.681897 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfc939-f68f-47d4-9a9c-84e1b9f5aa27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:28.682338 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfc939-f68f-47d4-9a9c-84e1b9f5aa27 admin admin] PATH_INFO: `/v3/projects/82112d0d83ca444483c5b304e25ce3a5/users/2bd3e6c11f724aaba81949e35db249b2/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:28.685210 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcfc939-f68f-47d4-9a9c-84e1b9f5aa27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82112d0d83ca444483c5b304e25ce3a5, user_id=2bd3e6c11f724aaba81949e35db249b2, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:28.690937 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcfc939-f68f-47d4-9a9c-84e1b9f5aa27 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:28.703440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 937/1871] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:28 2022] PUT /identity/v3/projects/82112d0d83ca444483c5b304e25ce3a5/users/2bd3e6c11f724aaba81949e35db249b2/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:28.735076 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46faff0f-1c9f-43d5-abaa-57337abfc63a None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:28.735552 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46faff0f-1c9f-43d5-abaa-57337abfc63a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:28.736229 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46faff0f-1c9f-43d5-abaa-57337abfc63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:28.805789 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0dba5f-ec93-400f-9d26-0979e8aa827b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:28.806674 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0dba5f-ec93-400f-9d26-0979e8aa827b admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:28.806960 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0dba5f-ec93-400f-9d26-0979e8aa827b admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:28.807234 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0dba5f-ec93-400f-9d26-0979e8aa827b admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:28.809388 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0dba5f-ec93-400f-9d26-0979e8aa827b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:28.811823 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0dba5f-ec93-400f-9d26-0979e8aa827b admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:28.816529 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-46faff0f-1c9f-43d5-abaa-57337abfc63a None None] MFA Rules not processed for user `2bd3e6c11f724aaba81949e35db249b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:28.817918 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-46faff0f-1c9f-43d5-abaa-57337abfc63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:28.871850 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 935/1872] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:18:28 2022] POST /identity/v3/projects => generated 367 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:28.874864 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0dba5f-ec93-400f-9d26-0979e8aa827b admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:28.990786 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 938/1873] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:28 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:29.004200 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46faff0f-1c9f-43d5-abaa-57337abfc63a None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:29.010740 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-46faff0f-1c9f-43d5-abaa-57337abfc63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:29.027506 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0dba5f-ec93-400f-9d26-0979e8aa827b admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:29.036871 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6b76f-06da-4467-9df8-551e8175bcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:29.038067 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6b76f-06da-4467-9df8-551e8175bcfe admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:29.038443 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6b76f-06da-4467-9df8-551e8175bcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:29.039690 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6b76f-06da-4467-9df8-551e8175bcfe admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:29.040608 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb6b76f-06da-4467-9df8-551e8175bcfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:29.045373 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb6b76f-06da-4467-9df8-551e8175bcfe admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:29.099656 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:29.113324 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 936/1874] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:18:28 2022] POST /identity/v3/users => generated 290 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:29.115011 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6b76f-06da-4467-9df8-551e8175bcfe admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:29.118019 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-cfb6b76f-06da-4467-9df8-551e8175bcfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:29.130708 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46faff0f-1c9f-43d5-abaa-57337abfc63a None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:29.135200 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6b76f-06da-4467-9df8-551e8175bcfe admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:29.142698 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121af3c-62a6-4475-9715-713289887f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:29.143773 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121af3c-62a6-4475-9715-713289887f71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:29.144017 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121af3c-62a6-4475-9715-713289887f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:29.144184 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121af3c-62a6-4475-9715-713289887f71 admin admin] PATH_INFO: `/v3/projects/ef00d8437ff64996b72766146d2e4c9d` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:29.145524 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121af3c-62a6-4475-9715-713289887f71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef00d8437ff64996b72766146d2e4c9d)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:29.147766 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121af3c-62a6-4475-9715-713289887f71 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:29.210174 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c3902-ee35-44a4-911b-55f5541cbda1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:29.211300 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c3902-ee35-44a4-911b-55f5541cbda1 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:29.211949 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c3902-ee35-44a4-911b-55f5541cbda1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:29.212622 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c3902-ee35-44a4-911b-55f5541cbda1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:29.215990 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-9121af3c-62a6-4475-9715-713289887f71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef00d8437ff64996b72766146d2e4c9d', 'request_id': 'req-9121af3c-62a6-4475-9715-713289887f71'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:29.223067 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-9121af3c-62a6-4475-9715-713289887f71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef00d8437ff64996b72766146d2e4c9d', 'request_id': 'req-9121af3c-62a6-4475-9715-713289887f71'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:29.232641 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-9121af3c-62a6-4475-9715-713289887f71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef00d8437ff64996b72766146d2e4c9d', 'request_id': 'req-9121af3c-62a6-4475-9715-713289887f71'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:29.248928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-9121af3c-62a6-4475-9715-713289887f71 admin admin] The token cache is being invalidate because project ef00d8437ff64996b72766146d2e4c9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:18:29.249276 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-9121af3c-62a6-4475-9715-713289887f71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:29.249934 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-9121af3c-62a6-4475-9715-713289887f71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:29.251501 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 937/1875] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:18:29 2022] DELETE /identity/v3/projects/ef00d8437ff64996b72766146d2e4c9d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:29.255132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121af3c-62a6-4475-9715-713289887f71 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:29.257385 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-9121af3c-62a6-4475-9715-713289887f71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:29.280863 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:29.292598 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c3902-ee35-44a4-911b-55f5541cbda1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:29.294729 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c3902-ee35-44a4-911b-55f5541cbda1 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:29.304318 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 939/1876] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:29 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:29.305349 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c3902-ee35-44a4-911b-55f5541cbda1 service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:29.315641 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c3902-ee35-44a4-911b-55f5541cbda1 service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:29.320901 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2a503-dd15-4cd5-ba5f-6badc1d8cb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:29.321903 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2a503-dd15-4cd5-ba5f-6badc1d8cb77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:29.322356 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2a503-dd15-4cd5-ba5f-6badc1d8cb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:29.323191 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2a503-dd15-4cd5-ba5f-6badc1d8cb77 admin admin] PATH_INFO: `/v3/users/85373384f7bc4d84b9b6cc62d72d8e45` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:29.324418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d2a503-dd15-4cd5-ba5f-6badc1d8cb77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85373384f7bc4d84b9b6cc62d72d8e45)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:29.327163 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d2a503-dd15-4cd5-ba5f-6badc1d8cb77 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:29.327994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121af3c-62a6-4475-9715-713289887f71 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:29.336273 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5079b6b-19b8-45d9-a376-00fcb17a818e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:29.336954 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5079b6b-19b8-45d9-a376-00fcb17a818e admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:29.337221 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5079b6b-19b8-45d9-a376-00fcb17a818e admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:29.337771 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5079b6b-19b8-45d9-a376-00fcb17a818e admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:29.338437 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5079b6b-19b8-45d9-a376-00fcb17a818e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:29.340091 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5079b6b-19b8-45d9-a376-00fcb17a818e admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:29.360484 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 938/1877] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:29.365482 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5079b6b-19b8-45d9-a376-00fcb17a818e admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:29.378405 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5079b6b-19b8-45d9-a376-00fcb17a818e admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:29.384104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0228817-ecde-4e6d-9424-e1b0561558b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:29.384863 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0228817-ecde-4e6d-9424-e1b0561558b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:29.385216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0228817-ecde-4e6d-9424-e1b0561558b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:29.385683 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0228817-ecde-4e6d-9424-e1b0561558b9 admin admin] PATH_INFO: `/v3/projects/b75a9120f9e54fb9933f2d7f8aca7161/users/bfdbad3f3f4d4af297ee7cd1b4c85afc/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:29.404290 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0228817-ecde-4e6d-9424-e1b0561558b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b75a9120f9e54fb9933f2d7f8aca7161, user_id=bfdbad3f3f4d4af297ee7cd1b4c85afc, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:29.405810 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-39d2a503-dd15-4cd5-ba5f-6badc1d8cb77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85373384f7bc4d84b9b6cc62d72d8e45'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:29.407494 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0228817-ecde-4e6d-9424-e1b0561558b9 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:29.416229 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-39d2a503-dd15-4cd5-ba5f-6badc1d8cb77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85373384f7bc4d84b9b6cc62d72d8e45'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:29.421861 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 939/1878] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:29 2022] PUT /identity/v3/projects/b75a9120f9e54fb9933f2d7f8aca7161/users/bfdbad3f3f4d4af297ee7cd1b4c85afc/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:18:29.422814 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0228817-ecde-4e6d-9424-e1b0561558b9 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:29.424759 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-e0228817-ecde-4e6d-9424-e1b0561558b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:29.427028 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-39d2a503-dd15-4cd5-ba5f-6badc1d8cb77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85373384f7bc4d84b9b6cc62d72d8e45'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:29.439172 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-39d2a503-dd15-4cd5-ba5f-6badc1d8cb77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85373384f7bc4d84b9b6cc62d72d8e45'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:29.439928 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-39d2a503-dd15-4cd5-ba5f-6badc1d8cb77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85373384f7bc4d84b9b6cc62d72d8e45'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:29.446232 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 940/1879] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:18:29 2022] DELETE /identity/v3/users/85373384f7bc4d84b9b6cc62d72d8e45 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:29.447291 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2a503-dd15-4cd5-ba5f-6badc1d8cb77 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:29.448598 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-39d2a503-dd15-4cd5-ba5f-6badc1d8cb77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:29.465505 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:29.485039 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0228817-ecde-4e6d-9424-e1b0561558b9 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:29.541575 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1933ed-c00d-4362-a57f-49a70f223444 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:29.542233 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1933ed-c00d-4362-a57f-49a70f223444 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:29.543274 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1933ed-c00d-4362-a57f-49a70f223444 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:29.543274 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1933ed-c00d-4362-a57f-49a70f223444 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:29.545174 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-8d1933ed-c00d-4362-a57f-49a70f223444 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:29.554416 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2a503-dd15-4cd5-ba5f-6badc1d8cb77 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:29.560115 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97dedf-a327-4b22-84ca-59cfa4b37742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:29.560951 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97dedf-a327-4b22-84ca-59cfa4b37742 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:29.561371 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97dedf-a327-4b22-84ca-59cfa4b37742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:29.561799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97dedf-a327-4b22-84ca-59cfa4b37742 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:29.562452 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b97dedf-a327-4b22-84ca-59cfa4b37742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:29.564159 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b97dedf-a327-4b22-84ca-59cfa4b37742 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:29.578800 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 941/1880] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:29.583285 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97dedf-a327-4b22-84ca-59cfa4b37742 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:29.597840 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97dedf-a327-4b22-84ca-59cfa4b37742 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:29.605838 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fe0c7-cba2-4bbc-a42f-e62def22387b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:29.607843 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fe0c7-cba2-4bbc-a42f-e62def22387b admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:29.609232 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fe0c7-cba2-4bbc-a42f-e62def22387b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:29.609609 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fe0c7-cba2-4bbc-a42f-e62def22387b admin admin] PATH_INFO: `/v3/projects/b75a9120f9e54fb9933f2d7f8aca7161/users/bfdbad3f3f4d4af297ee7cd1b4c85afc/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:29.617032 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4fe0c7-cba2-4bbc-a42f-e62def22387b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b75a9120f9e54fb9933f2d7f8aca7161, user_id=bfdbad3f3f4d4af297ee7cd1b4c85afc, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:29.624331 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4fe0c7-cba2-4bbc-a42f-e62def22387b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:29.661807 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 942/1881] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:29 2022] PUT /identity/v3/projects/b75a9120f9e54fb9933f2d7f8aca7161/users/bfdbad3f3f4d4af297ee7cd1b4c85afc/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:29.675400 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bdd2d-4956-43bc-bcdc-600f6f4fb592 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:29.675771 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bdd2d-4956-43bc-bcdc-600f6f4fb592 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:29.676511 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bdd2d-4956-43bc-bcdc-600f6f4fb592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:29.706912 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1933ed-c00d-4362-a57f-49a70f223444 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:29.708566 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1933ed-c00d-4362-a57f-49a70f223444 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:29.719264 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 940/1882] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:29 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:29.742604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-724bdd2d-4956-43bc-bcdc-600f6f4fb592 None None] MFA Rules not processed for user `bfdbad3f3f4d4af297ee7cd1b4c85afc`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:29.743977 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-724bdd2d-4956-43bc-bcdc-600f6f4fb592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:29.862608 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1933ed-c00d-4362-a57f-49a70f223444 service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:29.864093 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-8d1933ed-c00d-4362-a57f-49a70f223444 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:29.874302 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:29.897409 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 943/1883] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:29.898608 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1933ed-c00d-4362-a57f-49a70f223444 service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:29.923100 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724bdd2d-4956-43bc-bcdc-600f6f4fb592 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:29.924848 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-724bdd2d-4956-43bc-bcdc-600f6f4fb592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:30.004558 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd61fcce-7a66-4c37-96d3-f6f0bd2fc78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:30.007405 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61fcce-7a66-4c37-96d3-f6f0bd2fc78c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:30.007914 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61fcce-7a66-4c37-96d3-f6f0bd2fc78c admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:30.008484 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61fcce-7a66-4c37-96d3-f6f0bd2fc78c admin admin] PATH_INFO: `/v3/projects/714f7f86014d45d48206bcc59e814a92` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:30.010853 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd61fcce-7a66-4c37-96d3-f6f0bd2fc78c admin admin] RBAC: Authorizing `identity:delete_project(project_id=714f7f86014d45d48206bcc59e814a92)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:30.013340 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd61fcce-7a66-4c37-96d3-f6f0bd2fc78c admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:30.045167 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724bdd2d-4956-43bc-bcdc-600f6f4fb592 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:30.057407 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbcc205-2298-46a6-973e-86024f4e4261 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:30.058167 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcc205-2298-46a6-973e-86024f4e4261 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:30.058468 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcc205-2298-46a6-973e-86024f4e4261 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:30.058781 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcc205-2298-46a6-973e-86024f4e4261 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:30.085548 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbcc205-2298-46a6-973e-86024f4e4261 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:30.088776 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbcc205-2298-46a6-973e-86024f4e4261 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:30.102412 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 944/1884] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:18:30.129375 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-dd61fcce-7a66-4c37-96d3-f6f0bd2fc78c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '714f7f86014d45d48206bcc59e814a92', 'request_id': 'req-dd61fcce-7a66-4c37-96d3-f6f0bd2fc78c'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:30.139668 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-dd61fcce-7a66-4c37-96d3-f6f0bd2fc78c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '714f7f86014d45d48206bcc59e814a92', 'request_id': 'req-dd61fcce-7a66-4c37-96d3-f6f0bd2fc78c'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:30.154020 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-dd61fcce-7a66-4c37-96d3-f6f0bd2fc78c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '714f7f86014d45d48206bcc59e814a92', 'request_id': 'req-dd61fcce-7a66-4c37-96d3-f6f0bd2fc78c'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:30.186264 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-dd61fcce-7a66-4c37-96d3-f6f0bd2fc78c admin admin] The token cache is being invalidate because project 714f7f86014d45d48206bcc59e814a92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:18:30.187114 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-dd61fcce-7a66-4c37-96d3-f6f0bd2fc78c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:30.187935 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-dd61fcce-7a66-4c37-96d3-f6f0bd2fc78c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:30.191284 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 941/1885] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:18:29 2022] DELETE /identity/v3/projects/714f7f86014d45d48206bcc59e814a92 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:18:30.196450 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdaa0b-a542-4fc2-acbe-2f592f3d302b None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:30.197126 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdaa0b-a542-4fc2-acbe-2f592f3d302b None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:30.197126 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdaa0b-a542-4fc2-acbe-2f592f3d302b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:30.227480 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a63fc5-f157-4709-bb1b-a187f44c116e None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:30.228271 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a63fc5-f157-4709-bb1b-a187f44c116e None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:30.228806 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a63fc5-f157-4709-bb1b-a187f44c116e None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:30.230554 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 942/1886] 10.222.0.79 () {54 vars in 921 bytes} [Wed Aug 31 19:18:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:18:30.243039 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-e7bdaa0b-a542-4fc2-acbe-2f592f3d302b None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:30.249563 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e7bdaa0b-a542-4fc2-acbe-2f592f3d302b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:30.249706 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4c539-56fa-424e-916e-8206815108ff None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:30.250568 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4c539-56fa-424e-916e-8206815108ff None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:30.251012 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4c539-56fa-424e-916e-8206815108ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:30.335659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-44b4c539-56fa-424e-916e-8206815108ff None None] MFA Rules not processed for user `1fd6d45d1bc3479da72cb1a1990a6137`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:30.335659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-44b4c539-56fa-424e-916e-8206815108ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:30.344485 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:30.450565 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 945/1887] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:30.451799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bdaa0b-a542-4fc2-acbe-2f592f3d302b None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:30.453296 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e7bdaa0b-a542-4fc2-acbe-2f592f3d302b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:30.555253 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bdaa0b-a542-4fc2-acbe-2f592f3d302b None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:30.574609 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43cf9a-4441-4156-a4d8-f3df1a930e05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:30.575252 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43cf9a-4441-4156-a4d8-f3df1a930e05 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:30.575535 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43cf9a-4441-4156-a4d8-f3df1a930e05 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:30.575811 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43cf9a-4441-4156-a4d8-f3df1a930e05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:30.577601 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4c43cf9a-4441-4156-a4d8-f3df1a930e05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:30.583173 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 943/1888] 10.222.0.79 () {58 vars in 1018 bytes} [Wed Aug 31 19:18:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:18:30.584979 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3e05d-fd2e-4f9e-8e79-a4f82530259a None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:30.585448 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3e05d-fd2e-4f9e-8e79-a4f82530259a None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:30.586678 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3e05d-fd2e-4f9e-8e79-a4f82530259a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:30.617865 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-55c3e05d-fd2e-4f9e-8e79-a4f82530259a None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:30.619884 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-55c3e05d-fd2e-4f9e-8e79-a4f82530259a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:30.630714 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 944/1889] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:30.631722 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3e05d-fd2e-4f9e-8e79-a4f82530259a None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:30.634923 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-55c3e05d-fd2e-4f9e-8e79-a4f82530259a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:30.650285 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3e05d-fd2e-4f9e-8e79-a4f82530259a None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:30.655052 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d7244-c6f1-4581-8c71-7fc0afd77ce6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:30.656261 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d7244-c6f1-4581-8c71-7fc0afd77ce6 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:30.656382 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d7244-c6f1-4581-8c71-7fc0afd77ce6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:30.656750 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d7244-c6f1-4581-8c71-7fc0afd77ce6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:30.662001 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-403d7244-c6f1-4581-8c71-7fc0afd77ce6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:30.668733 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43cf9a-4441-4156-a4d8-f3df1a930e05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:30.670596 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43cf9a-4441-4156-a4d8-f3df1a930e05 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:30.678783 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:30.682267 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 946/1890] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:30 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:30.683210 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43cf9a-4441-4156-a4d8-f3df1a930e05 service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:30.684822 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4c43cf9a-4441-4156-a4d8-f3df1a930e05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:30.702406 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43cf9a-4441-4156-a4d8-f3df1a930e05 service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:30.708968 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a751c7-f928-46dd-ba6b-57b3ba03fb36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:30.709737 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a751c7-f928-46dd-ba6b-57b3ba03fb36 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:30.710074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a751c7-f928-46dd-ba6b-57b3ba03fb36 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:30.710417 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a751c7-f928-46dd-ba6b-57b3ba03fb36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:30.720846 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a751c7-f928-46dd-ba6b-57b3ba03fb36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:30.723653 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a751c7-f928-46dd-ba6b-57b3ba03fb36 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:30.737702 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 947/1891] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:30.741689 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d7244-c6f1-4581-8c71-7fc0afd77ce6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:30.744222 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d7244-c6f1-4581-8c71-7fc0afd77ce6 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:30.750955 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a751c7-f928-46dd-ba6b-57b3ba03fb36 service nova] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:30.758760 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 945/1892] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:30.771844 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a751c7-f928-46dd-ba6b-57b3ba03fb36 service nova] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:30.788130 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8cd6d-8b93-4422-bbfb-5473e8436048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:30.788868 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8cd6d-8b93-4422-bbfb-5473e8436048 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:30.789250 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8cd6d-8b93-4422-bbfb-5473e8436048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:30.789733 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8cd6d-8b93-4422-bbfb-5473e8436048 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:30.790647 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8cd6d-8b93-4422-bbfb-5473e8436048 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:18:30.791060 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8cd6d-8b93-4422-bbfb-5473e8436048 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:30.793053 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8cd6d-8b93-4422-bbfb-5473e8436048 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:30.825224 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d7244-c6f1-4581-8c71-7fc0afd77ce6 service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:30.828894 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 948/1893] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:18:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:18:30.843585 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d7244-c6f1-4581-8c71-7fc0afd77ce6 service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:30.851941 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99441792-7244-4ef9-93e1-7930381ac82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:30.852789 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99441792-7244-4ef9-93e1-7930381ac82d admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:30.853169 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99441792-7244-4ef9-93e1-7930381ac82d admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:30.853613 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99441792-7244-4ef9-93e1-7930381ac82d admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:30.854509 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99441792-7244-4ef9-93e1-7930381ac82d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:30.858495 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99441792-7244-4ef9-93e1-7930381ac82d admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:30.920986 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 946/1894] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:18:30 2022] POST /identity/v3/projects => generated 363 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:30.926942 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8cd6d-8b93-4422-bbfb-5473e8436048 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:30.942164 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8cd6d-8b93-4422-bbfb-5473e8436048 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:30.978660 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99441792-7244-4ef9-93e1-7930381ac82d admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:30.980942 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-99441792-7244-4ef9-93e1-7930381ac82d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:31.063923 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:31.092273 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abda2c6-fd23-429f-910d-acd18c142810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:31.092444 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99441792-7244-4ef9-93e1-7930381ac82d admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:31.093384 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abda2c6-fd23-429f-910d-acd18c142810 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:31.094031 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abda2c6-fd23-429f-910d-acd18c142810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:31.094685 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abda2c6-fd23-429f-910d-acd18c142810 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:31.096082 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abda2c6-fd23-429f-910d-acd18c142810 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:31.098957 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abda2c6-fd23-429f-910d-acd18c142810 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:31.100711 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ba0ba-9b9b-42d5-8629-fad6a8a75f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:31.101564 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ba0ba-9b9b-42d5-8629-fad6a8a75f75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:31.102824 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ba0ba-9b9b-42d5-8629-fad6a8a75f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:31.103257 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ba0ba-9b9b-42d5-8629-fad6a8a75f75 admin admin] PATH_INFO: `/v3/users/c93675882aca4597947fecbbf611a722` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:31.104694 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ba0ba-9b9b-42d5-8629-fad6a8a75f75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c93675882aca4597947fecbbf611a722)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:31.108660 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ba0ba-9b9b-42d5-8629-fad6a8a75f75 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:31.133127 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 949/1895] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:18:30 2022] POST /identity/v3/users => generated 282 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:31.135440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abda2c6-fd23-429f-910d-acd18c142810 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:31.150551 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abda2c6-fd23-429f-910d-acd18c142810 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:31.158268 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27465f08-c15b-42ba-8b71-c4cca04ad236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:31.159476 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27465f08-c15b-42ba-8b71-c4cca04ad236 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:31.159988 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27465f08-c15b-42ba-8b71-c4cca04ad236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:31.160451 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27465f08-c15b-42ba-8b71-c4cca04ad236 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:31.161496 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27465f08-c15b-42ba-8b71-c4cca04ad236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:31.163318 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27465f08-c15b-42ba-8b71-c4cca04ad236 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:31.171071 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-128ba0ba-9b9b-42d5-8629-fad6a8a75f75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c93675882aca4597947fecbbf611a722'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:31.172200 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-128ba0ba-9b9b-42d5-8629-fad6a8a75f75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c93675882aca4597947fecbbf611a722'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:31.180149 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 950/1896] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:31.181050 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27465f08-c15b-42ba-8b71-c4cca04ad236 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:31.188745 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-128ba0ba-9b9b-42d5-8629-fad6a8a75f75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c93675882aca4597947fecbbf611a722'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:31.198305 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27465f08-c15b-42ba-8b71-c4cca04ad236 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:31.199533 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-128ba0ba-9b9b-42d5-8629-fad6a8a75f75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c93675882aca4597947fecbbf611a722'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:31.205057 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af6f50-20db-45be-a8b8-a788332aa845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:31.206128 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af6f50-20db-45be-a8b8-a788332aa845 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:31.206683 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af6f50-20db-45be-a8b8-a788332aa845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:31.206935 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af6f50-20db-45be-a8b8-a788332aa845 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:31.208628 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af6f50-20db-45be-a8b8-a788332aa845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:31.210478 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af6f50-20db-45be-a8b8-a788332aa845 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:31.210758 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-128ba0ba-9b9b-42d5-8629-fad6a8a75f75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c93675882aca4597947fecbbf611a722'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:31.223308 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 951/1897] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:31.228396 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 947/1898] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:18:30 2022] DELETE /identity/v3/users/c93675882aca4597947fecbbf611a722 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:31.229252 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af6f50-20db-45be-a8b8-a788332aa845 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:31.231487 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-28af6f50-20db-45be-a8b8-a788332aa845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:31.233023 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacbed83-7ba3-434b-a6f8-dc82af651fd7 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:31.233292 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacbed83-7ba3-434b-a6f8-dc82af651fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:31.233548 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacbed83-7ba3-434b-a6f8-dc82af651fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:31.245575 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af6f50-20db-45be-a8b8-a788332aa845 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:31.278784 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-cacbed83-7ba3-434b-a6f8-dc82af651fd7 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:31.281071 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-cacbed83-7ba3-434b-a6f8-dc82af651fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:31.327114 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:31.334367 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02172eef-a56b-4154-8d4b-a1c7bde166b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:31.339237 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02172eef-a56b-4154-8d4b-a1c7bde166b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:31.339660 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02172eef-a56b-4154-8d4b-a1c7bde166b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:31.339835 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02172eef-a56b-4154-8d4b-a1c7bde166b1 admin admin] PATH_INFO: `/v3/projects/55d29151e3454dd4b6f95c29522ffd1e/users/ea49b24f9dae49beb209a3ddeb670a8d/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:31.361064 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02172eef-a56b-4154-8d4b-a1c7bde166b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55d29151e3454dd4b6f95c29522ffd1e, user_id=ea49b24f9dae49beb209a3ddeb670a8d, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:31.364734 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02172eef-a56b-4154-8d4b-a1c7bde166b1 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:31.387720 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 952/1899] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:31 2022] PUT /identity/v3/projects/55d29151e3454dd4b6f95c29522ffd1e/users/ea49b24f9dae49beb209a3ddeb670a8d/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:18:31.400257 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aafc6b5-8026-4974-86dc-d64f365e5aed None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:31.400555 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aafc6b5-8026-4974-86dc-d64f365e5aed None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:31.401067 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aafc6b5-8026-4974-86dc-d64f365e5aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:31.421730 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 948/1900] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:31.433000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacbed83-7ba3-434b-a6f8-dc82af651fd7 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:31.434430 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-cacbed83-7ba3-434b-a6f8-dc82af651fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:31.438747 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-7aafc6b5-8026-4974-86dc-d64f365e5aed None None] MFA Rules not processed for user `ea49b24f9dae49beb209a3ddeb670a8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:31.440860 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7aafc6b5-8026-4974-86dc-d64f365e5aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:31.512686 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacbed83-7ba3-434b-a6f8-dc82af651fd7 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:31.539620 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 953/1901] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:18:31.545942 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aafc6b5-8026-4974-86dc-d64f365e5aed None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:31.571338 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0072f-7055-489e-96d0-5cb4af7e5b23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:31.571986 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0072f-7055-489e-96d0-5cb4af7e5b23 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:31.572267 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0072f-7055-489e-96d0-5cb4af7e5b23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:31.572542 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0072f-7055-489e-96d0-5cb4af7e5b23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:31.601004 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:31.660317 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aafc6b5-8026-4974-86dc-d64f365e5aed None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:31.670713 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e0072f-7055-489e-96d0-5cb4af7e5b23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:31.672273 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e0072f-7055-489e-96d0-5cb4af7e5b23 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:31.679944 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b84260-eaa9-45de-b17c-1e30719963c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:31.680793 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b84260-eaa9-45de-b17c-1e30719963c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:31.681472 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b84260-eaa9-45de-b17c-1e30719963c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:31.681984 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b84260-eaa9-45de-b17c-1e30719963c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:31.682815 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b84260-eaa9-45de-b17c-1e30719963c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:31.685623 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b84260-eaa9-45de-b17c-1e30719963c4 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:31.709315 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 949/1902] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:18:31.763070 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0072f-7055-489e-96d0-5cb4af7e5b23 service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:31.763274 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 954/1903] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:18:31 2022] POST /identity/v3/projects => generated 365 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:31.782778 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0072f-7055-489e-96d0-5cb4af7e5b23 service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:31.831036 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:31.925339 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a0d5b-69c8-4468-b334-f7599374fb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:31.926054 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a0d5b-69c8-4468-b334-f7599374fb54 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:31.926255 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a0d5b-69c8-4468-b334-f7599374fb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:31.926606 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a0d5b-69c8-4468-b334-f7599374fb54 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:31.927610 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a0d5b-69c8-4468-b334-f7599374fb54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:31.929764 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a0d5b-69c8-4468-b334-f7599374fb54 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:31.962424 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 950/1904] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:18:31 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:31.966348 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b84260-eaa9-45de-b17c-1e30719963c4 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:31.981832 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b84260-eaa9-45de-b17c-1e30719963c4 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:31.999162 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91741e7-7c3a-4b8e-ab39-72b89743fa3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:32.000317 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91741e7-7c3a-4b8e-ab39-72b89743fa3a admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:32.000729 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91741e7-7c3a-4b8e-ab39-72b89743fa3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:32.001126 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91741e7-7c3a-4b8e-ab39-72b89743fa3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:32.001979 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91741e7-7c3a-4b8e-ab39-72b89743fa3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:32.004069 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91741e7-7c3a-4b8e-ab39-72b89743fa3a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:32.018201 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 955/1905] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:18:32.024290 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a0d5b-69c8-4468-b334-f7599374fb54 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:32.040530 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a0d5b-69c8-4468-b334-f7599374fb54 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:32.054856 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b510c-f84b-4431-852c-5d2094b3cb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:32.055708 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b510c-f84b-4431-852c-5d2094b3cb49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:32.056110 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b510c-f84b-4431-852c-5d2094b3cb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:32.056385 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b510c-f84b-4431-852c-5d2094b3cb49 admin admin] PATH_INFO: `/v3/projects/a88a7fd4772c4082a345b382d443913e/users/99582df633474f3cbae7ff807dda2d83/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:32.076111 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b510c-f84b-4431-852c-5d2094b3cb49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a88a7fd4772c4082a345b382d443913e, user_id=99582df633474f3cbae7ff807dda2d83, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:32.079081 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b510c-f84b-4431-852c-5d2094b3cb49 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:32.107193 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 951/1906] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:32 2022] PUT /identity/v3/projects/a88a7fd4772c4082a345b382d443913e/users/99582df633474f3cbae7ff807dda2d83/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:32.108209 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91741e7-7c3a-4b8e-ab39-72b89743fa3a admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:32.123560 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91741e7-7c3a-4b8e-ab39-72b89743fa3a admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:32.196312 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a180cb1-b95e-4877-b0a7-11cd8b61579e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:32.197052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a180cb1-b95e-4877-b0a7-11cd8b61579e admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:32.197251 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a180cb1-b95e-4877-b0a7-11cd8b61579e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:32.197595 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a180cb1-b95e-4877-b0a7-11cd8b61579e admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:32.198369 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a180cb1-b95e-4877-b0a7-11cd8b61579e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:32.200380 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a180cb1-b95e-4877-b0a7-11cd8b61579e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:32.214791 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 956/1907] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:18:32.218863 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b510c-f84b-4431-852c-5d2094b3cb49 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:32.233911 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b510c-f84b-4431-852c-5d2094b3cb49 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:32.242463 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc697b-db6a-4f1d-8a4f-4cb39c8b8c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:32.243225 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc697b-db6a-4f1d-8a4f-4cb39c8b8c01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:32.243509 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc697b-db6a-4f1d-8a4f-4cb39c8b8c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:32.243786 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc697b-db6a-4f1d-8a4f-4cb39c8b8c01 admin admin] PATH_INFO: `/v3/projects/a88a7fd4772c4082a345b382d443913e/users/99582df633474f3cbae7ff807dda2d83/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:32.246965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc697b-db6a-4f1d-8a4f-4cb39c8b8c01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a88a7fd4772c4082a345b382d443913e, user_id=99582df633474f3cbae7ff807dda2d83, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:32.250215 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc697b-db6a-4f1d-8a4f-4cb39c8b8c01 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:32.273709 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 952/1908] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:32 2022] PUT /identity/v3/projects/a88a7fd4772c4082a345b382d443913e/users/99582df633474f3cbae7ff807dda2d83/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:32.281244 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908073a-ff91-4823-8fa1-b4aba469303b None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:32.281541 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908073a-ff91-4823-8fa1-b4aba469303b None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:32.281822 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908073a-ff91-4823-8fa1-b4aba469303b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:32.291228 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc697b-db6a-4f1d-8a4f-4cb39c8b8c01 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:32.293716 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-44cc697b-db6a-4f1d-8a4f-4cb39c8b8c01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:32.318399 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-d908073a-ff91-4823-8fa1-b4aba469303b None None] MFA Rules not processed for user `99582df633474f3cbae7ff807dda2d83`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:32.319863 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d908073a-ff91-4823-8fa1-b4aba469303b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:32.431134 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc697b-db6a-4f1d-8a4f-4cb39c8b8c01 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:32.443263 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97712089-c8d0-4470-b708-90b6032d3e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:32.443937 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97712089-c8d0-4470-b708-90b6032d3e46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:32.444577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97712089-c8d0-4470-b708-90b6032d3e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:32.445891 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97712089-c8d0-4470-b708-90b6032d3e46 admin admin] PATH_INFO: `/v3/projects/12780e57c1084b889f58882232078614` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:32.447978 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97712089-c8d0-4470-b708-90b6032d3e46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12780e57c1084b889f58882232078614)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:32.450624 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97712089-c8d0-4470-b708-90b6032d3e46 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:32.466968 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 957/1909] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:32 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:32.532084 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-97712089-c8d0-4470-b708-90b6032d3e46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12780e57c1084b889f58882232078614', 'request_id': 'req-97712089-c8d0-4470-b708-90b6032d3e46'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:32.539778 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908073a-ff91-4823-8fa1-b4aba469303b None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:32.541400 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d908073a-ff91-4823-8fa1-b4aba469303b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:32.551122 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-97712089-c8d0-4470-b708-90b6032d3e46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12780e57c1084b889f58882232078614', 'request_id': 'req-97712089-c8d0-4470-b708-90b6032d3e46'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:32.563319 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-97712089-c8d0-4470-b708-90b6032d3e46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12780e57c1084b889f58882232078614', 'request_id': 'req-97712089-c8d0-4470-b708-90b6032d3e46'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:32.585797 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:32.590145 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-97712089-c8d0-4470-b708-90b6032d3e46 admin admin] The token cache is being invalidate because project 12780e57c1084b889f58882232078614 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:18:32.590794 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-97712089-c8d0-4470-b708-90b6032d3e46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:32.594339 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-97712089-c8d0-4470-b708-90b6032d3e46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:32.596641 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 953/1910] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:18:32 2022] DELETE /identity/v3/projects/12780e57c1084b889f58882232078614 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:32.601097 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97712089-c8d0-4470-b708-90b6032d3e46 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:32.602933 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-97712089-c8d0-4470-b708-90b6032d3e46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:32.609765 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:32.626924 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908073a-ff91-4823-8fa1-b4aba469303b None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:32.695627 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97712089-c8d0-4470-b708-90b6032d3e46 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:32.700484 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1949211-f906-4c7d-8e98-c993e3252d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:32.701148 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1949211-f906-4c7d-8e98-c993e3252d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:32.701434 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1949211-f906-4c7d-8e98-c993e3252d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:32.701711 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1949211-f906-4c7d-8e98-c993e3252d9a admin admin] PATH_INFO: `/v3/users/83fcd5a3a5984363a0bdc1872b57d313` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:32.702988 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1949211-f906-4c7d-8e98-c993e3252d9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=83fcd5a3a5984363a0bdc1872b57d313)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:32.703213 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbfa1e7-a285-4f23-af5a-1237cb7ad5b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:32.704174 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfa1e7-a285-4f23-af5a-1237cb7ad5b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:32.704929 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1949211-f906-4c7d-8e98-c993e3252d9a admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:32.706917 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfa1e7-a285-4f23-af5a-1237cb7ad5b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:32.707370 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfa1e7-a285-4f23-af5a-1237cb7ad5b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:32.714448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1fbfa1e7-a285-4f23-af5a-1237cb7ad5b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:32.822736 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-c1949211-f906-4c7d-8e98-c993e3252d9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83fcd5a3a5984363a0bdc1872b57d313'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:32.823484 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-c1949211-f906-4c7d-8e98-c993e3252d9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83fcd5a3a5984363a0bdc1872b57d313'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:32.843897 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-c1949211-f906-4c7d-8e98-c993e3252d9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83fcd5a3a5984363a0bdc1872b57d313'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:32.856805 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-c1949211-f906-4c7d-8e98-c993e3252d9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83fcd5a3a5984363a0bdc1872b57d313'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:32.879018 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbfa1e7-a285-4f23-af5a-1237cb7ad5b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:32.881187 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbfa1e7-a285-4f23-af5a-1237cb7ad5b5 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:32.887600 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-c1949211-f906-4c7d-8e98-c993e3252d9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83fcd5a3a5984363a0bdc1872b57d313'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:32.897264 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 954/1911] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:18:32 2022] DELETE /identity/v3/users/83fcd5a3a5984363a0bdc1872b57d313 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:32.906171 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 958/1912] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:32 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:18:33.149817 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1949211-f906-4c7d-8e98-c993e3252d9a admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:33.151544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-c1949211-f906-4c7d-8e98-c993e3252d9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:33.253379 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1949211-f906-4c7d-8e98-c993e3252d9a admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:33.258984 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea39f4d-eb87-44e7-aaa9-51952b325947 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:33.259852 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea39f4d-eb87-44e7-aaa9-51952b325947 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:33.260333 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea39f4d-eb87-44e7-aaa9-51952b325947 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:33.260943 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea39f4d-eb87-44e7-aaa9-51952b325947 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:33.264404 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-6ea39f4d-eb87-44e7-aaa9-51952b325947 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:33.318885 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:33.363912 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea39f4d-eb87-44e7-aaa9-51952b325947 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:33.365656 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea39f4d-eb87-44e7-aaa9-51952b325947 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:33.376840 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 955/1913] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:33.451716 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbfa1e7-a285-4f23-af5a-1237cb7ad5b5 service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:33.464301 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbfa1e7-a285-4f23-af5a-1237cb7ad5b5 service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:33.590953 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50765f9a-aa7f-4a42-bb81-e8c4075fec75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:33.591616 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50765f9a-aa7f-4a42-bb81-e8c4075fec75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:33.591944 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50765f9a-aa7f-4a42-bb81-e8c4075fec75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:33.594886 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50765f9a-aa7f-4a42-bb81-e8c4075fec75 admin admin] PATH_INFO: `/v3/projects/3b3225f247194c74b64deb7ba7f3dcb2` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:33.597099 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50765f9a-aa7f-4a42-bb81-e8c4075fec75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b3225f247194c74b64deb7ba7f3dcb2)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:33.599961 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50765f9a-aa7f-4a42-bb81-e8c4075fec75 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:33.638311 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:33.652144 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-50765f9a-aa7f-4a42-bb81-e8c4075fec75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b3225f247194c74b64deb7ba7f3dcb2', 'request_id': 'req-50765f9a-aa7f-4a42-bb81-e8c4075fec75'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:33.658259 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-50765f9a-aa7f-4a42-bb81-e8c4075fec75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b3225f247194c74b64deb7ba7f3dcb2', 'request_id': 'req-50765f9a-aa7f-4a42-bb81-e8c4075fec75'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:33.664863 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-50765f9a-aa7f-4a42-bb81-e8c4075fec75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b3225f247194c74b64deb7ba7f3dcb2', 'request_id': 'req-50765f9a-aa7f-4a42-bb81-e8c4075fec75'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:33.678058 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-50765f9a-aa7f-4a42-bb81-e8c4075fec75 admin admin] The token cache is being invalidate because project 3b3225f247194c74b64deb7ba7f3dcb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:18:33.678344 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-50765f9a-aa7f-4a42-bb81-e8c4075fec75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:33.679017 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-50765f9a-aa7f-4a42-bb81-e8c4075fec75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:33.680539 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 959/1914] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:18:33 2022] DELETE /identity/v3/projects/3b3225f247194c74b64deb7ba7f3dcb2 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:33.685477 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d898c3e-8a1d-4725-83da-b69f4ce1af9e None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:33.685812 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d898c3e-8a1d-4725-83da-b69f4ce1af9e None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:33.686379 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d898c3e-8a1d-4725-83da-b69f4ce1af9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:33.707038 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-7d898c3e-8a1d-4725-83da-b69f4ce1af9e None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:33.708299 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-7d898c3e-8a1d-4725-83da-b69f4ce1af9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:33.769688 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 956/1915] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:33.778417 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b06716-5328-43ce-a622-cc0d39dded00 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:33.779045 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b06716-5328-43ce-a622-cc0d39dded00 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:33.779446 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b06716-5328-43ce-a622-cc0d39dded00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:33.802093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-08b06716-5328-43ce-a622-cc0d39dded00 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:33.803356 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-08b06716-5328-43ce-a622-cc0d39dded00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:33.811942 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 960/1916] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:18:33.816570 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d898c3e-8a1d-4725-83da-b69f4ce1af9e None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:33.829639 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d898c3e-8a1d-4725-83da-b69f4ce1af9e None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:33.835895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580dc00-51d8-4e35-9206-315b7a164eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:33.836602 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580dc00-51d8-4e35-9206-315b7a164eab admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:33.837276 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580dc00-51d8-4e35-9206-315b7a164eab admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:33.837386 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580dc00-51d8-4e35-9206-315b7a164eab admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:33.838154 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1580dc00-51d8-4e35-9206-315b7a164eab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:18:33.838986 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1580dc00-51d8-4e35-9206-315b7a164eab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:33.840503 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1580dc00-51d8-4e35-9206-315b7a164eab admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:33.858483 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 957/1917] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:18:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:18:33.860253 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b06716-5328-43ce-a622-cc0d39dded00 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:33.879687 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b06716-5328-43ce-a622-cc0d39dded00 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:33.885190 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0960ef1c-9bbe-4177-9df5-d26f86062e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:33.886526 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960ef1c-9bbe-4177-9df5-d26f86062e64 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:33.887363 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960ef1c-9bbe-4177-9df5-d26f86062e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:33.887846 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960ef1c-9bbe-4177-9df5-d26f86062e64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:33.888841 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0960ef1c-9bbe-4177-9df5-d26f86062e64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:33.891984 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0960ef1c-9bbe-4177-9df5-d26f86062e64 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:33.933375 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 961/1918] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:18:33 2022] POST /identity/v3/projects => generated 387 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:33.939379 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580dc00-51d8-4e35-9206-315b7a164eab admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:33.951863 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580dc00-51d8-4e35-9206-315b7a164eab admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:34.024835 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f7ce06-581e-4573-8ea5-0b9cbd7c99e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:34.025454 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7ce06-581e-4573-8ea5-0b9cbd7c99e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:34.025738 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7ce06-581e-4573-8ea5-0b9cbd7c99e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:34.026017 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7ce06-581e-4573-8ea5-0b9cbd7c99e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:34.026877 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f7ce06-581e-4573-8ea5-0b9cbd7c99e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:34.028794 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f7ce06-581e-4573-8ea5-0b9cbd7c99e9 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:34.073661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 958/1919] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:18:33 2022] POST /identity/v3/users => generated 294 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:34.079076 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0960ef1c-9bbe-4177-9df5-d26f86062e64 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:34.092694 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0960ef1c-9bbe-4177-9df5-d26f86062e64 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:34.099623 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e66f7-3963-48fb-bcf6-6b073496b8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:34.101597 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e66f7-3963-48fb-bcf6-6b073496b8c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:34.101881 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e66f7-3963-48fb-bcf6-6b073496b8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:34.102197 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e66f7-3963-48fb-bcf6-6b073496b8c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:34.102915 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e66f7-3963-48fb-bcf6-6b073496b8c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:34.105345 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e66f7-3963-48fb-bcf6-6b073496b8c4 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:34.126689 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 962/1920] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:34.127872 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f7ce06-581e-4573-8ea5-0b9cbd7c99e9 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:34.146071 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f7ce06-581e-4573-8ea5-0b9cbd7c99e9 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:34.153760 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51076b6a-6180-40df-951d-83a751c297cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:34.155072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51076b6a-6180-40df-951d-83a751c297cf admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:34.155740 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51076b6a-6180-40df-951d-83a751c297cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:34.156338 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51076b6a-6180-40df-951d-83a751c297cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:34.157412 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51076b6a-6180-40df-951d-83a751c297cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:34.159875 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51076b6a-6180-40df-951d-83a751c297cf admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:34.188621 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 959/1921] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:34.193503 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e66f7-3963-48fb-bcf6-6b073496b8c4 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:34.205048 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e66f7-3963-48fb-bcf6-6b073496b8c4 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:34.210808 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9305760-9753-4ebd-9719-c6cd2b544cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:34.211671 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9305760-9753-4ebd-9719-c6cd2b544cac admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:34.211955 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9305760-9753-4ebd-9719-c6cd2b544cac admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:34.212254 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9305760-9753-4ebd-9719-c6cd2b544cac admin admin] PATH_INFO: `/v3/projects/a9482093e65b431f86d820d5211ab486/users/0a19b4a13271418fb9ab2674549b5453/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:34.229807 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9305760-9753-4ebd-9719-c6cd2b544cac admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9482093e65b431f86d820d5211ab486, user_id=0a19b4a13271418fb9ab2674549b5453, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:34.233182 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9305760-9753-4ebd-9719-c6cd2b544cac admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:34.250927 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 963/1922] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:34 2022] PUT /identity/v3/projects/a9482093e65b431f86d820d5211ab486/users/0a19b4a13271418fb9ab2674549b5453/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:18:34.262748 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6bfa23-65d0-425f-83a2-e06500d23926 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:34.263042 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6bfa23-65d0-425f-83a2-e06500d23926 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:34.263764 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6bfa23-65d0-425f-83a2-e06500d23926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:34.301390 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-8f6bfa23-65d0-425f-83a2-e06500d23926 None None] MFA Rules not processed for user `0a19b4a13271418fb9ab2674549b5453`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:34.303119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-8f6bfa23-65d0-425f-83a2-e06500d23926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:34.348009 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:34.416152 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 960/1923] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:34.420853 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9305760-9753-4ebd-9719-c6cd2b544cac admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:34.524072 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9305760-9753-4ebd-9719-c6cd2b544cac admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:34.536702 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbcb679-753f-4170-9028-4db08b612cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:34.537436 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcb679-753f-4170-9028-4db08b612cda admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:34.538228 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcb679-753f-4170-9028-4db08b612cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:34.538228 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcb679-753f-4170-9028-4db08b612cda admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:34.538820 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbcb679-753f-4170-9028-4db08b612cda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:34.541209 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbcb679-753f-4170-9028-4db08b612cda admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:34.590150 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 964/1924] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:18:34 2022] POST /identity/v3/projects => generated 387 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:34.595235 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6bfa23-65d0-425f-83a2-e06500d23926 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:34.610822 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6bfa23-65d0-425f-83a2-e06500d23926 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:34.741390 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b18cb3a-97c8-4ddb-847f-bb46ee8de423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:34.742163 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18cb3a-97c8-4ddb-847f-bb46ee8de423 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:34.742625 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18cb3a-97c8-4ddb-847f-bb46ee8de423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:34.743505 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18cb3a-97c8-4ddb-847f-bb46ee8de423 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:34.743838 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b18cb3a-97c8-4ddb-847f-bb46ee8de423 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:34.746055 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b18cb3a-97c8-4ddb-847f-bb46ee8de423 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:34.785747 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 961/1925] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:18:34 2022] POST /identity/v3/users => generated 294 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:34.789720 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbcb679-753f-4170-9028-4db08b612cda admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:34.805950 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbcb679-753f-4170-9028-4db08b612cda admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:34.818008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf3236-fa74-4a6e-b27f-fb966b13155f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:34.818682 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf3236-fa74-4a6e-b27f-fb966b13155f admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:34.819226 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf3236-fa74-4a6e-b27f-fb966b13155f admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:34.820761 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf3236-fa74-4a6e-b27f-fb966b13155f admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:34.821616 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf3236-fa74-4a6e-b27f-fb966b13155f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:34.824327 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf3236-fa74-4a6e-b27f-fb966b13155f admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:34.847381 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 965/1926] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:34.852329 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b18cb3a-97c8-4ddb-847f-bb46ee8de423 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:34.866596 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b18cb3a-97c8-4ddb-847f-bb46ee8de423 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:34.875848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac49c8e-f71c-4b22-8c03-547807623bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:34.879245 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac49c8e-f71c-4b22-8c03-547807623bdd admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:34.879788 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac49c8e-f71c-4b22-8c03-547807623bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:34.880170 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac49c8e-f71c-4b22-8c03-547807623bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:34.881332 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac49c8e-f71c-4b22-8c03-547807623bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:34.882806 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac49c8e-f71c-4b22-8c03-547807623bdd admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:34.896804 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 962/1927] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:34.901813 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf3236-fa74-4a6e-b27f-fb966b13155f admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:34.928196 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf3236-fa74-4a6e-b27f-fb966b13155f admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:34.943360 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac49c8e-f71c-4b22-8c03-547807623bdd admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:34.945288 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-6ac49c8e-f71c-4b22-8c03-547807623bdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:34.948153 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c4290-0165-45d4-bcee-7ee6a34c085e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:34.949885 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c4290-0165-45d4-bcee-7ee6a34c085e admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:34.950446 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c4290-0165-45d4-bcee-7ee6a34c085e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:34.950966 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c4290-0165-45d4-bcee-7ee6a34c085e admin admin] PATH_INFO: `/v3/projects/610ae6f02c4e453c9246d5623aec11bf/users/627763e338444f0392b54b87f223bd98/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:34.960374 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac49c8e-f71c-4b22-8c03-547807623bdd admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:34.966050 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac28b7-cab5-4db0-bcc6-fe2a4962192c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:34.966663 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac28b7-cab5-4db0-bcc6-fe2a4962192c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:34.967019 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac28b7-cab5-4db0-bcc6-fe2a4962192c admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:34.967301 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac28b7-cab5-4db0-bcc6-fe2a4962192c admin admin] PATH_INFO: `/v3/users/90eb7167ce5b45cf80f6310cde13aa64` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:34.968498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdac28b7-cab5-4db0-bcc6-fe2a4962192c admin admin] RBAC: Authorizing `identity:delete_user(user_id=90eb7167ce5b45cf80f6310cde13aa64)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:34.970439 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdac28b7-cab5-4db0-bcc6-fe2a4962192c admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:34.979519 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c4290-0165-45d4-bcee-7ee6a34c085e admin admin] RBAC: Authorizing `identity:create_grant(project_id=610ae6f02c4e453c9246d5623aec11bf, user_id=627763e338444f0392b54b87f223bd98, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:34.983403 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c4290-0165-45d4-bcee-7ee6a34c085e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:35.003451 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 966/1928] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:34 2022] PUT /identity/v3/projects/610ae6f02c4e453c9246d5623aec11bf/users/627763e338444f0392b54b87f223bd98/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:35.023670 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0f733-9302-42e3-ab84-9d2ad9b16adf None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:35.023961 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0f733-9302-42e3-ab84-9d2ad9b16adf None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:35.024240 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0f733-9302-42e3-ab84-9d2ad9b16adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:35.050120 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cdac28b7-cab5-4db0-bcc6-fe2a4962192c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90eb7167ce5b45cf80f6310cde13aa64'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:35.051017 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cdac28b7-cab5-4db0-bcc6-fe2a4962192c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90eb7167ce5b45cf80f6310cde13aa64'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:35.055569 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:35.085630 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cdac28b7-cab5-4db0-bcc6-fe2a4962192c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90eb7167ce5b45cf80f6310cde13aa64'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:35.097849 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cdac28b7-cab5-4db0-bcc6-fe2a4962192c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90eb7167ce5b45cf80f6310cde13aa64'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:35.102062 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-4db0f733-9302-42e3-ab84-9d2ad9b16adf None None] MFA Rules not processed for user `627763e338444f0392b54b87f223bd98`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:35.103323 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4db0f733-9302-42e3-ab84-9d2ad9b16adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:35.113800 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cdac28b7-cab5-4db0-bcc6-fe2a4962192c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90eb7167ce5b45cf80f6310cde13aa64'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:35.135076 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 963/1929] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:18:34 2022] DELETE /identity/v3/users/90eb7167ce5b45cf80f6310cde13aa64 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:18:35.140313 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386a375-6914-4d21-9851-1596b6dead94 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:35.141720 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386a375-6914-4d21-9851-1596b6dead94 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:35.144363 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386a375-6914-4d21-9851-1596b6dead94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:35.191738 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-f386a375-6914-4d21-9851-1596b6dead94 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:35.198840 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f386a375-6914-4d21-9851-1596b6dead94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:35.218071 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:35.237172 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 967/1930] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:18:35.242349 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0f733-9302-42e3-ab84-9d2ad9b16adf None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:35.248113 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4db0f733-9302-42e3-ab84-9d2ad9b16adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:35.306771 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 964/1931] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:18:35.310698 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f386a375-6914-4d21-9851-1596b6dead94 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:35.312179 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f386a375-6914-4d21-9851-1596b6dead94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:35.343021 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0f733-9302-42e3-ab84-9d2ad9b16adf None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:35.351304 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2f6e67-8cf0-4e67-83bb-4bca10fccb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:35.352076 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f6e67-8cf0-4e67-83bb-4bca10fccb7b admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:35.352362 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f6e67-8cf0-4e67-83bb-4bca10fccb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:35.352802 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f6e67-8cf0-4e67-83bb-4bca10fccb7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:35.353701 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2f6e67-8cf0-4e67-83bb-4bca10fccb7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:35.356085 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2f6e67-8cf0-4e67-83bb-4bca10fccb7b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:35.384337 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f386a375-6914-4d21-9851-1596b6dead94 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:35.388139 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 968/1932] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:18:35 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:35.389923 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667072c-c0e7-4cb9-9302-4ab6f7c93821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:35.390795 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667072c-c0e7-4cb9-9302-4ab6f7c93821 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:35.391450 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667072c-c0e7-4cb9-9302-4ab6f7c93821 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:35.391928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667072c-c0e7-4cb9-9302-4ab6f7c93821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:35.393030 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2f6e67-8cf0-4e67-83bb-4bca10fccb7b admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:35.403160 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667072c-c0e7-4cb9-9302-4ab6f7c93821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:35.404650 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667072c-c0e7-4cb9-9302-4ab6f7c93821 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:35.415610 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 965/1933] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:35.470710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2f6e67-8cf0-4e67-83bb-4bca10fccb7b admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:35.477024 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b8a6e-b948-4948-8153-a4f76767e608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:35.477736 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b8a6e-b948-4948-8153-a4f76767e608 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:35.478148 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b8a6e-b948-4948-8153-a4f76767e608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:35.478554 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b8a6e-b948-4948-8153-a4f76767e608 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:35.479414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b8a6e-b948-4948-8153-a4f76767e608 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:35.482074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b8a6e-b948-4948-8153-a4f76767e608 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:35.513131 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 969/1934] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:18:35 2022] POST /identity/v3/users => generated 299 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:18:35.517382 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667072c-c0e7-4cb9-9302-4ab6f7c93821 service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:35.537852 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667072c-c0e7-4cb9-9302-4ab6f7c93821 service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:35.543715 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6e985-5edd-4187-8d1f-8f5d893b2924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:35.544402 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6e985-5edd-4187-8d1f-8f5d893b2924 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:35.544759 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6e985-5edd-4187-8d1f-8f5d893b2924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:35.545412 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6e985-5edd-4187-8d1f-8f5d893b2924 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:35.545874 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6e985-5edd-4187-8d1f-8f5d893b2924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:35.548520 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6e985-5edd-4187-8d1f-8f5d893b2924 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:35.567002 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 966/1935] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:35.568362 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b8a6e-b948-4948-8153-a4f76767e608 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:35.579999 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b8a6e-b948-4948-8153-a4f76767e608 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:35.585551 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb9f62-ed21-48df-801b-7caae7a5a258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:35.586346 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb9f62-ed21-48df-801b-7caae7a5a258 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:35.586650 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb9f62-ed21-48df-801b-7caae7a5a258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:35.586967 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb9f62-ed21-48df-801b-7caae7a5a258 admin admin] PATH_INFO: `/v3/projects/c9ac6ae8bc28422898c27649e77bedb8/users/a0c2fa81aad74be8be5e90e1fdb6759c/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:35.597741 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:35.606665 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb9f62-ed21-48df-801b-7caae7a5a258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9ac6ae8bc28422898c27649e77bedb8, user_id=a0c2fa81aad74be8be5e90e1fdb6759c, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:35.609335 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb9f62-ed21-48df-801b-7caae7a5a258 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:35.625205 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 970/1936] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:35 2022] PUT /identity/v3/projects/c9ac6ae8bc28422898c27649e77bedb8/users/a0c2fa81aad74be8be5e90e1fdb6759c/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:35.629057 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6e985-5edd-4187-8d1f-8f5d893b2924 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:35.643250 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6e985-5edd-4187-8d1f-8f5d893b2924 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:35.722501 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284575e-45da-417c-96d7-009f420ad0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:35.723252 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284575e-45da-417c-96d7-009f420ad0d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:35.723579 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284575e-45da-417c-96d7-009f420ad0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:35.723929 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284575e-45da-417c-96d7-009f420ad0d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:35.724555 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284575e-45da-417c-96d7-009f420ad0d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:35.726209 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284575e-45da-417c-96d7-009f420ad0d6 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:35.743461 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 967/1937] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:35.744755 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb9f62-ed21-48df-801b-7caae7a5a258 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:35.763148 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb9f62-ed21-48df-801b-7caae7a5a258 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:35.770183 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52915fb4-b836-4ada-98ca-49b22ae0f90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:35.771117 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52915fb4-b836-4ada-98ca-49b22ae0f90e admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:35.771410 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52915fb4-b836-4ada-98ca-49b22ae0f90e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:35.771730 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52915fb4-b836-4ada-98ca-49b22ae0f90e admin admin] PATH_INFO: `/v3/projects/c9ac6ae8bc28422898c27649e77bedb8/users/a0c2fa81aad74be8be5e90e1fdb6759c/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:35.775018 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52915fb4-b836-4ada-98ca-49b22ae0f90e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9ac6ae8bc28422898c27649e77bedb8, user_id=a0c2fa81aad74be8be5e90e1fdb6759c, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:35.777713 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52915fb4-b836-4ada-98ca-49b22ae0f90e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:35.792454 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 971/1938] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:35 2022] PUT /identity/v3/projects/c9ac6ae8bc28422898c27649e77bedb8/users/a0c2fa81aad74be8be5e90e1fdb6759c/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:18:35.803655 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202933fc-635b-4451-9e71-2b21ed946496 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:35.804310 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202933fc-635b-4451-9e71-2b21ed946496 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:35.804909 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202933fc-635b-4451-9e71-2b21ed946496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:35.841433 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-202933fc-635b-4451-9e71-2b21ed946496 None None] MFA Rules not processed for user `a0c2fa81aad74be8be5e90e1fdb6759c`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:35.843247 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-202933fc-635b-4451-9e71-2b21ed946496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:35.895506 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52915fb4-b836-4ada-98ca-49b22ae0f90e admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:35.897579 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-52915fb4-b836-4ada-98ca-49b22ae0f90e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:35.910416 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:35.974389 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 968/1939] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:35 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:35.986327 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202933fc-635b-4451-9e71-2b21ed946496 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:35.988979 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-202933fc-635b-4451-9e71-2b21ed946496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:36.004789 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52915fb4-b836-4ada-98ca-49b22ae0f90e admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:36.011620 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32dd58a-ebc4-4d83-8fc2-f6f503fb127a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:36.012569 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32dd58a-ebc4-4d83-8fc2-f6f503fb127a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:36.013243 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32dd58a-ebc4-4d83-8fc2-f6f503fb127a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:36.013659 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32dd58a-ebc4-4d83-8fc2-f6f503fb127a admin admin] PATH_INFO: `/v3/projects/46e403fa48dc4a30a55b4ce4684754dd` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:36.015751 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32dd58a-ebc4-4d83-8fc2-f6f503fb127a admin admin] RBAC: Authorizing `identity:delete_project(project_id=46e403fa48dc4a30a55b4ce4684754dd)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:36.018897 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32dd58a-ebc4-4d83-8fc2-f6f503fb127a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:36.090301 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d32dd58a-ebc4-4d83-8fc2-f6f503fb127a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46e403fa48dc4a30a55b4ce4684754dd', 'request_id': 'req-d32dd58a-ebc4-4d83-8fc2-f6f503fb127a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:36.099532 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d32dd58a-ebc4-4d83-8fc2-f6f503fb127a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46e403fa48dc4a30a55b4ce4684754dd', 'request_id': 'req-d32dd58a-ebc4-4d83-8fc2-f6f503fb127a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:36.107516 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d32dd58a-ebc4-4d83-8fc2-f6f503fb127a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46e403fa48dc4a30a55b4ce4684754dd', 'request_id': 'req-d32dd58a-ebc4-4d83-8fc2-f6f503fb127a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:36.117381 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202933fc-635b-4451-9e71-2b21ed946496 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:36.137254 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d32dd58a-ebc4-4d83-8fc2-f6f503fb127a admin admin] The token cache is being invalidate because project 46e403fa48dc4a30a55b4ce4684754dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:18:36.137777 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d32dd58a-ebc4-4d83-8fc2-f6f503fb127a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:36.138675 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d32dd58a-ebc4-4d83-8fc2-f6f503fb127a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:36.144146 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 972/1940] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:18:35 2022] DELETE /identity/v3/projects/46e403fa48dc4a30a55b4ce4684754dd => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:36.145392 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32dd58a-ebc4-4d83-8fc2-f6f503fb127a admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:36.147299 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d32dd58a-ebc4-4d83-8fc2-f6f503fb127a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:36.239476 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32dd58a-ebc4-4d83-8fc2-f6f503fb127a admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:36.243591 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b5114-ef5c-4847-9828-54954d723c4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:36.244213 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b5114-ef5c-4847-9828-54954d723c4b service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:36.245037 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b5114-ef5c-4847-9828-54954d723c4b service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:36.245326 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b5114-ef5c-4847-9828-54954d723c4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:36.248367 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66557650-09f6-421c-ba40-1dbf4f073af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:36.249805 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66557650-09f6-421c-ba40-1dbf4f073af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:36.255958 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-a46b5114-ef5c-4847-9828-54954d723c4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:36.260845 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66557650-09f6-421c-ba40-1dbf4f073af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:36.261690 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66557650-09f6-421c-ba40-1dbf4f073af8 admin admin] PATH_INFO: `/v3/users/2bd3e6c11f724aaba81949e35db249b2` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:36.266718 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66557650-09f6-421c-ba40-1dbf4f073af8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bd3e6c11f724aaba81949e35db249b2)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:36.272261 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66557650-09f6-421c-ba40-1dbf4f073af8 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:36.289399 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:36.357050 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-66557650-09f6-421c-ba40-1dbf4f073af8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bd3e6c11f724aaba81949e35db249b2'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:36.367045 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-66557650-09f6-421c-ba40-1dbf4f073af8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bd3e6c11f724aaba81949e35db249b2'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:36.376304 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-66557650-09f6-421c-ba40-1dbf4f073af8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bd3e6c11f724aaba81949e35db249b2'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:36.377887 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b5114-ef5c-4847-9828-54954d723c4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:36.381012 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b5114-ef5c-4847-9828-54954d723c4b service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:36.395785 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 969/1941] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:35 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:18:36.400766 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-66557650-09f6-421c-ba40-1dbf4f073af8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bd3e6c11f724aaba81949e35db249b2'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:36.401455 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-66557650-09f6-421c-ba40-1dbf4f073af8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bd3e6c11f724aaba81949e35db249b2'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:36.413524 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 973/1942] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:18:36 2022] DELETE /identity/v3/users/2bd3e6c11f724aaba81949e35db249b2 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:36.563731 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b5114-ef5c-4847-9828-54954d723c4b service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:36.565686 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-a46b5114-ef5c-4847-9828-54954d723c4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:36.585122 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b5114-ef5c-4847-9828-54954d723c4b service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:36.650341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:36.671188 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b1f11-9936-477e-abf6-9149919c0f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:36.672407 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b1f11-9936-477e-abf6-9149919c0f1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:36.672976 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b1f11-9936-477e-abf6-9149919c0f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:36.673421 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b1f11-9936-477e-abf6-9149919c0f1b admin admin] PATH_INFO: `/v3/users/3ba7651f73de447c986fd17c565191c1` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:36.675022 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b1f11-9936-477e-abf6-9149919c0f1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ba7651f73de447c986fd17c565191c1)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:36.679471 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b1f11-9936-477e-abf6-9149919c0f1b admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:36.685856 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66557650-09f6-421c-ba40-1dbf4f073af8 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:36.687434 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-66557650-09f6-421c-ba40-1dbf4f073af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:36.707053 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66557650-09f6-421c-ba40-1dbf4f073af8 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:36.717284 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6eafa7-16a4-4c9f-8f6a-28bafae9f7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:36.717953 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6eafa7-16a4-4c9f-8f6a-28bafae9f7dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:36.718637 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6eafa7-16a4-4c9f-8f6a-28bafae9f7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:36.718961 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6eafa7-16a4-4c9f-8f6a-28bafae9f7dc admin admin] PATH_INFO: `/v3/users/ea49b24f9dae49beb209a3ddeb670a8d` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:36.721221 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6eafa7-16a4-4c9f-8f6a-28bafae9f7dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea49b24f9dae49beb209a3ddeb670a8d)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:36.725475 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6eafa7-16a4-4c9f-8f6a-28bafae9f7dc admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:36.762974 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-e70b1f11-9936-477e-abf6-9149919c0f1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ba7651f73de447c986fd17c565191c1'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:36.763824 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-e70b1f11-9936-477e-abf6-9149919c0f1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ba7651f73de447c986fd17c565191c1'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:36.786270 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-e70b1f11-9936-477e-abf6-9149919c0f1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ba7651f73de447c986fd17c565191c1'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:36.804002 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-e70b1f11-9936-477e-abf6-9149919c0f1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ba7651f73de447c986fd17c565191c1'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:36.817327 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-e70b1f11-9936-477e-abf6-9149919c0f1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ba7651f73de447c986fd17c565191c1'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:36.825298 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7f6eafa7-16a4-4c9f-8f6a-28bafae9f7dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea49b24f9dae49beb209a3ddeb670a8d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:36.843263 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 970/1943] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:18:36 2022] DELETE /identity/v3/users/3ba7651f73de447c986fd17c565191c1 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:36.844142 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b1f11-9936-477e-abf6-9149919c0f1b admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:36.848069 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-e70b1f11-9936-477e-abf6-9149919c0f1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:36.856835 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7f6eafa7-16a4-4c9f-8f6a-28bafae9f7dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea49b24f9dae49beb209a3ddeb670a8d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:36.875260 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7f6eafa7-16a4-4c9f-8f6a-28bafae9f7dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea49b24f9dae49beb209a3ddeb670a8d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:36.895439 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7f6eafa7-16a4-4c9f-8f6a-28bafae9f7dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea49b24f9dae49beb209a3ddeb670a8d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:36.896621 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7f6eafa7-16a4-4c9f-8f6a-28bafae9f7dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea49b24f9dae49beb209a3ddeb670a8d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:36.914240 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 974/1944] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:18:36 2022] DELETE /identity/v3/users/ea49b24f9dae49beb209a3ddeb670a8d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:36.915621 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd063f-204a-4f81-9294-3718aa3e1cbc None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:36.917021 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd063f-204a-4f81-9294-3718aa3e1cbc None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:36.917303 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd063f-204a-4f81-9294-3718aa3e1cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:36.945438 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b1f11-9936-477e-abf6-9149919c0f1b admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:36.961420 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-8ccd063f-204a-4f81-9294-3718aa3e1cbc None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:36.963197 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8ccd063f-204a-4f81-9294-3718aa3e1cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:37.061674 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548a423-cf40-4dd0-a68c-b3d777cce29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:37.063053 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548a423-cf40-4dd0-a68c-b3d777cce29f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:37.066771 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548a423-cf40-4dd0-a68c-b3d777cce29f admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:37.067254 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548a423-cf40-4dd0-a68c-b3d777cce29f admin admin] PATH_INFO: `/v3/projects/82112d0d83ca444483c5b304e25ce3a5` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:37.069521 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548a423-cf40-4dd0-a68c-b3d777cce29f admin admin] RBAC: Authorizing `identity:delete_project(project_id=82112d0d83ca444483c5b304e25ce3a5)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:37.071475 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548a423-cf40-4dd0-a68c-b3d777cce29f admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:37.092396 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:37.108479 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:37.171280 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 975/1945] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:37.172606 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd11d0-7e66-4214-badd-1e6c7873a89a None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:37.172871 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd11d0-7e66-4214-badd-1e6c7873a89a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:37.176864 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd11d0-7e66-4214-badd-1e6c7873a89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:37.186413 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-8548a423-cf40-4dd0-a68c-b3d777cce29f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82112d0d83ca444483c5b304e25ce3a5', 'request_id': 'req-8548a423-cf40-4dd0-a68c-b3d777cce29f'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:37.192684 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-8548a423-cf40-4dd0-a68c-b3d777cce29f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82112d0d83ca444483c5b304e25ce3a5', 'request_id': 'req-8548a423-cf40-4dd0-a68c-b3d777cce29f'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:37.200832 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-8548a423-cf40-4dd0-a68c-b3d777cce29f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82112d0d83ca444483c5b304e25ce3a5', 'request_id': 'req-8548a423-cf40-4dd0-a68c-b3d777cce29f'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:37.226211 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-9cdd11d0-7e66-4214-badd-1e6c7873a89a None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:37.228453 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9cdd11d0-7e66-4214-badd-1e6c7873a89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:37.243906 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-8548a423-cf40-4dd0-a68c-b3d777cce29f admin admin] The token cache is being invalidate because project 82112d0d83ca444483c5b304e25ce3a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:18:37.244460 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-8548a423-cf40-4dd0-a68c-b3d777cce29f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:37.244917 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-8548a423-cf40-4dd0-a68c-b3d777cce29f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:37.253504 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 971/1946] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:18:36 2022] DELETE /identity/v3/projects/82112d0d83ca444483c5b304e25ce3a5 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:37.254754 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548a423-cf40-4dd0-a68c-b3d777cce29f admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:37.271027 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-8548a423-cf40-4dd0-a68c-b3d777cce29f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:37.374321 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548a423-cf40-4dd0-a68c-b3d777cce29f admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:37.394234 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10bfbd-f6e8-462c-9bcc-e090a2bbda45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:37.394911 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10bfbd-f6e8-462c-9bcc-e090a2bbda45 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:37.395246 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10bfbd-f6e8-462c-9bcc-e090a2bbda45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:37.395520 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10bfbd-f6e8-462c-9bcc-e090a2bbda45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:37.397348 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-7d10bfbd-f6e8-462c-9bcc-e090a2bbda45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:37.398343 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 976/1947] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:37.399767 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544438cc-da0c-43b2-af1b-cef293b64d93 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:37.400123 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544438cc-da0c-43b2-af1b-cef293b64d93 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:37.400447 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544438cc-da0c-43b2-af1b-cef293b64d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:37.412782 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d10bfbd-f6e8-462c-9bcc-e090a2bbda45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:37.414443 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d10bfbd-f6e8-462c-9bcc-e090a2bbda45 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:37.425669 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 972/1948] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:37.426617 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10bfbd-f6e8-462c-9bcc-e090a2bbda45 service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:37.428011 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-544438cc-da0c-43b2-af1b-cef293b64d93 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:37.428146 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-7d10bfbd-f6e8-462c-9bcc-e090a2bbda45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:37.430140 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-544438cc-da0c-43b2-af1b-cef293b64d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:37.448302 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 977/1949] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:37.456064 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544438cc-da0c-43b2-af1b-cef293b64d93 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:37.467176 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544438cc-da0c-43b2-af1b-cef293b64d93 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:37.473092 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9bc4b-881a-4d20-9b8c-d105f0742f92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:37.473949 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9bc4b-881a-4d20-9b8c-d105f0742f92 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:37.474239 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9bc4b-881a-4d20-9b8c-d105f0742f92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:37.474548 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9bc4b-881a-4d20-9b8c-d105f0742f92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:37.486992 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb9bc4b-881a-4d20-9b8c-d105f0742f92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:37.489293 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb9bc4b-881a-4d20-9b8c-d105f0742f92 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:37.510337 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 978/1950] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:37.514140 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab662065-c05c-4bdd-9fd6-9af385e1c6d0 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:37.515008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab662065-c05c-4bdd-9fd6-9af385e1c6d0 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:37.515400 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab662065-c05c-4bdd-9fd6-9af385e1c6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:37.544009 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10bfbd-f6e8-462c-9bcc-e090a2bbda45 service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:37.551175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5339c1-8313-4884-94ba-9e2a4f046d7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:37.552023 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5339c1-8313-4884-94ba-9e2a4f046d7f service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:37.552302 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5339c1-8313-4884-94ba-9e2a4f046d7f service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:37.552578 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5339c1-8313-4884-94ba-9e2a4f046d7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:37.554389 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-5b5339c1-8313-4884-94ba-9e2a4f046d7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:37.562199 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-ab662065-c05c-4bdd-9fd6-9af385e1c6d0 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:37.563469 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ab662065-c05c-4bdd-9fd6-9af385e1c6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:37.583374 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 979/1951] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:37.584514 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab662065-c05c-4bdd-9fd6-9af385e1c6d0 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:37.602593 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab662065-c05c-4bdd-9fd6-9af385e1c6d0 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:37.607388 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54c192-2ab6-40b6-b154-7c34d89aeee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:37.608217 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54c192-2ab6-40b6-b154-7c34d89aeee5 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:37.608645 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54c192-2ab6-40b6-b154-7c34d89aeee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:37.609109 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54c192-2ab6-40b6-b154-7c34d89aeee5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:37.610079 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a54c192-2ab6-40b6-b154-7c34d89aeee5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:18:37.610571 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a54c192-2ab6-40b6-b154-7c34d89aeee5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:37.613541 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a54c192-2ab6-40b6-b154-7c34d89aeee5 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:37.626767 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:37.629707 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5339c1-8313-4884-94ba-9e2a4f046d7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:37.633652 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5339c1-8313-4884-94ba-9e2a4f046d7f service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:37.634326 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 980/1952] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:18:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:18:37.636941 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54c192-2ab6-40b6-b154-7c34d89aeee5 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:37.645072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 973/1953] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:37 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:37.656324 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54c192-2ab6-40b6-b154-7c34d89aeee5 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:37.661981 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c621dc-a750-48ab-b2d2-97e962fe79e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:37.662736 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c621dc-a750-48ab-b2d2-97e962fe79e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:37.663090 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c621dc-a750-48ab-b2d2-97e962fe79e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:37.663433 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c621dc-a750-48ab-b2d2-97e962fe79e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:37.664154 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c621dc-a750-48ab-b2d2-97e962fe79e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:37.666116 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c621dc-a750-48ab-b2d2-97e962fe79e4 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:37.703759 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 981/1954] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:18:37 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:37.708515 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5339c1-8313-4884-94ba-9e2a4f046d7f service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:37.723482 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5339c1-8313-4884-94ba-9e2a4f046d7f service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:37.834107 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b59f40-5222-4aa8-bc8d-257ef3f22aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:37.835041 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b59f40-5222-4aa8-bc8d-257ef3f22aa0 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:37.835515 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b59f40-5222-4aa8-bc8d-257ef3f22aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:37.835930 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b59f40-5222-4aa8-bc8d-257ef3f22aa0 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:37.836768 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b59f40-5222-4aa8-bc8d-257ef3f22aa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:37.839197 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b59f40-5222-4aa8-bc8d-257ef3f22aa0 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:37.889559 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 974/1955] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:18:37 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:37.894368 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c621dc-a750-48ab-b2d2-97e962fe79e4 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:37.904843 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c621dc-a750-48ab-b2d2-97e962fe79e4 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:37.909739 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88661c4e-522d-4e18-9108-d1c0cce845ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:37.910396 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88661c4e-522d-4e18-9108-d1c0cce845ba admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:37.910681 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88661c4e-522d-4e18-9108-d1c0cce845ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:37.910960 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88661c4e-522d-4e18-9108-d1c0cce845ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:37.911606 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88661c4e-522d-4e18-9108-d1c0cce845ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:37.913202 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88661c4e-522d-4e18-9108-d1c0cce845ba admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:37.926777 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 982/1956] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:37.930706 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b59f40-5222-4aa8-bc8d-257ef3f22aa0 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:37.944243 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b59f40-5222-4aa8-bc8d-257ef3f22aa0 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:37.949081 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88661c4e-522d-4e18-9108-d1c0cce845ba admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:37.951766 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c579c0-6aa0-4814-9e30-5e8109f1eda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:37.952394 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c579c0-6aa0-4814-9e30-5e8109f1eda7 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:37.952673 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c579c0-6aa0-4814-9e30-5e8109f1eda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:37.952984 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c579c0-6aa0-4814-9e30-5e8109f1eda7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:37.953329 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-88661c4e-522d-4e18-9108-d1c0cce845ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:37.953630 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c579c0-6aa0-4814-9e30-5e8109f1eda7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:37.955331 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c579c0-6aa0-4814-9e30-5e8109f1eda7 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:37.970793 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 975/1957] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:37.975576 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c579c0-6aa0-4814-9e30-5e8109f1eda7 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:37.976996 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88661c4e-522d-4e18-9108-d1c0cce845ba admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:37.982837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f85a58-5a17-495b-8ace-c26facc5fe44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:37.983841 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f85a58-5a17-495b-8ace-c26facc5fe44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:37.984121 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f85a58-5a17-495b-8ace-c26facc5fe44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:37.984440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f85a58-5a17-495b-8ace-c26facc5fe44 admin admin] PATH_INFO: `/v3/projects/f84ac1a024b34a18b4fb967f00274388` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:37.985741 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f85a58-5a17-495b-8ace-c26facc5fe44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f84ac1a024b34a18b4fb967f00274388)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:37.988418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f85a58-5a17-495b-8ace-c26facc5fe44 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:37.989280 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c579c0-6aa0-4814-9e30-5e8109f1eda7 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:37.995877 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18786e7-60de-4d5a-90e1-4e12f63aab1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:37.997397 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18786e7-60de-4d5a-90e1-4e12f63aab1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:37.997959 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18786e7-60de-4d5a-90e1-4e12f63aab1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:37.998881 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18786e7-60de-4d5a-90e1-4e12f63aab1e admin admin] PATH_INFO: `/v3/projects/2674af615cda4a68bd582fb1b2a6df83/users/824072473c644483b70036918a7a7f9d/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:38.026010 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18786e7-60de-4d5a-90e1-4e12f63aab1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2674af615cda4a68bd582fb1b2a6df83, user_id=824072473c644483b70036918a7a7f9d, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:38.029956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18786e7-60de-4d5a-90e1-4e12f63aab1e admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:38.051589 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 976/1958] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:37 2022] PUT /identity/v3/projects/2674af615cda4a68bd582fb1b2a6df83/users/824072473c644483b70036918a7a7f9d/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:38.070787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d96f7b-7380-4869-a536-39b4fe9c9fc6 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:38.070787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d96f7b-7380-4869-a536-39b4fe9c9fc6 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:38.070787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d96f7b-7380-4869-a536-39b4fe9c9fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:38.074577 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-b1f85a58-5a17-495b-8ace-c26facc5fe44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f84ac1a024b34a18b4fb967f00274388', 'request_id': 'req-b1f85a58-5a17-495b-8ace-c26facc5fe44'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:38.098169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-b1f85a58-5a17-495b-8ace-c26facc5fe44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f84ac1a024b34a18b4fb967f00274388', 'request_id': 'req-b1f85a58-5a17-495b-8ace-c26facc5fe44'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:38.098641 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-12d96f7b-7380-4869-a536-39b4fe9c9fc6 None None] MFA Rules not processed for user `824072473c644483b70036918a7a7f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:38.100159 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-12d96f7b-7380-4869-a536-39b4fe9c9fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:38.106578 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-b1f85a58-5a17-495b-8ace-c26facc5fe44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f84ac1a024b34a18b4fb967f00274388', 'request_id': 'req-b1f85a58-5a17-495b-8ace-c26facc5fe44'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:38.134136 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-b1f85a58-5a17-495b-8ace-c26facc5fe44 admin admin] The token cache is being invalidate because project f84ac1a024b34a18b4fb967f00274388 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:18:38.134502 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-b1f85a58-5a17-495b-8ace-c26facc5fe44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:38.135187 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-b1f85a58-5a17-495b-8ace-c26facc5fe44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:38.137159 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 983/1959] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:18:37 2022] DELETE /identity/v3/projects/f84ac1a024b34a18b4fb967f00274388 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:38.150326 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f85a58-5a17-495b-8ace-c26facc5fe44 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:38.150326 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b1f85a58-5a17-495b-8ace-c26facc5fe44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:38.159122 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:38.186416 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 977/1960] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:18:38.186416 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d96f7b-7380-4869-a536-39b4fe9c9fc6 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:38.186416 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-12d96f7b-7380-4869-a536-39b4fe9c9fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:38.225627 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f85a58-5a17-495b-8ace-c26facc5fe44 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:38.239700 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:38.272609 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d96f7b-7380-4869-a536-39b4fe9c9fc6 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:38.278005 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a213fb-4e2e-4eaf-9e3e-d7fdf5511593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:38.278866 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a213fb-4e2e-4eaf-9e3e-d7fdf5511593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:38.279269 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a213fb-4e2e-4eaf-9e3e-d7fdf5511593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:38.279672 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a213fb-4e2e-4eaf-9e3e-d7fdf5511593 admin admin] PATH_INFO: `/v3/users/bfdbad3f3f4d4af297ee7cd1b4c85afc` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:38.280819 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a213fb-4e2e-4eaf-9e3e-d7fdf5511593 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfdbad3f3f4d4af297ee7cd1b4c85afc)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:38.282783 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a213fb-4e2e-4eaf-9e3e-d7fdf5511593 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:38.311601 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a5bfe-50b9-45e2-bf78-acde002bea04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:38.312688 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a5bfe-50b9-45e2-bf78-acde002bea04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:38.313153 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a5bfe-50b9-45e2-bf78-acde002bea04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:38.313658 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a5bfe-50b9-45e2-bf78-acde002bea04 admin admin] PATH_INFO: `/v3/projects/55d29151e3454dd4b6f95c29522ffd1e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:38.317561 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a5bfe-50b9-45e2-bf78-acde002bea04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55d29151e3454dd4b6f95c29522ffd1e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:38.321260 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a5bfe-50b9-45e2-bf78-acde002bea04 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:38.333903 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-f3a213fb-4e2e-4eaf-9e3e-d7fdf5511593 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfdbad3f3f4d4af297ee7cd1b4c85afc'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:38.334604 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-f3a213fb-4e2e-4eaf-9e3e-d7fdf5511593 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfdbad3f3f4d4af297ee7cd1b4c85afc'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:38.347681 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-f3a213fb-4e2e-4eaf-9e3e-d7fdf5511593 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfdbad3f3f4d4af297ee7cd1b4c85afc'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:38.355714 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-f3a213fb-4e2e-4eaf-9e3e-d7fdf5511593 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfdbad3f3f4d4af297ee7cd1b4c85afc'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:38.365926 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-f3a213fb-4e2e-4eaf-9e3e-d7fdf5511593 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfdbad3f3f4d4af297ee7cd1b4c85afc'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:38.386919 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 978/1961] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:18:38 2022] DELETE /identity/v3/users/bfdbad3f3f4d4af297ee7cd1b4c85afc => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:38.388519 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a213fb-4e2e-4eaf-9e3e-d7fdf5511593 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:38.389108 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-fe2a5bfe-50b9-45e2-bf78-acde002bea04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55d29151e3454dd4b6f95c29522ffd1e', 'request_id': 'req-fe2a5bfe-50b9-45e2-bf78-acde002bea04'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:38.398483 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-fe2a5bfe-50b9-45e2-bf78-acde002bea04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55d29151e3454dd4b6f95c29522ffd1e', 'request_id': 'req-fe2a5bfe-50b9-45e2-bf78-acde002bea04'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:38.403445 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f3a213fb-4e2e-4eaf-9e3e-d7fdf5511593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:38.407300 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-fe2a5bfe-50b9-45e2-bf78-acde002bea04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55d29151e3454dd4b6f95c29522ffd1e', 'request_id': 'req-fe2a5bfe-50b9-45e2-bf78-acde002bea04'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:38.436696 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-fe2a5bfe-50b9-45e2-bf78-acde002bea04 admin admin] The token cache is being invalidate because project 55d29151e3454dd4b6f95c29522ffd1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:18:38.437080 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-fe2a5bfe-50b9-45e2-bf78-acde002bea04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:38.438389 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-fe2a5bfe-50b9-45e2-bf78-acde002bea04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:38.444683 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 984/1962] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:18:38 2022] DELETE /identity/v3/projects/55d29151e3454dd4b6f95c29522ffd1e => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:38.446114 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a5bfe-50b9-45e2-bf78-acde002bea04 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:38.447687 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-fe2a5bfe-50b9-45e2-bf78-acde002bea04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:38.498469 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a213fb-4e2e-4eaf-9e3e-d7fdf5511593 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:38.505866 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ecfe52-272d-4448-8e0b-b4aee72b8251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:38.507425 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecfe52-272d-4448-8e0b-b4aee72b8251 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:38.507726 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecfe52-272d-4448-8e0b-b4aee72b8251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:38.508131 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecfe52-272d-4448-8e0b-b4aee72b8251 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:38.508780 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ecfe52-272d-4448-8e0b-b4aee72b8251 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:38.510926 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ecfe52-272d-4448-8e0b-b4aee72b8251 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:38.511355 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:38.546891 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a5bfe-50b9-45e2-bf78-acde002bea04 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:38.550788 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 979/1963] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:18:38 2022] POST /identity/v3/projects => generated 387 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:38.553241 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54721be-6daf-4391-a8aa-17a2f41a9c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:38.553963 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54721be-6daf-4391-a8aa-17a2f41a9c08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:38.554235 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54721be-6daf-4391-a8aa-17a2f41a9c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:38.554535 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54721be-6daf-4391-a8aa-17a2f41a9c08 admin admin] PATH_INFO: `/v3/users/99582df633474f3cbae7ff807dda2d83` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:38.555435 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ecfe52-272d-4448-8e0b-b4aee72b8251 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:38.555727 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54721be-6daf-4391-a8aa-17a2f41a9c08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99582df633474f3cbae7ff807dda2d83)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:38.557664 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54721be-6daf-4391-a8aa-17a2f41a9c08 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:38.558052 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-51ecfe52-272d-4448-8e0b-b4aee72b8251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:38.625743 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:38.639422 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-f54721be-6daf-4391-a8aa-17a2f41a9c08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99582df633474f3cbae7ff807dda2d83'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:38.650641 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-f54721be-6daf-4391-a8aa-17a2f41a9c08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99582df633474f3cbae7ff807dda2d83'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:38.662965 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-f54721be-6daf-4391-a8aa-17a2f41a9c08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99582df633474f3cbae7ff807dda2d83'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:38.682968 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-f54721be-6daf-4391-a8aa-17a2f41a9c08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99582df633474f3cbae7ff807dda2d83'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:38.684067 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-f54721be-6daf-4391-a8aa-17a2f41a9c08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99582df633474f3cbae7ff807dda2d83'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:38.685999 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ecfe52-272d-4448-8e0b-b4aee72b8251 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:38.692655 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 985/1964] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:18:38 2022] DELETE /identity/v3/users/99582df633474f3cbae7ff807dda2d83 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:38.708364 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d7bc1-c0d3-4887-83a6-0a851466f133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:38.708996 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d7bc1-c0d3-4887-83a6-0a851466f133 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:38.709325 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d7bc1-c0d3-4887-83a6-0a851466f133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:38.709706 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d7bc1-c0d3-4887-83a6-0a851466f133 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:38.710359 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d7bc1-c0d3-4887-83a6-0a851466f133 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:38.712519 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d7bc1-c0d3-4887-83a6-0a851466f133 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:38.743865 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 980/1965] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:18:38 2022] POST /identity/v3/users => generated 300 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:38.747801 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54721be-6daf-4391-a8aa-17a2f41a9c08 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:38.750895 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f54721be-6daf-4391-a8aa-17a2f41a9c08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:38.842165 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54721be-6daf-4391-a8aa-17a2f41a9c08 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:38.848143 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ebc931-4e96-42f3-bb71-ba52c0fc5aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:38.848813 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebc931-4e96-42f3-bb71-ba52c0fc5aba admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:38.849120 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebc931-4e96-42f3-bb71-ba52c0fc5aba admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:38.849391 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebc931-4e96-42f3-bb71-ba52c0fc5aba admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:38.850065 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ebc931-4e96-42f3-bb71-ba52c0fc5aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:38.851832 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ebc931-4e96-42f3-bb71-ba52c0fc5aba admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:38.862810 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 986/1966] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:38.866912 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d7bc1-c0d3-4887-83a6-0a851466f133 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:38.877112 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d7bc1-c0d3-4887-83a6-0a851466f133 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:38.882514 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad706f-604f-4474-8392-2ad98f8229de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:38.883255 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad706f-604f-4474-8392-2ad98f8229de admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:38.883632 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad706f-604f-4474-8392-2ad98f8229de admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:38.883975 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad706f-604f-4474-8392-2ad98f8229de admin admin] PATH_INFO: `/v3/projects/da70b531669a49009e7b5eee9acc7ade/users/12a8838a4ea547b1b5c24027c01292bb/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:38.911635 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad706f-604f-4474-8392-2ad98f8229de admin admin] RBAC: Authorizing `identity:create_grant(project_id=da70b531669a49009e7b5eee9acc7ade, user_id=12a8838a4ea547b1b5c24027c01292bb, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:38.915125 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad706f-604f-4474-8392-2ad98f8229de admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:38.940381 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 981/1967] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:38 2022] PUT /identity/v3/projects/da70b531669a49009e7b5eee9acc7ade/users/12a8838a4ea547b1b5c24027c01292bb/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:38.942590 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ebc931-4e96-42f3-bb71-ba52c0fc5aba admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:38.955465 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ebc931-4e96-42f3-bb71-ba52c0fc5aba admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:38.973219 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad706f-604f-4474-8392-2ad98f8229de admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:38.975643 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-4bad706f-604f-4474-8392-2ad98f8229de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:39.058006 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e601ec-51f8-4d4c-8c14-01067beffb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:39.059131 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e601ec-51f8-4d4c-8c14-01067beffb56 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:39.059423 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e601ec-51f8-4d4c-8c14-01067beffb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:39.059700 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e601ec-51f8-4d4c-8c14-01067beffb56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:39.060466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e601ec-51f8-4d4c-8c14-01067beffb56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:39.062814 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e601ec-51f8-4d4c-8c14-01067beffb56 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:39.064818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:39.082034 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 987/1968] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:39.082947 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e601ec-51f8-4d4c-8c14-01067beffb56 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:39.085399 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad706f-604f-4474-8392-2ad98f8229de admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:39.090962 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb97b8-9010-4f87-a6b9-f5f032c2176c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:39.091854 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb97b8-9010-4f87-a6b9-f5f032c2176c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:39.092352 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb97b8-9010-4f87-a6b9-f5f032c2176c admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:39.092695 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb97b8-9010-4f87-a6b9-f5f032c2176c admin admin] PATH_INFO: `/v3/projects/b75a9120f9e54fb9933f2d7f8aca7161` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:39.094755 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb97b8-9010-4f87-a6b9-f5f032c2176c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b75a9120f9e54fb9933f2d7f8aca7161)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:39.097327 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e601ec-51f8-4d4c-8c14-01067beffb56 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:39.097661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb97b8-9010-4f87-a6b9-f5f032c2176c admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:39.109903 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e4930-b3e4-400d-9e54-46196bcdf24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:39.111311 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e4930-b3e4-400d-9e54-46196bcdf24e admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:39.112250 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e4930-b3e4-400d-9e54-46196bcdf24e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:39.112670 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e4930-b3e4-400d-9e54-46196bcdf24e admin admin] PATH_INFO: `/v3/projects/da70b531669a49009e7b5eee9acc7ade/users/12a8838a4ea547b1b5c24027c01292bb/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:39.124042 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e4930-b3e4-400d-9e54-46196bcdf24e admin admin] RBAC: Authorizing `identity:create_grant(project_id=da70b531669a49009e7b5eee9acc7ade, user_id=12a8838a4ea547b1b5c24027c01292bb, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:39.127131 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e4930-b3e4-400d-9e54-46196bcdf24e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:39.142527 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 988/1969] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:39 2022] PUT /identity/v3/projects/da70b531669a49009e7b5eee9acc7ade/users/12a8838a4ea547b1b5c24027c01292bb/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:39.154420 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8597d7-bbce-42c5-9c9b-a189a6f2229c None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:39.154571 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8597d7-bbce-42c5-9c9b-a189a6f2229c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:39.154913 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8597d7-bbce-42c5-9c9b-a189a6f2229c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:39.172504 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1acb97b8-9010-4f87-a6b9-f5f032c2176c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b75a9120f9e54fb9933f2d7f8aca7161', 'request_id': 'req-1acb97b8-9010-4f87-a6b9-f5f032c2176c'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:39.180657 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1acb97b8-9010-4f87-a6b9-f5f032c2176c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b75a9120f9e54fb9933f2d7f8aca7161', 'request_id': 'req-1acb97b8-9010-4f87-a6b9-f5f032c2176c'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:39.193453 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1acb97b8-9010-4f87-a6b9-f5f032c2176c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b75a9120f9e54fb9933f2d7f8aca7161', 'request_id': 'req-1acb97b8-9010-4f87-a6b9-f5f032c2176c'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:39.195460 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-0e8597d7-bbce-42c5-9c9b-a189a6f2229c None None] MFA Rules not processed for user `12a8838a4ea547b1b5c24027c01292bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:39.196942 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0e8597d7-bbce-42c5-9c9b-a189a6f2229c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:39.229504 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1acb97b8-9010-4f87-a6b9-f5f032c2176c admin admin] The token cache is being invalidate because project b75a9120f9e54fb9933f2d7f8aca7161 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:18:39.229883 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1acb97b8-9010-4f87-a6b9-f5f032c2176c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:39.230630 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1acb97b8-9010-4f87-a6b9-f5f032c2176c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:39.236367 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 982/1970] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:18:38 2022] DELETE /identity/v3/projects/b75a9120f9e54fb9933f2d7f8aca7161 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:39.238595 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb97b8-9010-4f87-a6b9-f5f032c2176c admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:39.240006 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1acb97b8-9010-4f87-a6b9-f5f032c2176c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:39.281648 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 989/1971] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:39 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:39.283374 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88f5de-b524-4cd7-80b2-cf301d454832 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:39.283374 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88f5de-b524-4cd7-80b2-cf301d454832 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:39.283549 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88f5de-b524-4cd7-80b2-cf301d454832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:39.287216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:39.310322 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-af88f5de-b524-4cd7-80b2-cf301d454832 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:39.311688 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-af88f5de-b524-4cd7-80b2-cf301d454832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:39.315736 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb97b8-9010-4f87-a6b9-f5f032c2176c admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:39.321815 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c8059-4dd6-41ee-bca7-f3e90aff5b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:39.322580 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c8059-4dd6-41ee-bca7-f3e90aff5b46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:39.322798 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 990/1972] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:39.322963 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c8059-4dd6-41ee-bca7-f3e90aff5b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:39.323210 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c8059-4dd6-41ee-bca7-f3e90aff5b46 admin admin] PATH_INFO: `/v3/projects/a88a7fd4772c4082a345b382d443913e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:39.324483 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c8059-4dd6-41ee-bca7-f3e90aff5b46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a88a7fd4772c4082a345b382d443913e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:39.325037 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88f5de-b524-4cd7-80b2-cf301d454832 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:39.326345 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c8059-4dd6-41ee-bca7-f3e90aff5b46 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:39.327788 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-af88f5de-b524-4cd7-80b2-cf301d454832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:39.409155 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-974c8059-4dd6-41ee-bca7-f3e90aff5b46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a88a7fd4772c4082a345b382d443913e', 'request_id': 'req-974c8059-4dd6-41ee-bca7-f3e90aff5b46'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:39.425030 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88f5de-b524-4cd7-80b2-cf301d454832 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:39.428733 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-974c8059-4dd6-41ee-bca7-f3e90aff5b46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a88a7fd4772c4082a345b382d443913e', 'request_id': 'req-974c8059-4dd6-41ee-bca7-f3e90aff5b46'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:39.435580 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-974c8059-4dd6-41ee-bca7-f3e90aff5b46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a88a7fd4772c4082a345b382d443913e', 'request_id': 'req-974c8059-4dd6-41ee-bca7-f3e90aff5b46'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:39.455547 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-974c8059-4dd6-41ee-bca7-f3e90aff5b46 admin admin] The token cache is being invalidate because project a88a7fd4772c4082a345b382d443913e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:18:39.455852 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-974c8059-4dd6-41ee-bca7-f3e90aff5b46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:39.457273 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-974c8059-4dd6-41ee-bca7-f3e90aff5b46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:39.459435 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 983/1973] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:18:39 2022] DELETE /identity/v3/projects/a88a7fd4772c4082a345b382d443913e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:39.460649 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc59d5-427c-4283-b9fd-e3a373c3e102 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:39.460941 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc59d5-427c-4283-b9fd-e3a373c3e102 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:39.461221 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc59d5-427c-4283-b9fd-e3a373c3e102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:39.484868 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-b5dc59d5-427c-4283-b9fd-e3a373c3e102 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:39.486098 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-b5dc59d5-427c-4283-b9fd-e3a373c3e102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:39.521183 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5413104e-3423-4281-a3ee-16edaa16c172 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:39.521436 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413104e-3423-4281-a3ee-16edaa16c172 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:39.521710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413104e-3423-4281-a3ee-16edaa16c172 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:39.521984 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413104e-3423-4281-a3ee-16edaa16c172 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:39.523921 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5413104e-3423-4281-a3ee-16edaa16c172 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:39.559247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:39.568135 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 984/1974] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:39.569754 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3582733-aaa5-4206-ae72-49f96adfe9f8 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:39.570428 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3582733-aaa5-4206-ae72-49f96adfe9f8 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:39.570875 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3582733-aaa5-4206-ae72-49f96adfe9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:39.597722 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-e3582733-aaa5-4206-ae72-49f96adfe9f8 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:39.599313 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-e3582733-aaa5-4206-ae72-49f96adfe9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:39.602778 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5413104e-3423-4281-a3ee-16edaa16c172 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:39.604399 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5413104e-3423-4281-a3ee-16edaa16c172 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:39.610281 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 985/1975] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:39.611269 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3582733-aaa5-4206-ae72-49f96adfe9f8 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:39.628445 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 991/1976] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:39 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:39.630270 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3582733-aaa5-4206-ae72-49f96adfe9f8 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:39.635565 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c1669-ab6a-47fc-a844-ca5e1b8bd054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:39.636175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c1669-ab6a-47fc-a844-ca5e1b8bd054 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:39.636382 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c166d2-2665-4fc5-bab6-19fe42886214 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:39.636483 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c1669-ab6a-47fc-a844-ca5e1b8bd054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:39.636705 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c1669-ab6a-47fc-a844-ca5e1b8bd054 admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:39.637379 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c1669-ab6a-47fc-a844-ca5e1b8bd054 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:18:39.637643 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c1669-ab6a-47fc-a844-ca5e1b8bd054 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:39.638062 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c166d2-2665-4fc5-bab6-19fe42886214 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:39.638401 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c166d2-2665-4fc5-bab6-19fe42886214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:39.639470 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c1669-ab6a-47fc-a844-ca5e1b8bd054 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:39.657439 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 986/1977] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:18:39.659374 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c1669-ab6a-47fc-a844-ca5e1b8bd054 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:39.670642 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-62c166d2-2665-4fc5-bab6-19fe42886214 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:39.671434 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-62c166d2-2665-4fc5-bab6-19fe42886214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:39.671745 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c1669-ab6a-47fc-a844-ca5e1b8bd054 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:39.679271 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055c0fa-9ead-47c0-9a83-15e707e7a0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:39.680020 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055c0fa-9ead-47c0-9a83-15e707e7a0b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:39.680371 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055c0fa-9ead-47c0-9a83-15e707e7a0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:39.681115 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055c0fa-9ead-47c0-9a83-15e707e7a0b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:39.681671 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4055c0fa-9ead-47c0-9a83-15e707e7a0b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:39.683505 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4055c0fa-9ead-47c0-9a83-15e707e7a0b1 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:39.701647 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 992/1978] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:39.706837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c166d2-2665-4fc5-bab6-19fe42886214 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:39.719955 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c166d2-2665-4fc5-bab6-19fe42886214 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:39.730692 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b96f63-4758-4399-840f-2c59cc35cc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:39.731350 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b96f63-4758-4399-840f-2c59cc35cc2b admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:39.732101 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b96f63-4758-4399-840f-2c59cc35cc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:39.732377 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b96f63-4758-4399-840f-2c59cc35cc2b admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:39.733768 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b96f63-4758-4399-840f-2c59cc35cc2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:18:39.733966 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b96f63-4758-4399-840f-2c59cc35cc2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:39.737991 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b96f63-4758-4399-840f-2c59cc35cc2b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:39.753730 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 987/1979] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:18:39 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:39.758255 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055c0fa-9ead-47c0-9a83-15e707e7a0b1 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:39.768322 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 993/1980] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:18:39.772521 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b96f63-4758-4399-840f-2c59cc35cc2b admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:39.797263 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b96f63-4758-4399-840f-2c59cc35cc2b admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:39.810942 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:39.867079 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055c0fa-9ead-47c0-9a83-15e707e7a0b1 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:39.874682 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4012b-a7fb-48e3-8a31-c52d80a56d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:39.875597 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4012b-a7fb-48e3-8a31-c52d80a56d3a admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:39.876175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4012b-a7fb-48e3-8a31-c52d80a56d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:39.876590 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4012b-a7fb-48e3-8a31-c52d80a56d3a admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:39.877689 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d4012b-a7fb-48e3-8a31-c52d80a56d3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:39.880559 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d4012b-a7fb-48e3-8a31-c52d80a56d3a admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:39.912876 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 988/1981] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:18:39 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:39.917905 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4012b-a7fb-48e3-8a31-c52d80a56d3a admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:39.920913 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-83d4012b-a7fb-48e3-8a31-c52d80a56d3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:39.936323 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4012b-a7fb-48e3-8a31-c52d80a56d3a admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:39.942132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f18c7-e8e0-42ef-951f-df852afcdf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:39.943011 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f18c7-e8e0-42ef-951f-df852afcdf9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:39.943123 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f18c7-e8e0-42ef-951f-df852afcdf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:39.943390 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f18c7-e8e0-42ef-951f-df852afcdf9d admin admin] PATH_INFO: `/v3/users/824072473c644483b70036918a7a7f9d` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:39.943491 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20304b62-d778-485d-9a41-b8fb35542e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:39.944027 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20304b62-d778-485d-9a41-b8fb35542e6d admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:39.944310 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20304b62-d778-485d-9a41-b8fb35542e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:39.944583 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20304b62-d778-485d-9a41-b8fb35542e6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:39.945301 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f18c7-e8e0-42ef-951f-df852afcdf9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=824072473c644483b70036918a7a7f9d)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:39.945425 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20304b62-d778-485d-9a41-b8fb35542e6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:39.947919 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f18c7-e8e0-42ef-951f-df852afcdf9d admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:39.948239 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20304b62-d778-485d-9a41-b8fb35542e6d admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:39.985799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 994/1982] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:18:39 2022] POST /identity/v3/projects => generated 383 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:18:39.986621 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20304b62-d778-485d-9a41-b8fb35542e6d admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:40.016734 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-481f18c7-e8e0-42ef-951f-df852afcdf9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '824072473c644483b70036918a7a7f9d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:40.017552 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-481f18c7-e8e0-42ef-951f-df852afcdf9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '824072473c644483b70036918a7a7f9d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:40.034414 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-481f18c7-e8e0-42ef-951f-df852afcdf9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '824072473c644483b70036918a7a7f9d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:40.042196 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-481f18c7-e8e0-42ef-951f-df852afcdf9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '824072473c644483b70036918a7a7f9d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:40.051768 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-481f18c7-e8e0-42ef-951f-df852afcdf9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '824072473c644483b70036918a7a7f9d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:40.061581 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 989/1983] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:18:39 2022] DELETE /identity/v3/users/824072473c644483b70036918a7a7f9d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:40.070607 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f18c7-e8e0-42ef-951f-df852afcdf9d admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:40.074722 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-481f18c7-e8e0-42ef-951f-df852afcdf9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:40.078956 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20304b62-d778-485d-9a41-b8fb35542e6d admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:40.130724 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:40.155105 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29a990-d735-4537-910d-4046d74dc43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:40.155744 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29a990-d735-4537-910d-4046d74dc43b admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:40.156022 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29a990-d735-4537-910d-4046d74dc43b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:40.156295 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29a990-d735-4537-910d-4046d74dc43b admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:40.156947 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b29a990-d735-4537-910d-4046d74dc43b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:40.160500 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b29a990-d735-4537-910d-4046d74dc43b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:40.178536 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f18c7-e8e0-42ef-951f-df852afcdf9d admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:40.183920 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 995/1984] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:40.184609 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15e9b0-f226-4cd5-9b06-805b2901a104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:40.185320 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15e9b0-f226-4cd5-9b06-805b2901a104 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:40.185649 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15e9b0-f226-4cd5-9b06-805b2901a104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:40.185895 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b79b21-40d7-42f4-b73d-d88fe5d3ea56 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:40.186007 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15e9b0-f226-4cd5-9b06-805b2901a104 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:40.186399 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b79b21-40d7-42f4-b73d-d88fe5d3ea56 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:40.186717 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15e9b0-f226-4cd5-9b06-805b2901a104 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:40.187017 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b79b21-40d7-42f4-b73d-d88fe5d3ea56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:40.189241 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15e9b0-f226-4cd5-9b06-805b2901a104 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:40.215821 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-61b79b21-40d7-42f4-b73d-d88fe5d3ea56 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:40.217619 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-61b79b21-40d7-42f4-b73d-d88fe5d3ea56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:40.218630 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 990/1985] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:18:40 2022] POST /identity/v3/users => generated 292 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:40.231517 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15e9b0-f226-4cd5-9b06-805b2901a104 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:40.238713 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1e15e9b0-f226-4cd5-9b06-805b2901a104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:40.253261 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15e9b0-f226-4cd5-9b06-805b2901a104 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:40.258294 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 996/1986] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:40.262539 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b79b21-40d7-42f4-b73d-d88fe5d3ea56 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:40.265518 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff98a1-de7f-4f81-9d62-2173700dc0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:40.266262 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff98a1-de7f-4f81-9d62-2173700dc0a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:40.266773 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff98a1-de7f-4f81-9d62-2173700dc0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:40.267545 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff98a1-de7f-4f81-9d62-2173700dc0a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:40.267782 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff98a1-de7f-4f81-9d62-2173700dc0a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:40.269876 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff98a1-de7f-4f81-9d62-2173700dc0a0 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:40.283182 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 991/1987] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:40.283919 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b79b21-40d7-42f4-b73d-d88fe5d3ea56 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:40.284710 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff98a1-de7f-4f81-9d62-2173700dc0a0 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:40.291239 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36acfe-6411-46fd-8f5b-3d458a226ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:40.291465 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-75ff98a1-de7f-4f81-9d62-2173700dc0a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:40.292110 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36acfe-6411-46fd-8f5b-3d458a226ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:40.292438 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36acfe-6411-46fd-8f5b-3d458a226ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:40.292790 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36acfe-6411-46fd-8f5b-3d458a226ec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:40.293536 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36acfe-6411-46fd-8f5b-3d458a226ec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:40.295459 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36acfe-6411-46fd-8f5b-3d458a226ec6 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:40.319659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=83,keystone:INSERT=7,keystone:DELETE=10 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:40.327581 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 997/1988] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:40.328741 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36acfe-6411-46fd-8f5b-3d458a226ec6 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:40.353547 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36acfe-6411-46fd-8f5b-3d458a226ec6 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:40.375667 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea693ee-fe3f-4b22-8129-83a45e338024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:40.378490 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea693ee-fe3f-4b22-8129-83a45e338024 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:40.378490 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea693ee-fe3f-4b22-8129-83a45e338024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:40.378490 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea693ee-fe3f-4b22-8129-83a45e338024 admin admin] PATH_INFO: `/v3/projects/87e153dec4704938afc279e424915eba/users/f383cf01470d42ba9fd0b31b0652c4cd/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:40.405437 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea693ee-fe3f-4b22-8129-83a45e338024 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87e153dec4704938afc279e424915eba, user_id=f383cf01470d42ba9fd0b31b0652c4cd, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:40.408357 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea693ee-fe3f-4b22-8129-83a45e338024 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:40.430498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff98a1-de7f-4f81-9d62-2173700dc0a0 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:40.433753 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 998/1989] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:40 2022] PUT /identity/v3/projects/87e153dec4704938afc279e424915eba/users/f383cf01470d42ba9fd0b31b0652c4cd/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:40.444936 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea693ee-fe3f-4b22-8129-83a45e338024 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:40.502665 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b0fa8-41f6-4c38-bcbd-e81a2eb0417a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:40.503326 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b0fa8-41f6-4c38-bcbd-e81a2eb0417a service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:40.503605 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b0fa8-41f6-4c38-bcbd-e81a2eb0417a service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:40.504178 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b0fa8-41f6-4c38-bcbd-e81a2eb0417a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:40.531723 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea693ee-fe3f-4b22-8129-83a45e338024 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:40.539595 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7977c-a491-4fd9-a4cd-7772fe345d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:40.540219 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7977c-a491-4fd9-a4cd-7772fe345d16 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:40.540488 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7977c-a491-4fd9-a4cd-7772fe345d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:40.540757 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7977c-a491-4fd9-a4cd-7772fe345d16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:40.541449 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f7977c-a491-4fd9-a4cd-7772fe345d16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:40.543096 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f7977c-a491-4fd9-a4cd-7772fe345d16 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:40.554038 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 999/1990] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:40.555364 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95fc1e3-7ed1-41a4-a044-09ccb335dca5 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:40.555627 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95fc1e3-7ed1-41a4-a044-09ccb335dca5 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:40.555902 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95fc1e3-7ed1-41a4-a044-09ccb335dca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:40.584546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b0fa8-41f6-4c38-bcbd-e81a2eb0417a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:40.584745 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-b95fc1e3-7ed1-41a4-a044-09ccb335dca5 None None] MFA Rules not processed for user `f383cf01470d42ba9fd0b31b0652c4cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:40.585773 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b95fc1e3-7ed1-41a4-a044-09ccb335dca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:40.586839 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b0fa8-41f6-4c38-bcbd-e81a2eb0417a service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:40.599939 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 992/1991] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:40.600811 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b0fa8-41f6-4c38-bcbd-e81a2eb0417a service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:40.611524 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b0fa8-41f6-4c38-bcbd-e81a2eb0417a service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:40.617333 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d7aa3-4916-4e1f-a3da-eec648a860e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:40.618236 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d7aa3-4916-4e1f-a3da-eec648a860e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:40.618549 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d7aa3-4916-4e1f-a3da-eec648a860e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:40.618956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d7aa3-4916-4e1f-a3da-eec648a860e2 admin admin] PATH_INFO: `/v3/projects/72305cb8cc2f408d99c82ac8e0aa080d/users/63ef72f756b04adab3746fa37d23df3c/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:40.637089 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d7aa3-4916-4e1f-a3da-eec648a860e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72305cb8cc2f408d99c82ac8e0aa080d, user_id=63ef72f756b04adab3746fa37d23df3c, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:40.641200 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d7aa3-4916-4e1f-a3da-eec648a860e2 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:40.662050 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 993/1992] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:40 2022] PUT /identity/v3/projects/72305cb8cc2f408d99c82ac8e0aa080d/users/63ef72f756b04adab3746fa37d23df3c/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:40.672457 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fce978-0431-435b-bad7-200ed17f6e51 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:40.672848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fce978-0431-435b-bad7-200ed17f6e51 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:40.673316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fce978-0431-435b-bad7-200ed17f6e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:40.686757 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1000/1993] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:40.691595 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95fc1e3-7ed1-41a4-a044-09ccb335dca5 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:40.708373 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95fc1e3-7ed1-41a4-a044-09ccb335dca5 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:40.723130 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-63fce978-0431-435b-bad7-200ed17f6e51 None None] MFA Rules not processed for user `63ef72f756b04adab3746fa37d23df3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:40.724478 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-63fce978-0431-435b-bad7-200ed17f6e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:40.732633 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:40.785395 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:40.830830 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 994/1994] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:18:40.833578 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fce978-0431-435b-bad7-200ed17f6e51 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:40.861588 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eebd979-3d2d-4493-9ac5-3c6fc5d04247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:40.862295 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebd979-3d2d-4493-9ac5-3c6fc5d04247 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:40.862898 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebd979-3d2d-4493-9ac5-3c6fc5d04247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:40.863300 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebd979-3d2d-4493-9ac5-3c6fc5d04247 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:40.864066 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eebd979-3d2d-4493-9ac5-3c6fc5d04247 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:40.867268 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eebd979-3d2d-4493-9ac5-3c6fc5d04247 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:40.905676 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1001/1995] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:18:40 2022] POST /identity/v3/projects => generated 387 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:40.917355 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eebd979-3d2d-4493-9ac5-3c6fc5d04247 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:40.970047 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fce978-0431-435b-bad7-200ed17f6e51 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:41.006291 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eebd979-3d2d-4493-9ac5-3c6fc5d04247 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:41.012147 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d3b74-d631-4cfa-83d9-376640b76787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:41.012773 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d3b74-d631-4cfa-83d9-376640b76787 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:41.013126 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d3b74-d631-4cfa-83d9-376640b76787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:41.013396 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d3b74-d631-4cfa-83d9-376640b76787 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:41.014032 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d3b74-d631-4cfa-83d9-376640b76787 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:41.016016 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d3b74-d631-4cfa-83d9-376640b76787 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:41.049977 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1002/1996] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:18:40 2022] POST /identity/v3/users => generated 300 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:41.051004 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d3b74-d631-4cfa-83d9-376640b76787 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:41.052835 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ce8d3b74-d631-4cfa-83d9-376640b76787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:41.057786 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f2bbb-7ed3-44ee-aa2b-a5fc6150e85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:41.058405 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f2bbb-7ed3-44ee-aa2b-a5fc6150e85c admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:41.058718 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f2bbb-7ed3-44ee-aa2b-a5fc6150e85c admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:41.059122 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f2bbb-7ed3-44ee-aa2b-a5fc6150e85c admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:41.059766 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025f2bbb-7ed3-44ee-aa2b-a5fc6150e85c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:41.061681 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025f2bbb-7ed3-44ee-aa2b-a5fc6150e85c admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:41.069567 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d3b74-d631-4cfa-83d9-376640b76787 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:41.074884 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2404c1-f2ca-4ef5-bae7-463a47744fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:41.075623 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2404c1-f2ca-4ef5-bae7-463a47744fee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:41.075987 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2404c1-f2ca-4ef5-bae7-463a47744fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:41.076266 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2404c1-f2ca-4ef5-bae7-463a47744fee admin admin] PATH_INFO: `/v3/projects/2674af615cda4a68bd582fb1b2a6df83` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:41.077693 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2404c1-f2ca-4ef5-bae7-463a47744fee admin admin] RBAC: Authorizing `identity:delete_project(project_id=2674af615cda4a68bd582fb1b2a6df83)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:41.079734 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2404c1-f2ca-4ef5-bae7-463a47744fee admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:41.101566 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 995/1997] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:18:40 2022] POST /identity/v3/projects => generated 381 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:41.102518 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f2bbb-7ed3-44ee-aa2b-a5fc6150e85c admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:41.148883 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8f2404c1-f2ca-4ef5-bae7-463a47744fee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2674af615cda4a68bd582fb1b2a6df83', 'request_id': 'req-8f2404c1-f2ca-4ef5-bae7-463a47744fee'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:41.155529 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8f2404c1-f2ca-4ef5-bae7-463a47744fee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2674af615cda4a68bd582fb1b2a6df83', 'request_id': 'req-8f2404c1-f2ca-4ef5-bae7-463a47744fee'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:41.163491 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8f2404c1-f2ca-4ef5-bae7-463a47744fee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2674af615cda4a68bd582fb1b2a6df83', 'request_id': 'req-8f2404c1-f2ca-4ef5-bae7-463a47744fee'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:41.184655 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8f2404c1-f2ca-4ef5-bae7-463a47744fee admin admin] The token cache is being invalidate because project 2674af615cda4a68bd582fb1b2a6df83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:18:41.185233 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8f2404c1-f2ca-4ef5-bae7-463a47744fee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:41.186067 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8f2404c1-f2ca-4ef5-bae7-463a47744fee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:41.188845 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1003/1998] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:18:41 2022] DELETE /identity/v3/projects/2674af615cda4a68bd582fb1b2a6df83 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:41.188845 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2404c1-f2ca-4ef5-bae7-463a47744fee admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:41.191170 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8f2404c1-f2ca-4ef5-bae7-463a47744fee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:41.197951 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f2bbb-7ed3-44ee-aa2b-a5fc6150e85c admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:41.216701 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:41.228913 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:41.273713 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b28ba-f588-4b59-b1b3-6980ae048bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:41.274352 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b28ba-f588-4b59-b1b3-6980ae048bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:41.274656 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b28ba-f588-4b59-b1b3-6980ae048bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:41.274939 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b28ba-f588-4b59-b1b3-6980ae048bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:41.275646 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b28ba-f588-4b59-b1b3-6980ae048bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:41.277288 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b28ba-f588-4b59-b1b3-6980ae048bc5 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:41.281617 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2404c1-f2ca-4ef5-bae7-463a47744fee admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:41.291020 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 996/1999] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:41.291313 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb45c96-7249-42be-8f15-5c8377c03213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:41.291467 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b28ba-f588-4b59-b1b3-6980ae048bc5 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:41.291557 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb45c96-7249-42be-8f15-5c8377c03213 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:41.291557 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb45c96-7249-42be-8f15-5c8377c03213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:41.291557 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb45c96-7249-42be-8f15-5c8377c03213 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:41.291557 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb45c96-7249-42be-8f15-5c8377c03213 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:41.292324 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb45c96-7249-42be-8f15-5c8377c03213 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:41.298414 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-5b5b28ba-f588-4b59-b1b3-6980ae048bc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:41.318365 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b28ba-f588-4b59-b1b3-6980ae048bc5 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:41.320078 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1004/2000] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:18:41 2022] POST /identity/v3/users => generated 297 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:41.321197 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb45c96-7249-42be-8f15-5c8377c03213 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:41.323088 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0cb45c96-7249-42be-8f15-5c8377c03213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:41.323502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b934856-b927-4865-a85b-be357f1d7d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:41.324140 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b934856-b927-4865-a85b-be357f1d7d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:41.324549 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b934856-b927-4865-a85b-be357f1d7d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:41.324837 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b934856-b927-4865-a85b-be357f1d7d41 admin admin] PATH_INFO: `/v3/users/12a8838a4ea547b1b5c24027c01292bb` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:41.326429 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b934856-b927-4865-a85b-be357f1d7d41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12a8838a4ea547b1b5c24027c01292bb)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:41.328644 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b934856-b927-4865-a85b-be357f1d7d41 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:41.346353 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb45c96-7249-42be-8f15-5c8377c03213 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:41.351946 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de4b73-8fd8-405a-aacd-d7aa2450edeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:41.352684 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de4b73-8fd8-405a-aacd-d7aa2450edeb admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:41.353083 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de4b73-8fd8-405a-aacd-d7aa2450edeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:41.353425 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de4b73-8fd8-405a-aacd-d7aa2450edeb admin admin] PATH_INFO: `/v3/projects/327917193f0e4f2d87f5ab4b7885f8ed/users/37bdccad6fea4a9b9ad8dc70cd78a4c0/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:41.371859 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de4b73-8fd8-405a-aacd-d7aa2450edeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=327917193f0e4f2d87f5ab4b7885f8ed, user_id=37bdccad6fea4a9b9ad8dc70cd78a4c0, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:41.375119 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de4b73-8fd8-405a-aacd-d7aa2450edeb admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:41.387857 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-0b934856-b927-4865-a85b-be357f1d7d41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12a8838a4ea547b1b5c24027c01292bb'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:41.388722 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-0b934856-b927-4865-a85b-be357f1d7d41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12a8838a4ea547b1b5c24027c01292bb'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:41.396300 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1005/2001] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:41 2022] PUT /identity/v3/projects/327917193f0e4f2d87f5ab4b7885f8ed/users/37bdccad6fea4a9b9ad8dc70cd78a4c0/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:41.396300 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de4b73-8fd8-405a-aacd-d7aa2450edeb admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:41.405854 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-0b934856-b927-4865-a85b-be357f1d7d41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12a8838a4ea547b1b5c24027c01292bb'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:41.415550 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-0b934856-b927-4865-a85b-be357f1d7d41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12a8838a4ea547b1b5c24027c01292bb'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:41.427090 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-0b934856-b927-4865-a85b-be357f1d7d41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12a8838a4ea547b1b5c24027c01292bb'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:41.451329 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 997/2002] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:18:41 2022] DELETE /identity/v3/users/12a8838a4ea547b1b5c24027c01292bb => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:41.452854 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b934856-b927-4865-a85b-be357f1d7d41 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:41.456378 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-0b934856-b927-4865-a85b-be357f1d7d41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:41.495673 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de4b73-8fd8-405a-aacd-d7aa2450edeb admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:41.555098 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b934856-b927-4865-a85b-be357f1d7d41 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:41.562662 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e951f-0df5-4824-a7ef-6681824a297a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:41.563451 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e951f-0df5-4824-a7ef-6681824a297a admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:41.563965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e951f-0df5-4824-a7ef-6681824a297a admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:41.564082 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e951f-0df5-4824-a7ef-6681824a297a admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:41.564793 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e951f-0df5-4824-a7ef-6681824a297a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:41.567011 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e951f-0df5-4824-a7ef-6681824a297a admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:41.569629 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5e21e-e44c-4e36-8282-f70042ab2f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:41.570251 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5e21e-e44c-4e36-8282-f70042ab2f9e admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:41.570563 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5e21e-e44c-4e36-8282-f70042ab2f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:41.570837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5e21e-e44c-4e36-8282-f70042ab2f9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:41.571483 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5e21e-e44c-4e36-8282-f70042ab2f9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:41.573115 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5e21e-e44c-4e36-8282-f70042ab2f9e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:41.584101 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 998/2003] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:41.587564 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1006/2004] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:41.587664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e951f-0df5-4824-a7ef-6681824a297a admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:41.588407 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5e21e-e44c-4e36-8282-f70042ab2f9e admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:41.590439 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-87b5e21e-e44c-4e36-8282-f70042ab2f9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:41.600271 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e951f-0df5-4824-a7ef-6681824a297a admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:41.606102 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5e21e-e44c-4e36-8282-f70042ab2f9e admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:41.607441 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bfd4bc-fe89-43e1-92b6-81e6d7306dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:41.608165 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bfd4bc-fe89-43e1-92b6-81e6d7306dca admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:41.608445 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bfd4bc-fe89-43e1-92b6-81e6d7306dca admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:41.608776 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bfd4bc-fe89-43e1-92b6-81e6d7306dca admin admin] PATH_INFO: `/v3/projects/327917193f0e4f2d87f5ab4b7885f8ed/users/37bdccad6fea4a9b9ad8dc70cd78a4c0/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:41.610933 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bfd4bc-fe89-43e1-92b6-81e6d7306dca admin admin] RBAC: Authorizing `identity:create_grant(project_id=327917193f0e4f2d87f5ab4b7885f8ed, user_id=37bdccad6fea4a9b9ad8dc70cd78a4c0, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:41.611055 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6226b7-87e5-4fa2-a940-fed9967ff6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:41.611662 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6226b7-87e5-4fa2-a940-fed9967ff6a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:41.611945 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6226b7-87e5-4fa2-a940-fed9967ff6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:41.612844 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6226b7-87e5-4fa2-a940-fed9967ff6a7 admin admin] PATH_INFO: `/v3/projects/7cffcb5d95ce46329b1f8c1f7d289546/users/7f2d293bf82648cb937b093f1f9accde/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:41.616369 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bfd4bc-fe89-43e1-92b6-81e6d7306dca admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:41.631044 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6226b7-87e5-4fa2-a940-fed9967ff6a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cffcb5d95ce46329b1f8c1f7d289546, user_id=7f2d293bf82648cb937b093f1f9accde, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:41.641269 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 999/2005] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:41 2022] PUT /identity/v3/projects/327917193f0e4f2d87f5ab4b7885f8ed/users/37bdccad6fea4a9b9ad8dc70cd78a4c0/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:41.641456 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6226b7-87e5-4fa2-a940-fed9967ff6a7 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:41.642566 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ceb54-e5ca-4ba8-ba28-d45a0fe83e7c None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:41.642957 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ceb54-e5ca-4ba8-ba28-d45a0fe83e7c None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:41.643386 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ceb54-e5ca-4ba8-ba28-d45a0fe83e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:41.658315 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1007/2006] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:41 2022] PUT /identity/v3/projects/7cffcb5d95ce46329b1f8c1f7d289546/users/7f2d293bf82648cb937b093f1f9accde/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:18:41.667667 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6226b7-87e5-4fa2-a940-fed9967ff6a7 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:41.672465 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:41.688227 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:41.699865 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-0c2ceb54-e5ca-4ba8-ba28-d45a0fe83e7c None None] MFA Rules not processed for user `37bdccad6fea4a9b9ad8dc70cd78a4c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:41.701598 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-0c2ceb54-e5ca-4ba8-ba28-d45a0fe83e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:41.811325 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1000/2007] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:41 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:18:41.812799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6226b7-87e5-4fa2-a940-fed9967ff6a7 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:41.822911 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ceb54-e5ca-4ba8-ba28-d45a0fe83e7c None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:41.828432 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-0c2ceb54-e5ca-4ba8-ba28-d45a0fe83e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:41.831104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e53340-2ec2-4459-a41d-b1eaa55f236b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:41.832646 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e53340-2ec2-4459-a41d-b1eaa55f236b admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:41.833188 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e53340-2ec2-4459-a41d-b1eaa55f236b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:41.834384 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e53340-2ec2-4459-a41d-b1eaa55f236b admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:41.835342 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e53340-2ec2-4459-a41d-b1eaa55f236b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:41.837696 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e53340-2ec2-4459-a41d-b1eaa55f236b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:41.859485 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1008/2008] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:41.869821 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e53340-2ec2-4459-a41d-b1eaa55f236b admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:41.892597 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e53340-2ec2-4459-a41d-b1eaa55f236b admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:41.902713 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a53b8-6dd3-4136-b0c9-0107178c8ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:41.906009 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a53b8-6dd3-4136-b0c9-0107178c8ead admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:41.906401 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a53b8-6dd3-4136-b0c9-0107178c8ead admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:41.906812 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a53b8-6dd3-4136-b0c9-0107178c8ead admin admin] PATH_INFO: `/v3/projects/7cffcb5d95ce46329b1f8c1f7d289546/users/7f2d293bf82648cb937b093f1f9accde/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:41.912855 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a53b8-6dd3-4136-b0c9-0107178c8ead admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cffcb5d95ce46329b1f8c1f7d289546, user_id=7f2d293bf82648cb937b093f1f9accde, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:41.919379 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a53b8-6dd3-4136-b0c9-0107178c8ead admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:41.937410 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ceb54-e5ca-4ba8-ba28-d45a0fe83e7c None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:41.943807 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1009/2009] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:41 2022] PUT /identity/v3/projects/7cffcb5d95ce46329b1f8c1f7d289546/users/7f2d293bf82648cb937b093f1f9accde/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:41.954873 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9121c-6000-4f9a-863b-403c7d0cd551 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:41.955226 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9121c-6000-4f9a-863b-403c7d0cd551 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:41.955638 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9121c-6000-4f9a-863b-403c7d0cd551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:41.997239 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-89a9121c-6000-4f9a-863b-403c7d0cd551 None None] MFA Rules not processed for user `7f2d293bf82648cb937b093f1f9accde`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:41.998782 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-89a9121c-6000-4f9a-863b-403c7d0cd551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:42.048671 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa08cc57-1a16-4f1d-9a39-148caf9b5ab2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:42.050358 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa08cc57-1a16-4f1d-9a39-148caf9b5ab2 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:42.050940 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa08cc57-1a16-4f1d-9a39-148caf9b5ab2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:42.051234 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa08cc57-1a16-4f1d-9a39-148caf9b5ab2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:42.138274 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1010/2010] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:41 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:42.140053 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9121c-6000-4f9a-863b-403c7d0cd551 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:42.140826 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa08cc57-1a16-4f1d-9a39-148caf9b5ab2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:42.142354 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-89a9121c-6000-4f9a-863b-403c7d0cd551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:42.143574 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa08cc57-1a16-4f1d-9a39-148caf9b5ab2 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:42.155450 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1001/2011] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:41 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:42.222938 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa08cc57-1a16-4f1d-9a39-148caf9b5ab2 service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:42.227875 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:42.238492 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa08cc57-1a16-4f1d-9a39-148caf9b5ab2 service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:42.239100 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9121c-6000-4f9a-863b-403c7d0cd551 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:42.243688 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64961e90-c668-4cff-ac6b-1ca7b84d128b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:42.244535 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64961e90-c668-4cff-ac6b-1ca7b84d128b service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:42.244965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64961e90-c668-4cff-ac6b-1ca7b84d128b service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:42.245082 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba75e701-1f32-4d77-8b42-84267ab74ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:42.245531 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64961e90-c668-4cff-ac6b-1ca7b84d128b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:42.245673 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75e701-1f32-4d77-8b42-84267ab74ee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:42.245962 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75e701-1f32-4d77-8b42-84267ab74ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:42.246239 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75e701-1f32-4d77-8b42-84267ab74ee0 admin admin] PATH_INFO: `/v3/projects/da70b531669a49009e7b5eee9acc7ade` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:42.247614 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba75e701-1f32-4d77-8b42-84267ab74ee0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da70b531669a49009e7b5eee9acc7ade)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:42.250354 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba75e701-1f32-4d77-8b42-84267ab74ee0 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:42.260163 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64961e90-c668-4cff-ac6b-1ca7b84d128b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:42.263600 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64961e90-c668-4cff-ac6b-1ca7b84d128b service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:42.283415 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1002/2012] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:42 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:18:42.292645 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:42.365109 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ba75e701-1f32-4d77-8b42-84267ab74ee0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da70b531669a49009e7b5eee9acc7ade', 'request_id': 'req-ba75e701-1f32-4d77-8b42-84267ab74ee0'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:42.373576 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ba75e701-1f32-4d77-8b42-84267ab74ee0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da70b531669a49009e7b5eee9acc7ade', 'request_id': 'req-ba75e701-1f32-4d77-8b42-84267ab74ee0'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:42.383058 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ba75e701-1f32-4d77-8b42-84267ab74ee0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da70b531669a49009e7b5eee9acc7ade', 'request_id': 'req-ba75e701-1f32-4d77-8b42-84267ab74ee0'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:42.408606 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ba75e701-1f32-4d77-8b42-84267ab74ee0 admin admin] The token cache is being invalidate because project da70b531669a49009e7b5eee9acc7ade was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:18:42.409113 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ba75e701-1f32-4d77-8b42-84267ab74ee0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:42.410109 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ba75e701-1f32-4d77-8b42-84267ab74ee0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:42.412114 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1011/2013] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:18:42 2022] DELETE /identity/v3/projects/da70b531669a49009e7b5eee9acc7ade => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:42.426078 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fcb99-e3d5-40d2-9842-b98265d286f1 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:42.426078 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fcb99-e3d5-40d2-9842-b98265d286f1 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:42.426078 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fcb99-e3d5-40d2-9842-b98265d286f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:42.449389 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-719fcb99-e3d5-40d2-9842-b98265d286f1 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:42.450403 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-719fcb99-e3d5-40d2-9842-b98265d286f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:42.543216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1003/2014] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:18:42.553456 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a7188-bec3-459d-a257-1e374793db7f None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:42.553914 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a7188-bec3-459d-a257-1e374793db7f None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:42.554296 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a7188-bec3-459d-a257-1e374793db7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:42.593058 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-a43a7188-bec3-459d-a257-1e374793db7f None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:42.593058 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a43a7188-bec3-459d-a257-1e374793db7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:42.606591 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1012/2015] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:42.607173 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719fcb99-e3d5-40d2-9842-b98265d286f1 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:42.620196 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719fcb99-e3d5-40d2-9842-b98265d286f1 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:42.626171 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b8f81-7487-478c-bd98-18ae2421a613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:42.627344 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b8f81-7487-478c-bd98-18ae2421a613 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:42.628362 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b8f81-7487-478c-bd98-18ae2421a613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:42.628840 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b8f81-7487-478c-bd98-18ae2421a613 admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:42.629827 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b8f81-7487-478c-bd98-18ae2421a613 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:18:42.630008 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b8f81-7487-478c-bd98-18ae2421a613 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:42.632052 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b8f81-7487-478c-bd98-18ae2421a613 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:42.652571 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43a7188-bec3-459d-a257-1e374793db7f None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:42.660108 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1004/2016] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:18:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:18:42.661101 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b8f81-7487-478c-bd98-18ae2421a613 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:42.663264 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f69b8f81-7487-478c-bd98-18ae2421a613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:42.665913 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43a7188-bec3-459d-a257-1e374793db7f None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:42.671790 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e7a00-448f-4ed9-8a0e-149c9d9658c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:42.672414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e7a00-448f-4ed9-8a0e-149c9d9658c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:42.672695 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e7a00-448f-4ed9-8a0e-149c9d9658c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:42.672969 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e7a00-448f-4ed9-8a0e-149c9d9658c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:42.673611 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e7a00-448f-4ed9-8a0e-149c9d9658c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:42.682083 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e7a00-448f-4ed9-8a0e-149c9d9658c9 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:42.726424 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1013/2017] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:18:42 2022] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:42.726424 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e7a00-448f-4ed9-8a0e-149c9d9658c9 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:42.745177 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b8f81-7487-478c-bd98-18ae2421a613 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:42.807165 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e7a00-448f-4ed9-8a0e-149c9d9658c9 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:42.811892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e4147-ff16-4249-9fa8-8d1290a14e21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:42.812171 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f093cc-4217-4760-9392-1511a16662e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:42.812676 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e4147-ff16-4249-9fa8-8d1290a14e21 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:42.812782 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f093cc-4217-4760-9392-1511a16662e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:42.813015 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e4147-ff16-4249-9fa8-8d1290a14e21 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:42.813128 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f093cc-4217-4760-9392-1511a16662e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:42.813288 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e4147-ff16-4249-9fa8-8d1290a14e21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:42.813364 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f093cc-4217-4760-9392-1511a16662e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:42.814223 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f093cc-4217-4760-9392-1511a16662e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:42.816012 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-758e4147-ff16-4249-9fa8-8d1290a14e21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:42.817410 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f093cc-4217-4760-9392-1511a16662e1 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:42.842496 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1014/2018] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:18:42 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:42.843041 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f093cc-4217-4760-9392-1511a16662e1 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:42.848086 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-88f093cc-4217-4760-9392-1511a16662e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:42.862344 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f093cc-4217-4760-9392-1511a16662e1 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:42.868253 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad780a70-23f2-46a4-abb1-871115a553f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:42.868878 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad780a70-23f2-46a4-abb1-871115a553f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:42.869182 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad780a70-23f2-46a4-abb1-871115a553f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:42.869440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad780a70-23f2-46a4-abb1-871115a553f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:42.871310 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ad780a70-23f2-46a4-abb1-871115a553f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:42.871870 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:42.886587 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e4147-ff16-4249-9fa8-8d1290a14e21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:42.888047 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e4147-ff16-4249-9fa8-8d1290a14e21 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:42.897947 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1005/2019] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:42 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:42.898710 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e4147-ff16-4249-9fa8-8d1290a14e21 service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:42.916951 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e4147-ff16-4249-9fa8-8d1290a14e21 service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:42.923793 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1c3bf-c8c0-4af5-8a6f-3a8c90acd969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:42.925173 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1c3bf-c8c0-4af5-8a6f-3a8c90acd969 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:42.925618 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1c3bf-c8c0-4af5-8a6f-3a8c90acd969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:42.926107 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1c3bf-c8c0-4af5-8a6f-3a8c90acd969 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:42.926808 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d1c3bf-c8c0-4af5-8a6f-3a8c90acd969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:42.928996 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d1c3bf-c8c0-4af5-8a6f-3a8c90acd969 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:42.954971 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad780a70-23f2-46a4-abb1-871115a553f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:42.957966 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad780a70-23f2-46a4-abb1-871115a553f0 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:42.963818 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1006/2020] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:42.965268 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1c3bf-c8c0-4af5-8a6f-3a8c90acd969 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:42.965384 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:42.973194 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1015/2021] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:42.980374 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1c3bf-c8c0-4af5-8a6f-3a8c90acd969 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:42.986231 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9ee0f-c720-4194-93c7-c6d6bb08aa59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:42.987390 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9ee0f-c720-4194-93c7-c6d6bb08aa59 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:42.987720 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9ee0f-c720-4194-93c7-c6d6bb08aa59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:42.987994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9ee0f-c720-4194-93c7-c6d6bb08aa59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:42.988638 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9ee0f-c720-4194-93c7-c6d6bb08aa59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:42.990272 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9ee0f-c720-4194-93c7-c6d6bb08aa59 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:43.005001 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1007/2022] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:43.008338 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad780a70-23f2-46a4-abb1-871115a553f0 service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:43.021002 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad780a70-23f2-46a4-abb1-871115a553f0 service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:43.027299 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd484bd3-bf4b-41f0-903e-610e7d854611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:43.028269 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd484bd3-bf4b-41f0-903e-610e7d854611 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:43.028790 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd484bd3-bf4b-41f0-903e-610e7d854611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:43.029359 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd484bd3-bf4b-41f0-903e-610e7d854611 admin admin] PATH_INFO: `/v3/projects/0ececb2c2b7f4d9f96ec20a816b0b355/users/5c3088c47f9b48f1ba612140a06da7cf/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:43.056781 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd484bd3-bf4b-41f0-903e-610e7d854611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ececb2c2b7f4d9f96ec20a816b0b355, user_id=5c3088c47f9b48f1ba612140a06da7cf, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:43.060411 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd484bd3-bf4b-41f0-903e-610e7d854611 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:43.079283 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1016/2023] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:43 2022] PUT /identity/v3/projects/0ececb2c2b7f4d9f96ec20a816b0b355/users/5c3088c47f9b48f1ba612140a06da7cf/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:43.097202 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33250939-3144-41c8-8f78-232b4ae0b79f None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:43.097557 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33250939-3144-41c8-8f78-232b4ae0b79f None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:43.097749 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33250939-3144-41c8-8f78-232b4ae0b79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:43.143379 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-33250939-3144-41c8-8f78-232b4ae0b79f None None] MFA Rules not processed for user `5c3088c47f9b48f1ba612140a06da7cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:43.145566 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-33250939-3144-41c8-8f78-232b4ae0b79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:43.233498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1008/2024] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:43.905419 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd484bd3-bf4b-41f0-903e-610e7d854611 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:43.966908 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd484bd3-bf4b-41f0-903e-610e7d854611 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:43.970544 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f130cf-4e68-424e-8a9f-1f17c4550f73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:43.971928 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f130cf-4e68-424e-8a9f-1f17c4550f73 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:43.972243 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f130cf-4e68-424e-8a9f-1f17c4550f73 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:43.972521 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f130cf-4e68-424e-8a9f-1f17c4550f73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:43.980953 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f130cf-4e68-424e-8a9f-1f17c4550f73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:43.982379 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f130cf-4e68-424e-8a9f-1f17c4550f73 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:43.992103 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1017/2025] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:45.034983 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33250939-3144-41c8-8f78-232b4ae0b79f None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:45.036497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-33250939-3144-41c8-8f78-232b4ae0b79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:45.103758 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33250939-3144-41c8-8f78-232b4ae0b79f None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:45.108589 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834da30d-0869-44ea-a503-ebf6ee8a17db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:45.109258 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834da30d-0869-44ea-a503-ebf6ee8a17db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:45.109488 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834da30d-0869-44ea-a503-ebf6ee8a17db admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:45.109944 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834da30d-0869-44ea-a503-ebf6ee8a17db admin admin] PATH_INFO: `/v3/users/f383cf01470d42ba9fd0b31b0652c4cd` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:45.110917 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834da30d-0869-44ea-a503-ebf6ee8a17db admin admin] RBAC: Authorizing `identity:delete_user(user_id=f383cf01470d42ba9fd0b31b0652c4cd)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:45.113312 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834da30d-0869-44ea-a503-ebf6ee8a17db admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:45.157909 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-834da30d-0869-44ea-a503-ebf6ee8a17db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f383cf01470d42ba9fd0b31b0652c4cd'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:45.158611 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-834da30d-0869-44ea-a503-ebf6ee8a17db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f383cf01470d42ba9fd0b31b0652c4cd'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:45.167745 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:45.174594 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-834da30d-0869-44ea-a503-ebf6ee8a17db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f383cf01470d42ba9fd0b31b0652c4cd'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:45.181495 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-834da30d-0869-44ea-a503-ebf6ee8a17db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f383cf01470d42ba9fd0b31b0652c4cd'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:45.189021 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-834da30d-0869-44ea-a503-ebf6ee8a17db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f383cf01470d42ba9fd0b31b0652c4cd'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:45.195544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1009/2026] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:18:45 2022] DELETE /identity/v3/users/f383cf01470d42ba9fd0b31b0652c4cd => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:45.200542 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dddae8-35a4-45b1-af55-7900307b7326 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:45.201071 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dddae8-35a4-45b1-af55-7900307b7326 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:45.201213 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dddae8-35a4-45b1-af55-7900307b7326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:45.220581 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-46dddae8-35a4-45b1-af55-7900307b7326 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:45.222630 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-46dddae8-35a4-45b1-af55-7900307b7326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:45.287508 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1018/2027] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:18:45.298231 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834da30d-0869-44ea-a503-ebf6ee8a17db admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:45.299790 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-834da30d-0869-44ea-a503-ebf6ee8a17db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:45.361145 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834da30d-0869-44ea-a503-ebf6ee8a17db admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:45.364920 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838cd82-1a6a-469f-8d90-85a301764015 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:45.365566 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838cd82-1a6a-469f-8d90-85a301764015 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:45.365848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838cd82-1a6a-469f-8d90-85a301764015 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:45.366119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838cd82-1a6a-469f-8d90-85a301764015 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:45.375059 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838cd82-1a6a-469f-8d90-85a301764015 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:45.376553 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838cd82-1a6a-469f-8d90-85a301764015 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:45.387134 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1010/2028] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:46.018221 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dddae8-35a4-45b1-af55-7900307b7326 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:46.020652 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-46dddae8-35a4-45b1-af55-7900307b7326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:46.037638 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dddae8-35a4-45b1-af55-7900307b7326 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:46.043555 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9cf2e6-0167-4858-83fb-e8e260653688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:46.044186 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9cf2e6-0167-4858-83fb-e8e260653688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:46.044765 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9cf2e6-0167-4858-83fb-e8e260653688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:46.045199 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9cf2e6-0167-4858-83fb-e8e260653688 admin admin] PATH_INFO: `/v3/projects/87e153dec4704938afc279e424915eba` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:46.047844 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9cf2e6-0167-4858-83fb-e8e260653688 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87e153dec4704938afc279e424915eba)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:46.051903 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9cf2e6-0167-4858-83fb-e8e260653688 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:46.123332 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1e9cf2e6-0167-4858-83fb-e8e260653688 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87e153dec4704938afc279e424915eba', 'request_id': 'req-1e9cf2e6-0167-4858-83fb-e8e260653688'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:46.130024 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1e9cf2e6-0167-4858-83fb-e8e260653688 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87e153dec4704938afc279e424915eba', 'request_id': 'req-1e9cf2e6-0167-4858-83fb-e8e260653688'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:46.137777 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1e9cf2e6-0167-4858-83fb-e8e260653688 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87e153dec4704938afc279e424915eba', 'request_id': 'req-1e9cf2e6-0167-4858-83fb-e8e260653688'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:46.162704 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1e9cf2e6-0167-4858-83fb-e8e260653688 admin admin] The token cache is being invalidate because project 87e153dec4704938afc279e424915eba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:18:46.162871 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1e9cf2e6-0167-4858-83fb-e8e260653688 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:46.163749 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1e9cf2e6-0167-4858-83fb-e8e260653688 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:46.166307 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1019/2029] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:18:46 2022] DELETE /identity/v3/projects/87e153dec4704938afc279e424915eba => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:46.170933 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838cd82-1a6a-469f-8d90-85a301764015 service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:46.183529 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838cd82-1a6a-469f-8d90-85a301764015 service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:46.268276 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5728b-3deb-4368-abb9-466e2b1c9dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:46.269073 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5728b-3deb-4368-abb9-466e2b1c9dd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:46.269353 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5728b-3deb-4368-abb9-466e2b1c9dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:46.269670 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5728b-3deb-4368-abb9-466e2b1c9dd1 admin admin] PATH_INFO: `/v3/users/37bdccad6fea4a9b9ad8dc70cd78a4c0` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:46.270993 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5728b-3deb-4368-abb9-466e2b1c9dd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37bdccad6fea4a9b9ad8dc70cd78a4c0)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:46.278796 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5728b-3deb-4368-abb9-466e2b1c9dd1 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:46.344867 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-c5a5728b-3deb-4368-abb9-466e2b1c9dd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37bdccad6fea4a9b9ad8dc70cd78a4c0'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:46.345534 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-c5a5728b-3deb-4368-abb9-466e2b1c9dd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37bdccad6fea4a9b9ad8dc70cd78a4c0'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:46.361475 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-c5a5728b-3deb-4368-abb9-466e2b1c9dd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37bdccad6fea4a9b9ad8dc70cd78a4c0'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:46.370100 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-c5a5728b-3deb-4368-abb9-466e2b1c9dd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37bdccad6fea4a9b9ad8dc70cd78a4c0'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:46.373816 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:46.387399 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-c5a5728b-3deb-4368-abb9-466e2b1c9dd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37bdccad6fea4a9b9ad8dc70cd78a4c0'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:46.398265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1011/2030] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:18:46 2022] DELETE /identity/v3/users/37bdccad6fea4a9b9ad8dc70cd78a4c0 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:46.436153 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9cf2e6-0167-4858-83fb-e8e260653688 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:46.437753 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1e9cf2e6-0167-4858-83fb-e8e260653688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:46.447488 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:46.456638 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9cf2e6-0167-4858-83fb-e8e260653688 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:46.534764 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab7f5e-e9bb-4c2c-bc77-4c8625c0db64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:46.535873 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab7f5e-e9bb-4c2c-bc77-4c8625c0db64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:46.536341 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab7f5e-e9bb-4c2c-bc77-4c8625c0db64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:46.536765 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab7f5e-e9bb-4c2c-bc77-4c8625c0db64 admin admin] PATH_INFO: `/v3/users/0a19b4a13271418fb9ab2674549b5453` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:46.538092 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ab7f5e-e9bb-4c2c-bc77-4c8625c0db64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a19b4a13271418fb9ab2674549b5453)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:46.540076 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ab7f5e-e9bb-4c2c-bc77-4c8625c0db64 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:46.607904 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-c8ab7f5e-e9bb-4c2c-bc77-4c8625c0db64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a19b4a13271418fb9ab2674549b5453'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:46.616729 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-c8ab7f5e-e9bb-4c2c-bc77-4c8625c0db64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a19b4a13271418fb9ab2674549b5453'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:46.623941 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-c8ab7f5e-e9bb-4c2c-bc77-4c8625c0db64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a19b4a13271418fb9ab2674549b5453'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:46.638392 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-c8ab7f5e-e9bb-4c2c-bc77-4c8625c0db64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a19b4a13271418fb9ab2674549b5453'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:46.639133 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-c8ab7f5e-e9bb-4c2c-bc77-4c8625c0db64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a19b4a13271418fb9ab2674549b5453'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:46.645193 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1020/2031] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:18:46 2022] DELETE /identity/v3/users/0a19b4a13271418fb9ab2674549b5453 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:46.649890 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e356d22-95ef-49c6-8026-edeece16d581 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:46.650177 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e356d22-95ef-49c6-8026-edeece16d581 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:46.650533 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e356d22-95ef-49c6-8026-edeece16d581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:46.671949 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-4e356d22-95ef-49c6-8026-edeece16d581 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:46.673340 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-4e356d22-95ef-49c6-8026-edeece16d581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:46.700403 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab7f5e-e9bb-4c2c-bc77-4c8625c0db64 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:46.701945 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c8ab7f5e-e9bb-4c2c-bc77-4c8625c0db64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:46.742794 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1012/2032] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:46.752654 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e356d22-95ef-49c6-8026-edeece16d581 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:46.755055 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-4e356d22-95ef-49c6-8026-edeece16d581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:46.781791 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab7f5e-e9bb-4c2c-bc77-4c8625c0db64 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:46.786681 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fed15f-743b-4c27-bda3-ff11fbc7f2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:46.787412 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fed15f-743b-4c27-bda3-ff11fbc7f2fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:46.788631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fed15f-743b-4c27-bda3-ff11fbc7f2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:46.788909 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fed15f-743b-4c27-bda3-ff11fbc7f2fa admin admin] PATH_INFO: `/v3/projects/327917193f0e4f2d87f5ab4b7885f8ed` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:46.790040 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fed15f-743b-4c27-bda3-ff11fbc7f2fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=327917193f0e4f2d87f5ab4b7885f8ed)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:46.792007 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fed15f-743b-4c27-bda3-ff11fbc7f2fa admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:46.813936 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e356d22-95ef-49c6-8026-edeece16d581 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:46.817340 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:46.819017 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1c8e7-d741-4ead-bb57-fd50da7ab27b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:46.819659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1c8e7-d741-4ead-bb57-fd50da7ab27b service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:46.819944 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1c8e7-d741-4ead-bb57-fd50da7ab27b service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:46.820291 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1c8e7-d741-4ead-bb57-fd50da7ab27b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:46.831242 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc1c8e7-d741-4ead-bb57-fd50da7ab27b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:46.832810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc1c8e7-d741-4ead-bb57-fd50da7ab27b service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:46.843501 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1013/2033] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:18:46.845440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-f5fed15f-743b-4c27-bda3-ff11fbc7f2fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '327917193f0e4f2d87f5ab4b7885f8ed', 'request_id': 'req-f5fed15f-743b-4c27-bda3-ff11fbc7f2fa'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:46.851997 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-f5fed15f-743b-4c27-bda3-ff11fbc7f2fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '327917193f0e4f2d87f5ab4b7885f8ed', 'request_id': 'req-f5fed15f-743b-4c27-bda3-ff11fbc7f2fa'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:46.858265 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-f5fed15f-743b-4c27-bda3-ff11fbc7f2fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '327917193f0e4f2d87f5ab4b7885f8ed', 'request_id': 'req-f5fed15f-743b-4c27-bda3-ff11fbc7f2fa'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:46.873684 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-f5fed15f-743b-4c27-bda3-ff11fbc7f2fa admin admin] The token cache is being invalidate because project 327917193f0e4f2d87f5ab4b7885f8ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:18:46.873976 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-f5fed15f-743b-4c27-bda3-ff11fbc7f2fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:46.874656 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-f5fed15f-743b-4c27-bda3-ff11fbc7f2fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:46.877814 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1021/2034] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:18:46 2022] DELETE /identity/v3/projects/327917193f0e4f2d87f5ab4b7885f8ed => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:18:46.882613 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbeba73-d756-4cf9-a18f-864838cc7b79 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:46.882906 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbeba73-d756-4cf9-a18f-864838cc7b79 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:46.883190 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbeba73-d756-4cf9-a18f-864838cc7b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:46.904400 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-4bbeba73-d756-4cf9-a18f-864838cc7b79 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:46.905350 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-4bbeba73-d756-4cf9-a18f-864838cc7b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:46.992565 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1014/2035] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:46.994528 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a91694-c50a-4b22-a6d9-95fd2372995d None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:46.994811 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a91694-c50a-4b22-a6d9-95fd2372995d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:46.995078 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a91694-c50a-4b22-a6d9-95fd2372995d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:47.005105 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbeba73-d756-4cf9-a18f-864838cc7b79 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:47.006943 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-4bbeba73-d756-4cf9-a18f-864838cc7b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:47.024653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbeba73-d756-4cf9-a18f-864838cc7b79 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:47.033834 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130cbaf6-ad86-4531-87d3-05def818510a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:47.036392 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cbaf6-ad86-4531-87d3-05def818510a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:47.036392 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cbaf6-ad86-4531-87d3-05def818510a admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:47.036392 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cbaf6-ad86-4531-87d3-05def818510a admin admin] PATH_INFO: `/v3/users/63ef72f756b04adab3746fa37d23df3c` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:47.037873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130cbaf6-ad86-4531-87d3-05def818510a admin admin] RBAC: Authorizing `identity:delete_user(user_id=63ef72f756b04adab3746fa37d23df3c)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:47.039735 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130cbaf6-ad86-4531-87d3-05def818510a admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:47.055318 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-54a91694-c50a-4b22-a6d9-95fd2372995d None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:47.064276 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-54a91694-c50a-4b22-a6d9-95fd2372995d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:47.081602 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1022/2036] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:47.086663 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a91694-c50a-4b22-a6d9-95fd2372995d None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:47.101485 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a91694-c50a-4b22-a6d9-95fd2372995d None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:47.113326 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbdaf65-40c1-4d50-a018-8d47afafb2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:47.114394 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdaf65-40c1-4d50-a018-8d47afafb2a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:47.115037 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdaf65-40c1-4d50-a018-8d47afafb2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:47.115452 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdaf65-40c1-4d50-a018-8d47afafb2a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:47.116326 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbdaf65-40c1-4d50-a018-8d47afafb2a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:18:47.116858 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbdaf65-40c1-4d50-a018-8d47afafb2a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:47.118328 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:47.120299 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbdaf65-40c1-4d50-a018-8d47afafb2a1 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:47.136317 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-130cbaf6-ad86-4531-87d3-05def818510a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63ef72f756b04adab3746fa37d23df3c'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:47.137254 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-130cbaf6-ad86-4531-87d3-05def818510a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63ef72f756b04adab3746fa37d23df3c'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:47.138896 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1023/2037] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:18:47.143363 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbdaf65-40c1-4d50-a018-8d47afafb2a1 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:47.156559 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-130cbaf6-ad86-4531-87d3-05def818510a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63ef72f756b04adab3746fa37d23df3c'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:47.162021 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbdaf65-40c1-4d50-a018-8d47afafb2a1 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:47.165385 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-130cbaf6-ad86-4531-87d3-05def818510a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63ef72f756b04adab3746fa37d23df3c'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:47.176752 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ceb40-733f-48d0-a651-cd7d5a672473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:47.177204 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-130cbaf6-ad86-4531-87d3-05def818510a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63ef72f756b04adab3746fa37d23df3c'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:47.177682 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ceb40-733f-48d0-a651-cd7d5a672473 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:47.177682 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ceb40-733f-48d0-a651-cd7d5a672473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:47.177921 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ceb40-733f-48d0-a651-cd7d5a672473 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:47.178606 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ceb40-733f-48d0-a651-cd7d5a672473 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:47.180684 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ceb40-733f-48d0-a651-cd7d5a672473 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:47.187625 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1015/2038] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:18:47 2022] DELETE /identity/v3/users/63ef72f756b04adab3746fa37d23df3c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:18:47.195683 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a4d49-573c-496a-8967-86f2a5803b71 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:47.196176 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a4d49-573c-496a-8967-86f2a5803b71 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:47.196652 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a4d49-573c-496a-8967-86f2a5803b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:47.219059 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1024/2039] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:18:47 2022] POST /identity/v3/projects => generated 371 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:47.222711 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-827a4d49-573c-496a-8967-86f2a5803b71 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:47.223704 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ceb40-733f-48d0-a651-cd7d5a672473 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:47.224357 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-827a4d49-573c-496a-8967-86f2a5803b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:47.225574 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-588ceb40-733f-48d0-a651-cd7d5a672473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:47.358605 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1016/2040] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:47.359228 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a4d49-573c-496a-8967-86f2a5803b71 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:47.369412 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ceb40-733f-48d0-a651-cd7d5a672473 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:47.374545 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fae8b5-f484-4b2a-899a-4c6e19953833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:47.375207 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fae8b5-f484-4b2a-899a-4c6e19953833 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:47.375492 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fae8b5-f484-4b2a-899a-4c6e19953833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:47.375767 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fae8b5-f484-4b2a-899a-4c6e19953833 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:47.376468 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-827a4d49-573c-496a-8967-86f2a5803b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:47.376575 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fae8b5-f484-4b2a-899a-4c6e19953833 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:47.378628 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fae8b5-f484-4b2a-899a-4c6e19953833 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:47.394326 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a4d49-573c-496a-8967-86f2a5803b71 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:47.401044 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d474ac-f251-4d23-a605-53ce84f8ed2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:47.401764 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d474ac-f251-4d23-a605-53ce84f8ed2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:47.402042 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d474ac-f251-4d23-a605-53ce84f8ed2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:47.402307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d474ac-f251-4d23-a605-53ce84f8ed2a admin admin] PATH_INFO: `/v3/projects/a9482093e65b431f86d820d5211ab486` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:47.403608 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d474ac-f251-4d23-a605-53ce84f8ed2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9482093e65b431f86d820d5211ab486)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:47.405594 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d474ac-f251-4d23-a605-53ce84f8ed2a admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:47.413361 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1025/2041] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:18:47 2022] POST /identity/v3/users => generated 286 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:47.413361 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fae8b5-f484-4b2a-899a-4c6e19953833 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:47.413596 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c7fae8b5-f484-4b2a-899a-4c6e19953833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:47.428742 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fae8b5-f484-4b2a-899a-4c6e19953833 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:47.434960 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cd7d6-3f5b-4c0b-9735-d3413a9b3bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:47.435559 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cd7d6-3f5b-4c0b-9735-d3413a9b3bcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:47.435846 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cd7d6-3f5b-4c0b-9735-d3413a9b3bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:47.436154 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cd7d6-3f5b-4c0b-9735-d3413a9b3bcb admin admin] PATH_INFO: `/v3/users/c861c35f9c51480b887310b6dae5d04b` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:47.437570 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52cd7d6-3f5b-4c0b-9735-d3413a9b3bcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c861c35f9c51480b887310b6dae5d04b)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:47.440599 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52cd7d6-3f5b-4c0b-9735-d3413a9b3bcb admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:47.461279 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a8d474ac-f251-4d23-a605-53ce84f8ed2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9482093e65b431f86d820d5211ab486', 'request_id': 'req-a8d474ac-f251-4d23-a605-53ce84f8ed2a'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:47.468851 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a8d474ac-f251-4d23-a605-53ce84f8ed2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9482093e65b431f86d820d5211ab486', 'request_id': 'req-a8d474ac-f251-4d23-a605-53ce84f8ed2a'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:47.480380 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a8d474ac-f251-4d23-a605-53ce84f8ed2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9482093e65b431f86d820d5211ab486', 'request_id': 'req-a8d474ac-f251-4d23-a605-53ce84f8ed2a'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:47.494668 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a8d474ac-f251-4d23-a605-53ce84f8ed2a admin admin] The token cache is being invalidate because project a9482093e65b431f86d820d5211ab486 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:18:47.495069 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a8d474ac-f251-4d23-a605-53ce84f8ed2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:47.495783 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a8d474ac-f251-4d23-a605-53ce84f8ed2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:47.497546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1017/2042] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:18:47 2022] DELETE /identity/v3/projects/a9482093e65b431f86d820d5211ab486 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:47.498654 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d474ac-f251-4d23-a605-53ce84f8ed2a admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:47.500018 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-a8d474ac-f251-4d23-a605-53ce84f8ed2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:47.505797 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e52cd7d6-3f5b-4c0b-9735-d3413a9b3bcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c861c35f9c51480b887310b6dae5d04b'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:47.515932 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e52cd7d6-3f5b-4c0b-9735-d3413a9b3bcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c861c35f9c51480b887310b6dae5d04b'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:47.519041 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=80,keystone:DELETE=14,keystone:INSERT=6 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:47.539090 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e52cd7d6-3f5b-4c0b-9735-d3413a9b3bcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c861c35f9c51480b887310b6dae5d04b'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:47.567753 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:47.571610 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e52cd7d6-3f5b-4c0b-9735-d3413a9b3bcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c861c35f9c51480b887310b6dae5d04b'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:47.572599 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e52cd7d6-3f5b-4c0b-9735-d3413a9b3bcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c861c35f9c51480b887310b6dae5d04b'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:47.582433 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1026/2043] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:18:47 2022] DELETE /identity/v3/users/c861c35f9c51480b887310b6dae5d04b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:47.583285 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cd7d6-3f5b-4c0b-9735-d3413a9b3bcb admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:47.584653 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e52cd7d6-3f5b-4c0b-9735-d3413a9b3bcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:47.602182 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d474ac-f251-4d23-a605-53ce84f8ed2a admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:47.681267 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e9def-5f36-4df3-9e34-4e02c738a572 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:47.681979 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e9def-5f36-4df3-9e34-4e02c738a572 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:47.682334 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e9def-5f36-4df3-9e34-4e02c738a572 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:47.682714 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e9def-5f36-4df3-9e34-4e02c738a572 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:47.684794 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d00e9def-5f36-4df3-9e34-4e02c738a572 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:47.686089 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cd7d6-3f5b-4c0b-9735-d3413a9b3bcb admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:47.698022 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52143e6-6d19-407e-86e8-e00e6a215d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:47.698734 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52143e6-6d19-407e-86e8-e00e6a215d19 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:47.698999 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52143e6-6d19-407e-86e8-e00e6a215d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:47.699224 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52143e6-6d19-407e-86e8-e00e6a215d19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:47.700014 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52143e6-6d19-407e-86e8-e00e6a215d19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:47.700110 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e9def-5f36-4df3-9e34-4e02c738a572 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:47.701818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52143e6-6d19-407e-86e8-e00e6a215d19 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:47.702130 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e9def-5f36-4df3-9e34-4e02c738a572 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:47.713126 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1018/2044] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:47.714001 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1027/2045] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:47.714765 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52143e6-6d19-407e-86e8-e00e6a215d19 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:47.716683 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b52143e6-6d19-407e-86e8-e00e6a215d19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:47.724347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e310d-25b9-4da9-891d-5ba8a5dddd85 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:47.725027 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e310d-25b9-4da9-891d-5ba8a5dddd85 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:47.725801 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e310d-25b9-4da9-891d-5ba8a5dddd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:47.731058 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52143e6-6d19-407e-86e8-e00e6a215d19 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:47.749448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccba932-2b9a-464e-85c6-f1327b6c0f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:47.749448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccba932-2b9a-464e-85c6-f1327b6c0f14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:47.749448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccba932-2b9a-464e-85c6-f1327b6c0f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:47.749448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccba932-2b9a-464e-85c6-f1327b6c0f14 admin admin] PATH_INFO: `/v3/users/627763e338444f0392b54b87f223bd98` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:47.750358 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccba932-2b9a-464e-85c6-f1327b6c0f14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=627763e338444f0392b54b87f223bd98)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:47.750358 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccba932-2b9a-464e-85c6-f1327b6c0f14 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:47.750538 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-684e310d-25b9-4da9-891d-5ba8a5dddd85 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:47.750538 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-684e310d-25b9-4da9-891d-5ba8a5dddd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:47.757948 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1019/2046] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:47.758860 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e310d-25b9-4da9-891d-5ba8a5dddd85 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:47.768750 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e310d-25b9-4da9-891d-5ba8a5dddd85 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:47.775055 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706e69a-0461-448c-a993-9c386753e8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:47.775695 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706e69a-0461-448c-a993-9c386753e8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:47.775945 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706e69a-0461-448c-a993-9c386753e8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:47.776217 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706e69a-0461-448c-a993-9c386753e8d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:47.776975 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706e69a-0461-448c-a993-9c386753e8d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:47.778731 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706e69a-0461-448c-a993-9c386753e8d9 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:47.794644 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1020/2047] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:47.796538 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706e69a-0461-448c-a993-9c386753e8d9 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:47.799111 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-4706e69a-0461-448c-a993-9c386753e8d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:47.801432 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9ccba932-2b9a-464e-85c6-f1327b6c0f14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '627763e338444f0392b54b87f223bd98'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:47.810698 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9ccba932-2b9a-464e-85c6-f1327b6c0f14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '627763e338444f0392b54b87f223bd98'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:47.814380 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706e69a-0461-448c-a993-9c386753e8d9 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:47.819685 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393718d-9b90-4db8-84b9-fc7e358c043d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:47.820162 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9ccba932-2b9a-464e-85c6-f1327b6c0f14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '627763e338444f0392b54b87f223bd98'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:47.820353 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393718d-9b90-4db8-84b9-fc7e358c043d service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:47.820618 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393718d-9b90-4db8-84b9-fc7e358c043d service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:47.821252 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393718d-9b90-4db8-84b9-fc7e358c043d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:47.832999 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3393718d-9b90-4db8-84b9-fc7e358c043d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:47.834491 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3393718d-9b90-4db8-84b9-fc7e358c043d service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:47.838046 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9ccba932-2b9a-464e-85c6-f1327b6c0f14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '627763e338444f0392b54b87f223bd98'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:47.838966 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9ccba932-2b9a-464e-85c6-f1327b6c0f14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '627763e338444f0392b54b87f223bd98'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:47.844610 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1021/2048] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:47.848703 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1028/2049] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:18:47 2022] DELETE /identity/v3/users/627763e338444f0392b54b87f223bd98 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:47.848892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393718d-9b90-4db8-84b9-fc7e358c043d service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:47.857651 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393718d-9b90-4db8-84b9-fc7e358c043d service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:47.929782 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b1143-4ef5-4220-9273-912fd24ae718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:47.930578 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b1143-4ef5-4220-9273-912fd24ae718 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:47.930865 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b1143-4ef5-4220-9273-912fd24ae718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:47.931144 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b1143-4ef5-4220-9273-912fd24ae718 admin admin] PATH_INFO: `/v3/projects/b183a289c159406098e2f2bb2a570ecf/users/68e6d3f15b8d4b3598895e2470096fd0/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:47.951816 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b1143-4ef5-4220-9273-912fd24ae718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b183a289c159406098e2f2bb2a570ecf, user_id=68e6d3f15b8d4b3598895e2470096fd0, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:47.955437 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b1143-4ef5-4220-9273-912fd24ae718 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:47.979034 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1022/2050] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:47 2022] PUT /identity/v3/projects/b183a289c159406098e2f2bb2a570ecf/users/68e6d3f15b8d4b3598895e2470096fd0/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:47.991155 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d75269-c8ed-4a21-995e-211ffb3bbe74 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:47.991618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d75269-c8ed-4a21-995e-211ffb3bbe74 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:47.991924 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d75269-c8ed-4a21-995e-211ffb3bbe74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:48.028807 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-48d75269-c8ed-4a21-995e-211ffb3bbe74 None None] MFA Rules not processed for user `68e6d3f15b8d4b3598895e2470096fd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:48.030432 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-48d75269-c8ed-4a21-995e-211ffb3bbe74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:48.065381 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:48.120419 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1029/2051] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:48.125303 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b1143-4ef5-4220-9273-912fd24ae718 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:48.127546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-530b1143-4ef5-4220-9273-912fd24ae718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:48.193136 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:48.216334 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b1143-4ef5-4220-9273-912fd24ae718 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:48.222961 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121eb5b-2ee2-414e-b47f-1c918d931f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:48.223785 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121eb5b-2ee2-414e-b47f-1c918d931f5d admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:48.224145 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121eb5b-2ee2-414e-b47f-1c918d931f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:48.224537 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121eb5b-2ee2-414e-b47f-1c918d931f5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:48.225420 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f121eb5b-2ee2-414e-b47f-1c918d931f5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:48.227627 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f121eb5b-2ee2-414e-b47f-1c918d931f5d admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:48.232982 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d75269-c8ed-4a21-995e-211ffb3bbe74 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:48.234894 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-48d75269-c8ed-4a21-995e-211ffb3bbe74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:48.262800 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d75269-c8ed-4a21-995e-211ffb3bbe74 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:48.270099 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10f9ee-0d11-4e3c-be82-9715ebee49f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:48.270794 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10f9ee-0d11-4e3c-be82-9715ebee49f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:48.271071 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10f9ee-0d11-4e3c-be82-9715ebee49f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:48.271344 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10f9ee-0d11-4e3c-be82-9715ebee49f2 admin admin] PATH_INFO: `/v3/projects/72305cb8cc2f408d99c82ac8e0aa080d` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:48.272638 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e10f9ee-0d11-4e3c-be82-9715ebee49f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72305cb8cc2f408d99c82ac8e0aa080d)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:48.274802 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e10f9ee-0d11-4e3c-be82-9715ebee49f2 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:48.289742 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1023/2052] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:18:48 2022] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:48.289742 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121eb5b-2ee2-414e-b47f-1c918d931f5d admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:48.289742 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f121eb5b-2ee2-414e-b47f-1c918d931f5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:48.337572 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0e10f9ee-0d11-4e3c-be82-9715ebee49f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72305cb8cc2f408d99c82ac8e0aa080d', 'request_id': 'req-0e10f9ee-0d11-4e3c-be82-9715ebee49f2'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:48.346074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0e10f9ee-0d11-4e3c-be82-9715ebee49f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72305cb8cc2f408d99c82ac8e0aa080d', 'request_id': 'req-0e10f9ee-0d11-4e3c-be82-9715ebee49f2'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:48.353818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0e10f9ee-0d11-4e3c-be82-9715ebee49f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72305cb8cc2f408d99c82ac8e0aa080d', 'request_id': 'req-0e10f9ee-0d11-4e3c-be82-9715ebee49f2'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:48.369340 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0e10f9ee-0d11-4e3c-be82-9715ebee49f2 admin admin] The token cache is being invalidate because project 72305cb8cc2f408d99c82ac8e0aa080d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:18:48.369632 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0e10f9ee-0d11-4e3c-be82-9715ebee49f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:48.370280 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0e10f9ee-0d11-4e3c-be82-9715ebee49f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:48.375462 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1030/2053] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:18:48 2022] DELETE /identity/v3/projects/72305cb8cc2f408d99c82ac8e0aa080d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:48.376291 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10f9ee-0d11-4e3c-be82-9715ebee49f2 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:48.378876 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0e10f9ee-0d11-4e3c-be82-9715ebee49f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:48.389165 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121eb5b-2ee2-414e-b47f-1c918d931f5d admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:48.452414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10f9ee-0d11-4e3c-be82-9715ebee49f2 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:48.453298 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05246f3d-a32d-453b-8b60-6d7ecbbc3a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:48.454303 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05246f3d-a32d-453b-8b60-6d7ecbbc3a81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:48.454752 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05246f3d-a32d-453b-8b60-6d7ecbbc3a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:48.455394 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05246f3d-a32d-453b-8b60-6d7ecbbc3a81 admin admin] PATH_INFO: `/v3/projects/610ae6f02c4e453c9246d5623aec11bf` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:48.456867 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05246f3d-a32d-453b-8b60-6d7ecbbc3a81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=610ae6f02c4e453c9246d5623aec11bf)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:48.458958 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05246f3d-a32d-453b-8b60-6d7ecbbc3a81 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:48.459324 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e0070-8ca2-410a-8013-b49071757e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:48.459977 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e0070-8ca2-410a-8013-b49071757e63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:48.460264 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e0070-8ca2-410a-8013-b49071757e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:48.460549 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e0070-8ca2-410a-8013-b49071757e63 admin admin] PATH_INFO: `/v3/projects/1860198bac1b4dff94ee086d2e858665` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:48.461696 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e0070-8ca2-410a-8013-b49071757e63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1860198bac1b4dff94ee086d2e858665)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:48.463702 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e0070-8ca2-410a-8013-b49071757e63 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:48.510120 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-05246f3d-a32d-453b-8b60-6d7ecbbc3a81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '610ae6f02c4e453c9246d5623aec11bf', 'request_id': 'req-05246f3d-a32d-453b-8b60-6d7ecbbc3a81'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:48.514871 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a95e0070-8ca2-410a-8013-b49071757e63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1860198bac1b4dff94ee086d2e858665', 'request_id': 'req-a95e0070-8ca2-410a-8013-b49071757e63'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:48.515912 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-05246f3d-a32d-453b-8b60-6d7ecbbc3a81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '610ae6f02c4e453c9246d5623aec11bf', 'request_id': 'req-05246f3d-a32d-453b-8b60-6d7ecbbc3a81'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:48.519382 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:48.521752 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a95e0070-8ca2-410a-8013-b49071757e63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1860198bac1b4dff94ee086d2e858665', 'request_id': 'req-a95e0070-8ca2-410a-8013-b49071757e63'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:48.523242 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-05246f3d-a32d-453b-8b60-6d7ecbbc3a81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '610ae6f02c4e453c9246d5623aec11bf', 'request_id': 'req-05246f3d-a32d-453b-8b60-6d7ecbbc3a81'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:48.528477 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a95e0070-8ca2-410a-8013-b49071757e63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1860198bac1b4dff94ee086d2e858665', 'request_id': 'req-a95e0070-8ca2-410a-8013-b49071757e63'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:48.543866 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a95e0070-8ca2-410a-8013-b49071757e63 admin admin] The token cache is being invalidate because project 1860198bac1b4dff94ee086d2e858665 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:18:48.544276 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a95e0070-8ca2-410a-8013-b49071757e63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:48.545190 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a95e0070-8ca2-410a-8013-b49071757e63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:48.547043 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1031/2054] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:18:48 2022] DELETE /identity/v3/projects/1860198bac1b4dff94ee086d2e858665 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:48.547514 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e0070-8ca2-410a-8013-b49071757e63 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:48.548926 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a95e0070-8ca2-410a-8013-b49071757e63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:48.550717 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-05246f3d-a32d-453b-8b60-6d7ecbbc3a81 admin admin] The token cache is being invalidate because project 610ae6f02c4e453c9246d5623aec11bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:18:48.551089 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-05246f3d-a32d-453b-8b60-6d7ecbbc3a81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:48.551830 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-05246f3d-a32d-453b-8b60-6d7ecbbc3a81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:48.554236 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1024/2055] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:18:48 2022] DELETE /identity/v3/projects/610ae6f02c4e453c9246d5623aec11bf => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:48.555504 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05246f3d-a32d-453b-8b60-6d7ecbbc3a81 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:48.556976 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-05246f3d-a32d-453b-8b60-6d7ecbbc3a81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:48.568321 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:48.615445 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e0070-8ca2-410a-8013-b49071757e63 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:48.620452 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309597a-624c-418c-8635-b675cfe054c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:48.621055 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309597a-624c-418c-8635-b675cfe054c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:48.621332 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309597a-624c-418c-8635-b675cfe054c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:48.621614 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309597a-624c-418c-8635-b675cfe054c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:48.622246 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0309597a-624c-418c-8635-b675cfe054c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:48.624186 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0309597a-624c-418c-8635-b675cfe054c6 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:48.631689 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05246f3d-a32d-453b-8b60-6d7ecbbc3a81 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:48.636967 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35f386-50c1-429c-b7e2-9b153be12463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:48.637743 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35f386-50c1-429c-b7e2-9b153be12463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:48.638060 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35f386-50c1-429c-b7e2-9b153be12463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:48.638822 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35f386-50c1-429c-b7e2-9b153be12463 admin admin] PATH_INFO: `/v3/users/7f2d293bf82648cb937b093f1f9accde` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:48.640332 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec35f386-50c1-429c-b7e2-9b153be12463 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f2d293bf82648cb937b093f1f9accde)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:48.642410 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec35f386-50c1-429c-b7e2-9b153be12463 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:48.646988 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1032/2056] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:18:48 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:48.647805 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309597a-624c-418c-8635-b675cfe054c6 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:48.649364 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0309597a-624c-418c-8635-b675cfe054c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:48.663186 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309597a-624c-418c-8635-b675cfe054c6 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:48.669393 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00a1ae-1793-40f1-b331-9e18a2ff4a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:48.670136 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00a1ae-1793-40f1-b331-9e18a2ff4a04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:48.670449 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00a1ae-1793-40f1-b331-9e18a2ff4a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:48.670830 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00a1ae-1793-40f1-b331-9e18a2ff4a04 admin admin] PATH_INFO: `/v3/users/5150d54de81142ccbb4fecbada9bc05a` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:48.672145 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b00a1ae-1793-40f1-b331-9e18a2ff4a04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5150d54de81142ccbb4fecbada9bc05a)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:48.674189 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b00a1ae-1793-40f1-b331-9e18a2ff4a04 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:48.696108 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-ec35f386-50c1-429c-b7e2-9b153be12463 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f2d293bf82648cb937b093f1f9accde'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:48.697178 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-ec35f386-50c1-429c-b7e2-9b153be12463 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f2d293bf82648cb937b093f1f9accde'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:48.713175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-ec35f386-50c1-429c-b7e2-9b153be12463 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f2d293bf82648cb937b093f1f9accde'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:48.727452 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-ec35f386-50c1-429c-b7e2-9b153be12463 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f2d293bf82648cb937b093f1f9accde'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:48.737492 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-ec35f386-50c1-429c-b7e2-9b153be12463 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f2d293bf82648cb937b093f1f9accde'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:48.740967 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9b00a1ae-1793-40f1-b331-9e18a2ff4a04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5150d54de81142ccbb4fecbada9bc05a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:48.744796 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1025/2057] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:18:48 2022] DELETE /identity/v3/users/7f2d293bf82648cb937b093f1f9accde => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:48.745310 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35f386-50c1-429c-b7e2-9b153be12463 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:48.756109 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9b00a1ae-1793-40f1-b331-9e18a2ff4a04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5150d54de81142ccbb4fecbada9bc05a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:48.759410 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-ec35f386-50c1-429c-b7e2-9b153be12463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:48.767064 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9b00a1ae-1793-40f1-b331-9e18a2ff4a04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5150d54de81142ccbb4fecbada9bc05a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:48.786382 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9b00a1ae-1793-40f1-b331-9e18a2ff4a04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5150d54de81142ccbb4fecbada9bc05a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:48.787222 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9b00a1ae-1793-40f1-b331-9e18a2ff4a04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5150d54de81142ccbb4fecbada9bc05a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:48.798921 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1033/2058] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:18:48 2022] DELETE /identity/v3/users/5150d54de81142ccbb4fecbada9bc05a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:48.799990 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00a1ae-1793-40f1-b331-9e18a2ff4a04 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:48.801801 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9b00a1ae-1793-40f1-b331-9e18a2ff4a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:48.880364 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35f386-50c1-429c-b7e2-9b153be12463 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:48.898639 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:DELETE=12,keystone:SELECT=83,keystone:INSERT=5 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:48.939168 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00a1ae-1793-40f1-b331-9e18a2ff4a04 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:48.945321 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d31621-de65-4a82-a619-dfd49ce9d464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:48.946174 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d31621-de65-4a82-a619-dfd49ce9d464 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:48.946668 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d31621-de65-4a82-a619-dfd49ce9d464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:48.947122 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d31621-de65-4a82-a619-dfd49ce9d464 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:48.948066 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d31621-de65-4a82-a619-dfd49ce9d464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:48.950191 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d31621-de65-4a82-a619-dfd49ce9d464 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:48.951699 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:48.966293 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1034/2059] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:48.972800 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d31621-de65-4a82-a619-dfd49ce9d464 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:48.989101 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d31621-de65-4a82-a619-dfd49ce9d464 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:48.990933 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a06f7b-679c-49d4-b07d-60fff87d263c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:48.991717 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a06f7b-679c-49d4-b07d-60fff87d263c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:48.992090 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a06f7b-679c-49d4-b07d-60fff87d263c admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:48.992440 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a06f7b-679c-49d4-b07d-60fff87d263c admin admin] PATH_INFO: `/v3/users/a0c2fa81aad74be8be5e90e1fdb6759c` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:48.994326 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a06f7b-679c-49d4-b07d-60fff87d263c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0c2fa81aad74be8be5e90e1fdb6759c)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:48.996256 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3ef4e-e81d-477c-817e-b1938b84250c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:48.997132 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3ef4e-e81d-477c-817e-b1938b84250c admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:48.998585 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a06f7b-679c-49d4-b07d-60fff87d263c admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:48.998782 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3ef4e-e81d-477c-817e-b1938b84250c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:48.998782 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3ef4e-e81d-477c-817e-b1938b84250c admin admin] PATH_INFO: `/v3/projects/09daf638e2f94f0e92533737e7c91d60/users/084893bae79a4ca2b3d63d92818ea6fe/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:49.029200 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3ef4e-e81d-477c-817e-b1938b84250c admin admin] RBAC: Authorizing `identity:create_grant(project_id=09daf638e2f94f0e92533737e7c91d60, user_id=084893bae79a4ca2b3d63d92818ea6fe, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:49.032244 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3ef4e-e81d-477c-817e-b1938b84250c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:49.075039 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1035/2060] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:48 2022] PUT /identity/v3/projects/09daf638e2f94f0e92533737e7c91d60/users/084893bae79a4ca2b3d63d92818ea6fe/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:18:49.076694 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3ef4e-e81d-477c-817e-b1938b84250c admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:49.087179 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-59a06f7b-679c-49d4-b07d-60fff87d263c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0c2fa81aad74be8be5e90e1fdb6759c'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:49.087899 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-59a06f7b-679c-49d4-b07d-60fff87d263c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0c2fa81aad74be8be5e90e1fdb6759c'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:49.107614 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-59a06f7b-679c-49d4-b07d-60fff87d263c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0c2fa81aad74be8be5e90e1fdb6759c'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:49.116630 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-59a06f7b-679c-49d4-b07d-60fff87d263c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0c2fa81aad74be8be5e90e1fdb6759c'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:49.136449 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-59a06f7b-679c-49d4-b07d-60fff87d263c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0c2fa81aad74be8be5e90e1fdb6759c'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:49.146769 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1026/2061] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:18:48 2022] DELETE /identity/v3/users/a0c2fa81aad74be8be5e90e1fdb6759c => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:49.196066 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3ef4e-e81d-477c-817e-b1938b84250c admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:49.267145 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313566b-918a-49a4-832b-bbde1ef66c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:49.268529 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313566b-918a-49a4-832b-bbde1ef66c5a admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:49.268691 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313566b-918a-49a4-832b-bbde1ef66c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:49.268856 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313566b-918a-49a4-832b-bbde1ef66c5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:49.269504 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a313566b-918a-49a4-832b-bbde1ef66c5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:49.271158 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a313566b-918a-49a4-832b-bbde1ef66c5a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:49.285613 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1036/2062] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:49.289414 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a06f7b-679c-49d4-b07d-60fff87d263c admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:49.290944 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-59a06f7b-679c-49d4-b07d-60fff87d263c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:49.312851 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a06f7b-679c-49d4-b07d-60fff87d263c admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:49.319508 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3aefd-31e7-4928-9a0a-4805c7e70c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:49.320640 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3aefd-31e7-4928-9a0a-4805c7e70c0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:49.320982 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3aefd-31e7-4928-9a0a-4805c7e70c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:49.321313 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3aefd-31e7-4928-9a0a-4805c7e70c0b admin admin] PATH_INFO: `/v3/projects/09daf638e2f94f0e92533737e7c91d60/users/084893bae79a4ca2b3d63d92818ea6fe/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:49.323611 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b3aefd-31e7-4928-9a0a-4805c7e70c0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=09daf638e2f94f0e92533737e7c91d60, user_id=084893bae79a4ca2b3d63d92818ea6fe, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:49.327866 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b3aefd-31e7-4928-9a0a-4805c7e70c0b admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:49.341190 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1027/2063] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:49 2022] PUT /identity/v3/projects/09daf638e2f94f0e92533737e7c91d60/users/084893bae79a4ca2b3d63d92818ea6fe/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:49.358326 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fd2d1-daf9-420f-a1ce-f074d3ec111d None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:49.358926 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fd2d1-daf9-420f-a1ce-f074d3ec111d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:49.359230 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fd2d1-daf9-420f-a1ce-f074d3ec111d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:49.364111 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3aefd-31e7-4928-9a0a-4805c7e70c0b admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:49.367354 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-76b3aefd-31e7-4928-9a0a-4805c7e70c0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:49.423129 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-c99fd2d1-daf9-420f-a1ce-f074d3ec111d None None] MFA Rules not processed for user `084893bae79a4ca2b3d63d92818ea6fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:49.424654 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c99fd2d1-daf9-420f-a1ce-f074d3ec111d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:49.463079 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3aefd-31e7-4928-9a0a-4805c7e70c0b admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:49.469180 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c61b57-a395-4f2f-8bde-bbb2598476a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:49.470119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c61b57-a395-4f2f-8bde-bbb2598476a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:49.470318 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c61b57-a395-4f2f-8bde-bbb2598476a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:49.470855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c61b57-a395-4f2f-8bde-bbb2598476a6 admin admin] PATH_INFO: `/v3/projects/7cffcb5d95ce46329b1f8c1f7d289546` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:49.472785 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c61b57-a395-4f2f-8bde-bbb2598476a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cffcb5d95ce46329b1f8c1f7d289546)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:49.475270 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c61b57-a395-4f2f-8bde-bbb2598476a6 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:49.500996 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:49.543519 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:49.551546 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1037/2064] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:49 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:49.552090 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fd2d1-daf9-420f-a1ce-f074d3ec111d None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:49.553322 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-21c61b57-a395-4f2f-8bde-bbb2598476a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cffcb5d95ce46329b1f8c1f7d289546', 'request_id': 'req-21c61b57-a395-4f2f-8bde-bbb2598476a6'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:49.558806 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c99fd2d1-daf9-420f-a1ce-f074d3ec111d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:49.563990 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-21c61b57-a395-4f2f-8bde-bbb2598476a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cffcb5d95ce46329b1f8c1f7d289546', 'request_id': 'req-21c61b57-a395-4f2f-8bde-bbb2598476a6'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:49.581960 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-21c61b57-a395-4f2f-8bde-bbb2598476a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cffcb5d95ce46329b1f8c1f7d289546', 'request_id': 'req-21c61b57-a395-4f2f-8bde-bbb2598476a6'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:49.582801 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fd2d1-daf9-420f-a1ce-f074d3ec111d None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:49.601565 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-21c61b57-a395-4f2f-8bde-bbb2598476a6 admin admin] The token cache is being invalidate because project 7cffcb5d95ce46329b1f8c1f7d289546 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:18:49.601923 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-21c61b57-a395-4f2f-8bde-bbb2598476a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:49.603779 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-21c61b57-a395-4f2f-8bde-bbb2598476a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:49.604620 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1028/2065] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:18:49 2022] DELETE /identity/v3/projects/7cffcb5d95ce46329b1f8c1f7d289546 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:49.607959 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c61b57-a395-4f2f-8bde-bbb2598476a6 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:49.607959 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-21c61b57-a395-4f2f-8bde-bbb2598476a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:49.661566 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb69db-9443-43a3-9961-e28edc6399d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:49.662610 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb69db-9443-43a3-9961-e28edc6399d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:49.663082 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb69db-9443-43a3-9961-e28edc6399d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:49.663357 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb69db-9443-43a3-9961-e28edc6399d5 admin admin] PATH_INFO: `/v3/projects/8f1ccd5bf814440d8cf2d7d5f3801eef` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:49.664493 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb69db-9443-43a3-9961-e28edc6399d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f1ccd5bf814440d8cf2d7d5f3801eef)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:49.666411 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb69db-9443-43a3-9961-e28edc6399d5 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:49.686123 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c61b57-a395-4f2f-8bde-bbb2598476a6 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:49.691525 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a622d-a4a1-4b6e-a30c-39b91acbb417 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:49.693166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a622d-a4a1-4b6e-a30c-39b91acbb417 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:49.693516 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a622d-a4a1-4b6e-a30c-39b91acbb417 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:49.695260 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a622d-a4a1-4b6e-a30c-39b91acbb417 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:49.698560 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f34a622d-a4a1-4b6e-a30c-39b91acbb417 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:49.718818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-73fb69db-9443-43a3-9961-e28edc6399d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f1ccd5bf814440d8cf2d7d5f3801eef', 'request_id': 'req-73fb69db-9443-43a3-9961-e28edc6399d5'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:49.726148 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-73fb69db-9443-43a3-9961-e28edc6399d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f1ccd5bf814440d8cf2d7d5f3801eef', 'request_id': 'req-73fb69db-9443-43a3-9961-e28edc6399d5'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:49.733203 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-73fb69db-9443-43a3-9961-e28edc6399d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f1ccd5bf814440d8cf2d7d5f3801eef', 'request_id': 'req-73fb69db-9443-43a3-9961-e28edc6399d5'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:49.747879 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-73fb69db-9443-43a3-9961-e28edc6399d5 admin admin] The token cache is being invalidate because project 8f1ccd5bf814440d8cf2d7d5f3801eef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:18:49.748459 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-73fb69db-9443-43a3-9961-e28edc6399d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:49.749200 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-73fb69db-9443-43a3-9961-e28edc6399d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:49.751262 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1038/2066] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:18:49 2022] DELETE /identity/v3/projects/8f1ccd5bf814440d8cf2d7d5f3801eef => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:49.752689 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01634cb8-a773-4186-8c72-1c15a4b0de95 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:49.752819 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01634cb8-a773-4186-8c72-1c15a4b0de95 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:49.753190 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01634cb8-a773-4186-8c72-1c15a4b0de95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:49.773927 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a622d-a4a1-4b6e-a30c-39b91acbb417 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:49.775427 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a622d-a4a1-4b6e-a30c-39b91acbb417 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:49.776542 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-01634cb8-a773-4186-8c72-1c15a4b0de95 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:49.777966 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-01634cb8-a773-4186-8c72-1c15a4b0de95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:49.786168 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1029/2067] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:49.787661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e63f8-a53e-456e-8ce8-d541438694a3 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:49.787947 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e63f8-a53e-456e-8ce8-d541438694a3 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:49.788222 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e63f8-a53e-456e-8ce8-d541438694a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:49.810103 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-763e63f8-a53e-456e-8ce8-d541438694a3 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:49.811746 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-763e63f8-a53e-456e-8ce8-d541438694a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:49.870617 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1039/2068] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:49.880452 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b16b52-fb31-429f-b393-50b3bc129fb5 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:49.880761 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b16b52-fb31-429f-b393-50b3bc129fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:49.881010 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b16b52-fb31-429f-b393-50b3bc129fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:49.907011 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1030/2069] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:49.910586 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-91b16b52-fb31-429f-b393-50b3bc129fb5 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:49.911000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad141d-725c-4da9-89e9-636908e6d426 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:49.911361 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad141d-725c-4da9-89e9-636908e6d426 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:49.911711 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad141d-725c-4da9-89e9-636908e6d426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:49.911898 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-91b16b52-fb31-429f-b393-50b3bc129fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:49.923813 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1040/2070] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:18:49.926767 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b16b52-fb31-429f-b393-50b3bc129fb5 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:49.938497 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b16b52-fb31-429f-b393-50b3bc129fb5 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:49.943883 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-08ad141d-725c-4da9-89e9-636908e6d426 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:49.944610 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d84d8-d3fe-4c34-a638-ae565c2ed9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:49.945622 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-08ad141d-725c-4da9-89e9-636908e6d426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:49.946538 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d84d8-d3fe-4c34-a638-ae565c2ed9d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:49.946825 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d84d8-d3fe-4c34-a638-ae565c2ed9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:49.947102 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d84d8-d3fe-4c34-a638-ae565c2ed9d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:49.947764 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d84d8-d3fe-4c34-a638-ae565c2ed9d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:18:49.948070 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d84d8-d3fe-4c34-a638-ae565c2ed9d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:49.949791 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d84d8-d3fe-4c34-a638-ae565c2ed9d8 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:49.952996 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:49.961943 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1031/2071] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:49.967385 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad141d-725c-4da9-89e9-636908e6d426 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:49.973716 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1041/2072] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:18:49.978356 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d84d8-d3fe-4c34-a638-ae565c2ed9d8 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:49.991888 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad141d-725c-4da9-89e9-636908e6d426 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:50.001020 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09eae96-05d2-4031-bad1-6421d6708f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:50.002531 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09eae96-05d2-4031-bad1-6421d6708f29 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:50.002995 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09eae96-05d2-4031-bad1-6421d6708f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:50.003407 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09eae96-05d2-4031-bad1-6421d6708f29 admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:50.004800 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09eae96-05d2-4031-bad1-6421d6708f29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:18:50.005249 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09eae96-05d2-4031-bad1-6421d6708f29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:50.006208 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d84d8-d3fe-4c34-a638-ae565c2ed9d8 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:50.007020 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09eae96-05d2-4031-bad1-6421d6708f29 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:50.016115 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ce2f1-49b0-4735-b21d-2a4378f10d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:50.017217 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ce2f1-49b0-4735-b21d-2a4378f10d9c admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:50.018790 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ce2f1-49b0-4735-b21d-2a4378f10d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:50.019453 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ce2f1-49b0-4735-b21d-2a4378f10d9c admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:50.020914 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ce2f1-49b0-4735-b21d-2a4378f10d9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:50.023901 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1032/2073] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:18:50.025852 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ce2f1-49b0-4735-b21d-2a4378f10d9c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:50.031366 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09eae96-05d2-4031-bad1-6421d6708f29 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:50.034716 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f09eae96-05d2-4031-bad1-6421d6708f29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:50.054544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09eae96-05d2-4031-bad1-6421d6708f29 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:50.073602 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223141e9-e2b2-4d5b-93a3-d7048d68194e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:50.074545 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223141e9-e2b2-4d5b-93a3-d7048d68194e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:50.074833 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223141e9-e2b2-4d5b-93a3-d7048d68194e admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:50.075108 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223141e9-e2b2-4d5b-93a3-d7048d68194e admin admin] PATH_INFO: `/v3/users/5c3088c47f9b48f1ba612140a06da7cf` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:50.076413 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223141e9-e2b2-4d5b-93a3-d7048d68194e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c3088c47f9b48f1ba612140a06da7cf)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:50.078983 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223141e9-e2b2-4d5b-93a3-d7048d68194e admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:50.083696 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1042/2074] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:18:49 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:18:50.083696 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ce2f1-49b0-4735-b21d-2a4378f10d9c admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:50.085005 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:50.174794 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-223141e9-e2b2-4d5b-93a3-d7048d68194e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c3088c47f9b48f1ba612140a06da7cf'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:50.176163 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-223141e9-e2b2-4d5b-93a3-d7048d68194e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c3088c47f9b48f1ba612140a06da7cf'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:50.201744 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-223141e9-e2b2-4d5b-93a3-d7048d68194e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c3088c47f9b48f1ba612140a06da7cf'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:50.225953 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-223141e9-e2b2-4d5b-93a3-d7048d68194e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c3088c47f9b48f1ba612140a06da7cf'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:50.234439 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ce2f1-49b0-4735-b21d-2a4378f10d9c admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:50.242209 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-223141e9-e2b2-4d5b-93a3-d7048d68194e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c3088c47f9b48f1ba612140a06da7cf'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:50.247598 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce50520-5d9a-4ddb-95d6-b69869a5e537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:50.248992 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce50520-5d9a-4ddb-95d6-b69869a5e537 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:50.254831 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1033/2075] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:18:50 2022] DELETE /identity/v3/users/5c3088c47f9b48f1ba612140a06da7cf => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:50.254831 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223141e9-e2b2-4d5b-93a3-d7048d68194e admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:50.256057 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce50520-5d9a-4ddb-95d6-b69869a5e537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:50.256616 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce50520-5d9a-4ddb-95d6-b69869a5e537 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:50.259493 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce50520-5d9a-4ddb-95d6-b69869a5e537 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:50.267164 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce50520-5d9a-4ddb-95d6-b69869a5e537 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:50.290207 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-223141e9-e2b2-4d5b-93a3-d7048d68194e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:50.352643 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1043/2076] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:18:50 2022] POST /identity/v3/projects => generated 385 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:50.352643 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce50520-5d9a-4ddb-95d6-b69869a5e537 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:50.354728 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7ce50520-5d9a-4ddb-95d6-b69869a5e537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:50.443110 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce50520-5d9a-4ddb-95d6-b69869a5e537 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:50.448319 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b607cbf-28ac-439c-a3f6-d5d3ec89b65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:50.449009 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b607cbf-28ac-439c-a3f6-d5d3ec89b65d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:50.450223 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b607cbf-28ac-439c-a3f6-d5d3ec89b65d admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:50.451173 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b607cbf-28ac-439c-a3f6-d5d3ec89b65d admin admin] PATH_INFO: `/v3/projects/c9ac6ae8bc28422898c27649e77bedb8` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:50.452726 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b607cbf-28ac-439c-a3f6-d5d3ec89b65d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9ac6ae8bc28422898c27649e77bedb8)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:50.456593 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b607cbf-28ac-439c-a3f6-d5d3ec89b65d admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:50.496925 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223141e9-e2b2-4d5b-93a3-d7048d68194e admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:50.503956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb32952-1dd6-4aa2-9be8-ac4ca1372f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:50.505757 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb32952-1dd6-4aa2-9be8-ac4ca1372f1b admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:50.506662 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb32952-1dd6-4aa2-9be8-ac4ca1372f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:50.507164 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb32952-1dd6-4aa2-9be8-ac4ca1372f1b admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:50.509223 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb32952-1dd6-4aa2-9be8-ac4ca1372f1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:50.512334 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb32952-1dd6-4aa2-9be8-ac4ca1372f1b admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:50.521737 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4b607cbf-28ac-439c-a3f6-d5d3ec89b65d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9ac6ae8bc28422898c27649e77bedb8', 'request_id': 'req-4b607cbf-28ac-439c-a3f6-d5d3ec89b65d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:50.530622 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4b607cbf-28ac-439c-a3f6-d5d3ec89b65d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9ac6ae8bc28422898c27649e77bedb8', 'request_id': 'req-4b607cbf-28ac-439c-a3f6-d5d3ec89b65d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:50.534855 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:50.548105 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4b607cbf-28ac-439c-a3f6-d5d3ec89b65d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9ac6ae8bc28422898c27649e77bedb8', 'request_id': 'req-4b607cbf-28ac-439c-a3f6-d5d3ec89b65d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:50.556237 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1034/2077] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:18:50 2022] POST /identity/v3/users => generated 291 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:50.558164 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17266fa-d964-4c00-948e-302d428d84a9 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:50.558823 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17266fa-d964-4c00-948e-302d428d84a9 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:50.559895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17266fa-d964-4c00-948e-302d428d84a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:50.588406 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4b607cbf-28ac-439c-a3f6-d5d3ec89b65d admin admin] The token cache is being invalidate because project c9ac6ae8bc28422898c27649e77bedb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:18:50.588786 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4b607cbf-28ac-439c-a3f6-d5d3ec89b65d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:50.590099 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-a17266fa-d964-4c00-948e-302d428d84a9 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:50.593226 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-a17266fa-d964-4c00-948e-302d428d84a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:50.594710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4b607cbf-28ac-439c-a3f6-d5d3ec89b65d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:50.602273 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1044/2078] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:18:50 2022] DELETE /identity/v3/projects/c9ac6ae8bc28422898c27649e77bedb8 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:50.602273 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b607cbf-28ac-439c-a3f6-d5d3ec89b65d admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:50.602273 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4b607cbf-28ac-439c-a3f6-d5d3ec89b65d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:50.680836 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1035/2079] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:50.682029 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17266fa-d964-4c00-948e-302d428d84a9 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:50.683430 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-a17266fa-d964-4c00-948e-302d428d84a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:50.695965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17266fa-d964-4c00-948e-302d428d84a9 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:50.701126 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4388f63-4ec2-4279-9b5b-7a2089e939df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:50.701740 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4388f63-4ec2-4279-9b5b-7a2089e939df admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:50.702026 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4388f63-4ec2-4279-9b5b-7a2089e939df admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:50.702303 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4388f63-4ec2-4279-9b5b-7a2089e939df admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:50.703000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4388f63-4ec2-4279-9b5b-7a2089e939df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:50.704604 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4388f63-4ec2-4279-9b5b-7a2089e939df admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:50.706419 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b607cbf-28ac-439c-a3f6-d5d3ec89b65d admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:50.710699 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:50.711813 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528a527-1211-4376-9eef-6e70e507494e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:50.712543 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528a527-1211-4376-9eef-6e70e507494e admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:50.714325 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528a527-1211-4376-9eef-6e70e507494e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:50.714325 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528a527-1211-4376-9eef-6e70e507494e admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:50.714325 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9528a527-1211-4376-9eef-6e70e507494e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:50.716744 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9528a527-1211-4376-9eef-6e70e507494e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:50.728692 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1036/2080] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:50.729986 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98602c90-d04b-4dc0-b072-2d82a5d3c6ed None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:50.730270 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98602c90-d04b-4dc0-b072-2d82a5d3c6ed None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:50.732056 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98602c90-d04b-4dc0-b072-2d82a5d3c6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:50.744925 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1045/2081] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:18:50 2022] POST /identity/v3/users => generated 293 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:50.746271 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528a527-1211-4376-9eef-6e70e507494e admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:50.749505 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9528a527-1211-4376-9eef-6e70e507494e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:50.762570 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-98602c90-d04b-4dc0-b072-2d82a5d3c6ed None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:50.764333 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-98602c90-d04b-4dc0-b072-2d82a5d3c6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:50.775538 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1037/2082] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:50.776601 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98602c90-d04b-4dc0-b072-2d82a5d3c6ed None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:50.793477 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98602c90-d04b-4dc0-b072-2d82a5d3c6ed None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:50.800842 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc35ed33-4b7c-4c8e-b5b4-f125c34d5247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:50.801450 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35ed33-4b7c-4c8e-b5b4-f125c34d5247 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:50.801945 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35ed33-4b7c-4c8e-b5b4-f125c34d5247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:50.802057 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35ed33-4b7c-4c8e-b5b4-f125c34d5247 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:50.802745 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc35ed33-4b7c-4c8e-b5b4-f125c34d5247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:50.804515 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc35ed33-4b7c-4c8e-b5b4-f125c34d5247 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:50.817318 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1038/2083] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:50.818391 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc35ed33-4b7c-4c8e-b5b4-f125c34d5247 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:50.824227 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528a527-1211-4376-9eef-6e70e507494e admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:50.828715 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af1b17-5dac-4fcc-a04c-6124c02e5894 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:50.829425 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af1b17-5dac-4fcc-a04c-6124c02e5894 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:50.829775 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af1b17-5dac-4fcc-a04c-6124c02e5894 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:50.830150 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af1b17-5dac-4fcc-a04c-6124c02e5894 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:50.832175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc35ed33-4b7c-4c8e-b5b4-f125c34d5247 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:50.839291 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c19dbc-9127-483e-b851-65008ffd1714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:50.840094 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c19dbc-9127-483e-b851-65008ffd1714 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:50.840378 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c19dbc-9127-483e-b851-65008ffd1714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:50.840648 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c19dbc-9127-483e-b851-65008ffd1714 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:50.841352 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c19dbc-9127-483e-b851-65008ffd1714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:50.843216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c19dbc-9127-483e-b851-65008ffd1714 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:50.851225 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8af1b17-5dac-4fcc-a04c-6124c02e5894 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:50.853710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8af1b17-5dac-4fcc-a04c-6124c02e5894 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:50.859644 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1039/2084] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:50.859644 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7084b5-b1d1-483c-a77a-3ff5309671f9 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:50.859644 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7084b5-b1d1-483c-a77a-3ff5309671f9 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:50.859644 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7084b5-b1d1-483c-a77a-3ff5309671f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:50.871014 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1046/2085] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:50.871014 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af1b17-5dac-4fcc-a04c-6124c02e5894 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:50.880771 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af1b17-5dac-4fcc-a04c-6124c02e5894 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:50.883411 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-dc7084b5-b1d1-483c-a77a-3ff5309671f9 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:50.884624 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-dc7084b5-b1d1-483c-a77a-3ff5309671f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:50.886536 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cff445-c82e-406a-b2f9-f32983ae1eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:50.887934 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cff445-c82e-406a-b2f9-f32983ae1eaa admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:50.888320 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cff445-c82e-406a-b2f9-f32983ae1eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:50.888704 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cff445-c82e-406a-b2f9-f32983ae1eaa admin admin] PATH_INFO: `/v3/projects/78eb8ee37bf74133aba6564c5c0bfce8/users/f4d7b10cf5c244f5bf2edf4b6ffce9d5/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:50.898294 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1040/2086] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:50.899454 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7084b5-b1d1-483c-a77a-3ff5309671f9 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:50.905994 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cff445-c82e-406a-b2f9-f32983ae1eaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=78eb8ee37bf74133aba6564c5c0bfce8, user_id=f4d7b10cf5c244f5bf2edf4b6ffce9d5, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:50.911113 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cff445-c82e-406a-b2f9-f32983ae1eaa admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:50.919257 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7084b5-b1d1-483c-a77a-3ff5309671f9 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:50.926901 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea31951-5bf7-47ba-803e-31a6fae6bfe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:50.927708 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea31951-5bf7-47ba-803e-31a6fae6bfe3 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:50.928084 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea31951-5bf7-47ba-803e-31a6fae6bfe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:50.928400 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea31951-5bf7-47ba-803e-31a6fae6bfe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:50.929904 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea31951-5bf7-47ba-803e-31a6fae6bfe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:50.933213 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea31951-5bf7-47ba-803e-31a6fae6bfe3 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:50.937192 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1047/2087] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:50 2022] PUT /identity/v3/projects/78eb8ee37bf74133aba6564c5c0bfce8/users/f4d7b10cf5c244f5bf2edf4b6ffce9d5/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:50.939491 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cff445-c82e-406a-b2f9-f32983ae1eaa admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:50.958710 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1041/2088] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:50.958710 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38297f49-d02e-4a3c-801d-68e1827be066 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:50.958710 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38297f49-d02e-4a3c-801d-68e1827be066 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:50.958710 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38297f49-d02e-4a3c-801d-68e1827be066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:51.004967 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-38297f49-d02e-4a3c-801d-68e1827be066 None None] MFA Rules not processed for user `f4d7b10cf5c244f5bf2edf4b6ffce9d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:51.006278 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-38297f49-d02e-4a3c-801d-68e1827be066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:51.052181 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:51.058356 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cff445-c82e-406a-b2f9-f32983ae1eaa admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:51.065943 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df7c87-47aa-4718-882f-83f83f70056f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:51.066676 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df7c87-47aa-4718-882f-83f83f70056f admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:51.067031 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df7c87-47aa-4718-882f-83f83f70056f admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:51.067376 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df7c87-47aa-4718-882f-83f83f70056f admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:51.068109 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df7c87-47aa-4718-882f-83f83f70056f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:18:51.068488 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df7c87-47aa-4718-882f-83f83f70056f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:51.070230 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df7c87-47aa-4718-882f-83f83f70056f admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:51.087920 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1048/2089] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:18:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:18:51.087920 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df7c87-47aa-4718-882f-83f83f70056f admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:51.098785 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1042/2090] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:51.098785 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38297f49-d02e-4a3c-801d-68e1827be066 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:51.111580 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38297f49-d02e-4a3c-801d-68e1827be066 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:51.115158 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df7c87-47aa-4718-882f-83f83f70056f admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:51.116976 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cd2a16-3320-427d-95d6-4348ceae6018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:51.117459 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd2a16-3320-427d-95d6-4348ceae6018 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:51.117737 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd2a16-3320-427d-95d6-4348ceae6018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:51.118017 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd2a16-3320-427d-95d6-4348ceae6018 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:51.118688 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cd2a16-3320-427d-95d6-4348ceae6018 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:51.120600 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cd2a16-3320-427d-95d6-4348ceae6018 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:51.126879 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3fcaa6-cd13-4745-8016-21620cbca153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:51.127325 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fcaa6-cd13-4745-8016-21620cbca153 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:51.128079 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fcaa6-cd13-4745-8016-21620cbca153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:51.128370 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fcaa6-cd13-4745-8016-21620cbca153 admin admin] PATH_INFO: `/v3/projects/1fc8628fdf1f4c6397a70d300114da1a/users/6752b3066eec4d8383967a6c11460d26/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:51.147639 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3fcaa6-cd13-4745-8016-21620cbca153 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fc8628fdf1f4c6397a70d300114da1a, user_id=6752b3066eec4d8383967a6c11460d26, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:51.153840 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3fcaa6-cd13-4745-8016-21620cbca153 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:51.156545 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1043/2091] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:18:51 2022] POST /identity/v3/projects => generated 409 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:51.162542 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cd2a16-3320-427d-95d6-4348ceae6018 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:51.176094 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1049/2092] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:51 2022] PUT /identity/v3/projects/1fc8628fdf1f4c6397a70d300114da1a/users/6752b3066eec4d8383967a6c11460d26/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:51.183802 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3fcaa6-cd13-4745-8016-21620cbca153 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:51.243901 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cd2a16-3320-427d-95d6-4348ceae6018 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:51.266954 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3fcaa6-cd13-4745-8016-21620cbca153 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:51.273193 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1fe225-73f1-4f18-bfbe-99efa6ac832d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:51.278050 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:51.282743 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1fe225-73f1-4f18-bfbe-99efa6ac832d admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:51.284661 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1fe225-73f1-4f18-bfbe-99efa6ac832d admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:51.285825 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1fe225-73f1-4f18-bfbe-99efa6ac832d admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:51.286625 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1fe225-73f1-4f18-bfbe-99efa6ac832d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:51.290675 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1fe225-73f1-4f18-bfbe-99efa6ac832d admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:51.318800 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1050/2093] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:18:51 2022] POST /identity/v3/users => generated 305 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:51.320195 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd67512-74ca-44c4-9321-173dc066c914 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:51.320487 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd67512-74ca-44c4-9321-173dc066c914 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:51.320775 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd67512-74ca-44c4-9321-173dc066c914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:51.331973 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44765506-d9b8-4b76-8dec-1cab7571f48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:51.332598 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44765506-d9b8-4b76-8dec-1cab7571f48a admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:51.332877 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44765506-d9b8-4b76-8dec-1cab7571f48a admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:51.333147 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44765506-d9b8-4b76-8dec-1cab7571f48a admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:51.333785 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44765506-d9b8-4b76-8dec-1cab7571f48a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:51.337883 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44765506-d9b8-4b76-8dec-1cab7571f48a admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:51.357985 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-2fd67512-74ca-44c4-9321-173dc066c914 None None] MFA Rules not processed for user `6752b3066eec4d8383967a6c11460d26`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:51.359352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2fd67512-74ca-44c4-9321-173dc066c914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:51.377735 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1044/2094] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:18:51 2022] POST /identity/v3/projects => generated 383 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:51.378854 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44765506-d9b8-4b76-8dec-1cab7571f48a admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:51.381019 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-44765506-d9b8-4b76-8dec-1cab7571f48a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:51.448438 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1051/2095] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:51.448438 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd67512-74ca-44c4-9321-173dc066c914 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:51.462247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd67512-74ca-44c4-9321-173dc066c914 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:51.464736 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44765506-d9b8-4b76-8dec-1cab7571f48a admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:51.475439 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7536fd70-994b-4a09-a54e-7892979f5c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:51.476107 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536fd70-994b-4a09-a54e-7892979f5c11 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:51.476318 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536fd70-994b-4a09-a54e-7892979f5c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:51.476588 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536fd70-994b-4a09-a54e-7892979f5c11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:51.477239 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7536fd70-994b-4a09-a54e-7892979f5c11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:51.478917 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7536fd70-994b-4a09-a54e-7892979f5c11 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:51.480426 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2791ea-7f88-43a8-ad8c-d305c274a474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:51.481081 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2791ea-7f88-43a8-ad8c-d305c274a474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:51.481369 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2791ea-7f88-43a8-ad8c-d305c274a474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:51.481646 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2791ea-7f88-43a8-ad8c-d305c274a474 admin admin] PATH_INFO: `/v3/projects/0ececb2c2b7f4d9f96ec20a816b0b355` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:51.482847 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2791ea-7f88-43a8-ad8c-d305c274a474 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ececb2c2b7f4d9f96ec20a816b0b355)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:51.484976 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2791ea-7f88-43a8-ad8c-d305c274a474 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:51.490227 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1052/2096] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:51.490933 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7536fd70-994b-4a09-a54e-7892979f5c11 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:51.503822 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7536fd70-994b-4a09-a54e-7892979f5c11 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:51.509481 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92fb2e-32ab-4d64-8988-ee3fd6819f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:51.510497 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92fb2e-32ab-4d64-8988-ee3fd6819f5e admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:51.510782 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92fb2e-32ab-4d64-8988-ee3fd6819f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:51.511060 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92fb2e-32ab-4d64-8988-ee3fd6819f5e admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:51.512205 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c92fb2e-32ab-4d64-8988-ee3fd6819f5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:51.515095 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c92fb2e-32ab-4d64-8988-ee3fd6819f5e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:51.540625 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-2f2791ea-7f88-43a8-ad8c-d305c274a474 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ececb2c2b7f4d9f96ec20a816b0b355', 'request_id': 'req-2f2791ea-7f88-43a8-ad8c-d305c274a474'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:51.547337 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-2f2791ea-7f88-43a8-ad8c-d305c274a474 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ececb2c2b7f4d9f96ec20a816b0b355', 'request_id': 'req-2f2791ea-7f88-43a8-ad8c-d305c274a474'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:51.548365 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1053/2097] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:18:51 2022] POST /identity/v3/users => generated 298 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:51.550497 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92fb2e-32ab-4d64-8988-ee3fd6819f5e admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:51.556188 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-2f2791ea-7f88-43a8-ad8c-d305c274a474 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ececb2c2b7f4d9f96ec20a816b0b355', 'request_id': 'req-2f2791ea-7f88-43a8-ad8c-d305c274a474'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:51.568558 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92fb2e-32ab-4d64-8988-ee3fd6819f5e admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:51.573293 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-2f2791ea-7f88-43a8-ad8c-d305c274a474 admin admin] The token cache is being invalidate because project 0ececb2c2b7f4d9f96ec20a816b0b355 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:18:51.573464 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-2f2791ea-7f88-43a8-ad8c-d305c274a474 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:51.574315 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-2f2791ea-7f88-43a8-ad8c-d305c274a474 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:51.575957 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1045/2098] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:18:51 2022] DELETE /identity/v3/projects/0ececb2c2b7f4d9f96ec20a816b0b355 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:51.576915 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2791ea-7f88-43a8-ad8c-d305c274a474 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:51.580071 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-2f2791ea-7f88-43a8-ad8c-d305c274a474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:51.599730 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:51.651210 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:51.670769 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43f1cb-5956-4f04-9ef5-c0ac97e7305c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:51.672554 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43f1cb-5956-4f04-9ef5-c0ac97e7305c admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:51.672554 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43f1cb-5956-4f04-9ef5-c0ac97e7305c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:51.672554 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43f1cb-5956-4f04-9ef5-c0ac97e7305c admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:51.673388 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43f1cb-5956-4f04-9ef5-c0ac97e7305c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:51.675872 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43f1cb-5956-4f04-9ef5-c0ac97e7305c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:51.688018 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2791ea-7f88-43a8-ad8c-d305c274a474 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:51.694644 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aafcfd2-96bf-431d-8007-e49302eb71f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:51.695513 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafcfd2-96bf-431d-8007-e49302eb71f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:51.695800 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafcfd2-96bf-431d-8007-e49302eb71f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:51.696073 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafcfd2-96bf-431d-8007-e49302eb71f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:51.696897 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aafcfd2-96bf-431d-8007-e49302eb71f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:51.698672 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aafcfd2-96bf-431d-8007-e49302eb71f0 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:51.714421 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1046/2099] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:51.718095 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1054/2100] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:18:51 2022] POST /identity/v3/projects => generated 387 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:51.718230 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aafcfd2-96bf-431d-8007-e49302eb71f0 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:51.718347 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad59f10-24b9-415b-bce0-1b4236911811 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:51.718347 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad59f10-24b9-415b-bce0-1b4236911811 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:51.718347 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad59f10-24b9-415b-bce0-1b4236911811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:51.720571 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-4aafcfd2-96bf-431d-8007-e49302eb71f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:51.735345 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aafcfd2-96bf-431d-8007-e49302eb71f0 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:51.741035 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-aad59f10-24b9-415b-bce0-1b4236911811 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:51.742242 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-aad59f10-24b9-415b-bce0-1b4236911811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:51.795456 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b556499-efa1-4b3d-a91a-0f3d2c7eec50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:51.795978 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b556499-efa1-4b3d-a91a-0f3d2c7eec50 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:51.796263 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b556499-efa1-4b3d-a91a-0f3d2c7eec50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:51.796535 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b556499-efa1-4b3d-a91a-0f3d2c7eec50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:51.797171 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b556499-efa1-4b3d-a91a-0f3d2c7eec50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:51.799314 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b556499-efa1-4b3d-a91a-0f3d2c7eec50 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:51.804214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1055/2101] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:51.805042 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad59f10-24b9-415b-bce0-1b4236911811 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:51.814180 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad59f10-24b9-415b-bce0-1b4236911811 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:51.816782 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1047/2102] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:51.817664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b556499-efa1-4b3d-a91a-0f3d2c7eec50 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:51.819410 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1b556499-efa1-4b3d-a91a-0f3d2c7eec50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:51.820021 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a251e2a-d63b-4123-852b-33fd25835b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:51.820683 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a251e2a-d63b-4123-852b-33fd25835b6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:51.820963 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a251e2a-d63b-4123-852b-33fd25835b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:51.821238 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a251e2a-d63b-4123-852b-33fd25835b6c admin admin] PATH_INFO: `/v3/projects/7b9c47a320b24faba71ef727756ef0c9/users/aee8987c22dc44cebed6465ef9d36951/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:51.832367 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b556499-efa1-4b3d-a91a-0f3d2c7eec50 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:51.836147 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a251e2a-d63b-4123-852b-33fd25835b6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b9c47a320b24faba71ef727756ef0c9, user_id=aee8987c22dc44cebed6465ef9d36951, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:51.837502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03befbf4-8322-4e2d-aacc-41a70420244b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:51.838092 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03befbf4-8322-4e2d-aacc-41a70420244b admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:51.838369 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03befbf4-8322-4e2d-aacc-41a70420244b admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:51.838669 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03befbf4-8322-4e2d-aacc-41a70420244b admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:51.838855 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a251e2a-d63b-4123-852b-33fd25835b6c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:51.839306 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03befbf4-8322-4e2d-aacc-41a70420244b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:51.842092 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03befbf4-8322-4e2d-aacc-41a70420244b admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:51.855233 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1056/2103] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:51 2022] PUT /identity/v3/projects/7b9c47a320b24faba71ef727756ef0c9/users/aee8987c22dc44cebed6465ef9d36951/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:51.856503 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81ae9d-191e-4da3-b478-f099ea89b90b None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:51.856803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81ae9d-191e-4da3-b478-f099ea89b90b None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:51.857072 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81ae9d-191e-4da3-b478-f099ea89b90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:51.876664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1048/2104] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:18:51 2022] POST /identity/v3/users => generated 300 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:51.878219 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03befbf4-8322-4e2d-aacc-41a70420244b admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:51.879748 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-8c81ae9d-191e-4da3-b478-f099ea89b90b None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:51.881011 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8c81ae9d-191e-4da3-b478-f099ea89b90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:51.887903 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03befbf4-8322-4e2d-aacc-41a70420244b admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:51.942755 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1057/2105] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:51.944292 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e2f19-4947-46a4-a0fd-3b05a0a71f67 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:51.944735 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e2f19-4947-46a4-a0fd-3b05a0a71f67 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:51.945159 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e2f19-4947-46a4-a0fd-3b05a0a71f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:51.947119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31dac2-c3ff-4c10-b994-d9450c407e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:51.947786 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31dac2-c3ff-4c10-b994-d9450c407e21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:51.948072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31dac2-c3ff-4c10-b994-d9450c407e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:51.948352 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31dac2-c3ff-4c10-b994-d9450c407e21 admin admin] PATH_INFO: `/v3/projects/695f8b8490294869817a4bbaa0ac85d0/users/75a87a09a9df4396a42982d79623b6e4/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:51.967428 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31dac2-c3ff-4c10-b994-d9450c407e21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=695f8b8490294869817a4bbaa0ac85d0, user_id=75a87a09a9df4396a42982d79623b6e4, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:51.970816 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31dac2-c3ff-4c10-b994-d9450c407e21 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:51.975321 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-b11e2f19-4947-46a4-a0fd-3b05a0a71f67 None None] MFA Rules not processed for user `aee8987c22dc44cebed6465ef9d36951`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:51.976660 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b11e2f19-4947-46a4-a0fd-3b05a0a71f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:51.985061 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1049/2106] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:51 2022] PUT /identity/v3/projects/695f8b8490294869817a4bbaa0ac85d0/users/75a87a09a9df4396a42982d79623b6e4/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:51.985484 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:51.985982 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31dac2-c3ff-4c10-b994-d9450c407e21 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:52.031909 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:52.054088 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1058/2107] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:51 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:52.054963 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31dac2-c3ff-4c10-b994-d9450c407e21 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:52.055103 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11e2f19-4947-46a4-a0fd-3b05a0a71f67 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:52.059647 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e857b05-325a-4eca-afcb-f7561f0cf826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:52.060253 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e857b05-325a-4eca-afcb-f7561f0cf826 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:52.060528 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e857b05-325a-4eca-afcb-f7561f0cf826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:52.060797 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e857b05-325a-4eca-afcb-f7561f0cf826 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:52.061436 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e857b05-325a-4eca-afcb-f7561f0cf826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:52.063059 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e857b05-325a-4eca-afcb-f7561f0cf826 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:52.068077 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11e2f19-4947-46a4-a0fd-3b05a0a71f67 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:52.073554 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43528039-7107-4bbd-9cb6-0422f161cfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:52.074161 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43528039-7107-4bbd-9cb6-0422f161cfb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:52.074443 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1050/2108] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:52.074580 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43528039-7107-4bbd-9cb6-0422f161cfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:52.074760 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43528039-7107-4bbd-9cb6-0422f161cfb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:52.075271 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e857b05-325a-4eca-afcb-f7561f0cf826 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:52.075418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43528039-7107-4bbd-9cb6-0422f161cfb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:18:52.075698 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43528039-7107-4bbd-9cb6-0422f161cfb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:52.077303 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43528039-7107-4bbd-9cb6-0422f161cfb9 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:52.088962 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e857b05-325a-4eca-afcb-f7561f0cf826 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:52.090832 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1059/2109] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:18:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:18:52.091647 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43528039-7107-4bbd-9cb6-0422f161cfb9 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:52.095017 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee370c-b7e4-42ad-a4c7-eaabac7a197c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:52.096805 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee370c-b7e4-42ad-a4c7-eaabac7a197c admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:52.097219 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee370c-b7e4-42ad-a4c7-eaabac7a197c admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:52.097526 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee370c-b7e4-42ad-a4c7-eaabac7a197c admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:52.098251 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee370c-b7e4-42ad-a4c7-eaabac7a197c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:52.100097 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee370c-b7e4-42ad-a4c7-eaabac7a197c admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:52.105610 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43528039-7107-4bbd-9cb6-0422f161cfb9 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:52.110506 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed117d74-8acd-48fd-a9e4-757ab0506497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:52.111217 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1051/2110] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:52.112466 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee370c-b7e4-42ad-a4c7-eaabac7a197c admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:52.114605 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed117d74-8acd-48fd-a9e4-757ab0506497 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:52.116173 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed117d74-8acd-48fd-a9e4-757ab0506497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:52.116717 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed117d74-8acd-48fd-a9e4-757ab0506497 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:52.117602 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed117d74-8acd-48fd-a9e4-757ab0506497 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:52.121959 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed117d74-8acd-48fd-a9e4-757ab0506497 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:52.123328 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee370c-b7e4-42ad-a4c7-eaabac7a197c admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:52.128054 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b6327f-de17-4848-9121-36a4fa192794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:52.128876 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6327f-de17-4848-9121-36a4fa192794 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:52.129004 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6327f-de17-4848-9121-36a4fa192794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:52.129263 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6327f-de17-4848-9121-36a4fa192794 admin admin] PATH_INFO: `/v3/projects/ac1e153d0aed4985ac7e0dbc787c65d4/users/22c81dad60af4611817bec9fc152d501/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:52.146498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b6327f-de17-4848-9121-36a4fa192794 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac1e153d0aed4985ac7e0dbc787c65d4, user_id=22c81dad60af4611817bec9fc152d501, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:52.151737 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b6327f-de17-4848-9121-36a4fa192794 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:52.158697 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1060/2111] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:18:52 2022] POST /identity/v3/projects => generated 409 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:52.159686 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed117d74-8acd-48fd-a9e4-757ab0506497 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:52.171955 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1052/2112] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:52 2022] PUT /identity/v3/projects/ac1e153d0aed4985ac7e0dbc787c65d4/users/22c81dad60af4611817bec9fc152d501/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:52.172765 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b6327f-de17-4848-9121-36a4fa192794 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:52.244004 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed117d74-8acd-48fd-a9e4-757ab0506497 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:52.260210 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b6327f-de17-4848-9121-36a4fa192794 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:52.266023 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c18697-1193-4016-bd82-ba8eb76bfa96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:52.267246 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c18697-1193-4016-bd82-ba8eb76bfa96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:52.268238 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c18697-1193-4016-bd82-ba8eb76bfa96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:52.268621 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c18697-1193-4016-bd82-ba8eb76bfa96 admin admin] PATH_INFO: `/v3/projects/695f8b8490294869817a4bbaa0ac85d0/users/75a87a09a9df4396a42982d79623b6e4/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:52.271571 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c18697-1193-4016-bd82-ba8eb76bfa96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=695f8b8490294869817a4bbaa0ac85d0, user_id=75a87a09a9df4396a42982d79623b6e4, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:52.274818 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c18697-1193-4016-bd82-ba8eb76bfa96 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:52.286748 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1053/2113] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:52 2022] PUT /identity/v3/projects/695f8b8490294869817a4bbaa0ac85d0/users/75a87a09a9df4396a42982d79623b6e4/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:52.287568 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c18697-1193-4016-bd82-ba8eb76bfa96 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:52.322899 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cc8f8-327e-4743-abe9-ea8cebeaaac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:52.323301 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cc8f8-327e-4743-abe9-ea8cebeaaac1 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:52.323570 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cc8f8-327e-4743-abe9-ea8cebeaaac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:52.323843 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cc8f8-327e-4743-abe9-ea8cebeaaac1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:52.324540 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6cc8f8-327e-4743-abe9-ea8cebeaaac1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:52.326518 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6cc8f8-327e-4743-abe9-ea8cebeaaac1 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:52.361590 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1061/2114] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:18:52 2022] POST /identity/v3/projects => generated 359 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:52.362418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cc8f8-327e-4743-abe9-ea8cebeaaac1 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:52.364304 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c18697-1193-4016-bd82-ba8eb76bfa96 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:52.377682 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:52.407614 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:52.427866 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed9089d-1799-4c83-b81c-36322a9de6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:52.428481 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9089d-1799-4c83-b81c-36322a9de6ca admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:52.428765 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9089d-1799-4c83-b81c-36322a9de6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:52.429040 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9089d-1799-4c83-b81c-36322a9de6ca admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:52.429682 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed9089d-1799-4c83-b81c-36322a9de6ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:52.431751 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed9089d-1799-4c83-b81c-36322a9de6ca admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:52.436224 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cc8f8-327e-4743-abe9-ea8cebeaaac1 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:52.441397 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ac82e-b062-4004-81f2-7042a384a65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:52.442075 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ac82e-b062-4004-81f2-7042a384a65d admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:52.442343 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ac82e-b062-4004-81f2-7042a384a65d admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:52.442670 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ac82e-b062-4004-81f2-7042a384a65d admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:52.443314 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ac82e-b062-4004-81f2-7042a384a65d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:52.445046 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ac82e-b062-4004-81f2-7042a384a65d admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:52.455013 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1054/2115] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:18:52 2022] POST /identity/v3/users => generated 311 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:52.458803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1062/2116] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:52.459025 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c92ff4-668b-4257-a7b8-4c6543c12876 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:52.459110 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ac82e-b062-4004-81f2-7042a384a65d admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:52.459183 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c92ff4-668b-4257-a7b8-4c6543c12876 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:52.459183 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c92ff4-668b-4257-a7b8-4c6543c12876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:52.468325 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ac82e-b062-4004-81f2-7042a384a65d admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:52.473827 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6bacd9-d068-4f82-86f5-31b7ddf572b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:52.474431 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bacd9-d068-4f82-86f5-31b7ddf572b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:52.474794 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bacd9-d068-4f82-86f5-31b7ddf572b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:52.475074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bacd9-d068-4f82-86f5-31b7ddf572b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:52.475711 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6bacd9-d068-4f82-86f5-31b7ddf572b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:52.477751 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6bacd9-d068-4f82-86f5-31b7ddf572b9 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:52.489081 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-e6c92ff4-668b-4257-a7b8-4c6543c12876 None None] MFA Rules not processed for user `75a87a09a9df4396a42982d79623b6e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:52.490778 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-e6c92ff4-668b-4257-a7b8-4c6543c12876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:52.500462 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1063/2117] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:18:52 2022] POST /identity/v3/users => generated 280 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:52.503969 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6bacd9-d068-4f82-86f5-31b7ddf572b9 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:52.514242 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6bacd9-d068-4f82-86f5-31b7ddf572b9 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:52.520357 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d5e8c-23f9-484c-923a-9ce138c80fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:52.520972 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d5e8c-23f9-484c-923a-9ce138c80fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:52.521253 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d5e8c-23f9-484c-923a-9ce138c80fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:52.521905 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d5e8c-23f9-484c-923a-9ce138c80fd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:52.522309 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d5e8c-23f9-484c-923a-9ce138c80fd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:52.523952 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d5e8c-23f9-484c-923a-9ce138c80fd1 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:52.549202 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1064/2118] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:52.549202 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d5e8c-23f9-484c-923a-9ce138c80fd1 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:52.559531 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d5e8c-23f9-484c-923a-9ce138c80fd1 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:52.564166 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd35c01-172b-4dd5-a71d-f38a5da07f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:52.564919 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd35c01-172b-4dd5-a71d-f38a5da07f53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:52.565255 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd35c01-172b-4dd5-a71d-f38a5da07f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:52.565536 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd35c01-172b-4dd5-a71d-f38a5da07f53 admin admin] PATH_INFO: `/v3/projects/ac1e153d0aed4985ac7e0dbc787c65d4/users/22c81dad60af4611817bec9fc152d501/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:52.567960 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd35c01-172b-4dd5-a71d-f38a5da07f53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac1e153d0aed4985ac7e0dbc787c65d4, user_id=22c81dad60af4611817bec9fc152d501, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:52.573215 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1055/2119] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:52 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:52.573215 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c92ff4-668b-4257-a7b8-4c6543c12876 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:52.573448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd35c01-172b-4dd5-a71d-f38a5da07f53 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:52.584793 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c92ff4-668b-4257-a7b8-4c6543c12876 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:52.590917 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1065/2120] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:52 2022] PUT /identity/v3/projects/ac1e153d0aed4985ac7e0dbc787c65d4/users/22c81dad60af4611817bec9fc152d501/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:52.591953 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd35c01-172b-4dd5-a71d-f38a5da07f53 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:52.679171 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c08c4-b3d6-4663-842a-18e413e1b1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:52.679363 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd35c01-172b-4dd5-a71d-f38a5da07f53 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:52.679792 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c08c4-b3d6-4663-842a-18e413e1b1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:52.680070 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c08c4-b3d6-4663-842a-18e413e1b1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:52.680344 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c08c4-b3d6-4663-842a-18e413e1b1f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:52.680985 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11c08c4-b3d6-4663-842a-18e413e1b1f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:52.682624 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11c08c4-b3d6-4663-842a-18e413e1b1f4 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:52.684713 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0584e86-65eb-469b-97b6-16702f19a7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:52.685437 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0584e86-65eb-469b-97b6-16702f19a7af admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:52.685907 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0584e86-65eb-469b-97b6-16702f19a7af admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:52.686177 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0584e86-65eb-469b-97b6-16702f19a7af admin admin] PATH_INFO: `/v3/projects/b16ad15746e74154a4382fd91ab394fd/users/91e3a70f8f3b4417be3083b83405fbc6/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:52.695607 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1056/2121] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:52.695607 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c08c4-b3d6-4663-842a-18e413e1b1f4 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:52.697444 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d11c08c4-b3d6-4663-842a-18e413e1b1f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:52.703683 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0584e86-65eb-469b-97b6-16702f19a7af admin admin] RBAC: Authorizing `identity:create_grant(project_id=b16ad15746e74154a4382fd91ab394fd, user_id=91e3a70f8f3b4417be3083b83405fbc6, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:52.707177 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0584e86-65eb-469b-97b6-16702f19a7af admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:52.725948 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1066/2122] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:52 2022] PUT /identity/v3/projects/b16ad15746e74154a4382fd91ab394fd/users/91e3a70f8f3b4417be3083b83405fbc6/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:52.726079 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a644e6-101d-4768-8e60-4c65bc33a5b9 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:52.726444 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a644e6-101d-4768-8e60-4c65bc33a5b9 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:52.728449 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a644e6-101d-4768-8e60-4c65bc33a5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:52.771604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-26a644e6-101d-4768-8e60-4c65bc33a5b9 None None] MFA Rules not processed for user `22c81dad60af4611817bec9fc152d501`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:52.773102 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-26a644e6-101d-4768-8e60-4c65bc33a5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:52.779798 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c08c4-b3d6-4663-842a-18e413e1b1f4 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:52.786930 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:52.820647 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:52.842987 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef863c0-1ced-44b3-8e94-40bdaee02d02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:52.843736 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef863c0-1ced-44b3-8e94-40bdaee02d02 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:52.843997 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef863c0-1ced-44b3-8e94-40bdaee02d02 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:52.844272 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef863c0-1ced-44b3-8e94-40bdaee02d02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:52.867342 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1067/2123] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:52 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:52.868191 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a644e6-101d-4768-8e60-4c65bc33a5b9 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:52.918886 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef863c0-1ced-44b3-8e94-40bdaee02d02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:52.920429 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef863c0-1ced-44b3-8e94-40bdaee02d02 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:52.930112 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1057/2124] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:52 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:52.931010 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef863c0-1ced-44b3-8e94-40bdaee02d02 service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:52.935283 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a644e6-101d-4768-8e60-4c65bc33a5b9 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:52.941342 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef863c0-1ced-44b3-8e94-40bdaee02d02 service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:52.942005 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1eb78-e1a1-48b8-bf8a-4b16dcecacbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:52.942884 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1eb78-e1a1-48b8-bf8a-4b16dcecacbd admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:52.943169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1eb78-e1a1-48b8-bf8a-4b16dcecacbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:52.943442 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1eb78-e1a1-48b8-bf8a-4b16dcecacbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:52.944160 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1eb78-e1a1-48b8-bf8a-4b16dcecacbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:52.945887 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1eb78-e1a1-48b8-bf8a-4b16dcecacbd admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:52.946225 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ec540-f1e0-4584-ac21-979ff9e89c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:52.946924 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ec540-f1e0-4584-ac21-979ff9e89c0b admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:52.947316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ec540-f1e0-4584-ac21-979ff9e89c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:52.947666 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ec540-f1e0-4584-ac21-979ff9e89c0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:52.948365 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ec540-f1e0-4584-ac21-979ff9e89c0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:52.949935 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ec540-f1e0-4584-ac21-979ff9e89c0b admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:52.958411 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1068/2125] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:52.959521 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1eb78-e1a1-48b8-bf8a-4b16dcecacbd admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:52.962505 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1058/2126] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:52.962700 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ec540-f1e0-4584-ac21-979ff9e89c0b admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:52.966197 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f75ec540-f1e0-4584-ac21-979ff9e89c0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:52.966319 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-70a1eb78-e1a1-48b8-bf8a-4b16dcecacbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:52.979292 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ec540-f1e0-4584-ac21-979ff9e89c0b admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:52.979670 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1eb78-e1a1-48b8-bf8a-4b16dcecacbd admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:52.987742 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e4587-ee4e-4c00-814e-3924aab2c2c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:52.987932 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15daac13-dc94-4f46-ad0b-0eca25b33a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:52.988495 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15daac13-dc94-4f46-ad0b-0eca25b33a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:52.989231 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e4587-ee4e-4c00-814e-3924aab2c2c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:52.989751 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e4587-ee4e-4c00-814e-3924aab2c2c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:52.989863 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15daac13-dc94-4f46-ad0b-0eca25b33a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:52.990046 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15daac13-dc94-4f46-ad0b-0eca25b33a48 admin admin] PATH_INFO: `/v3/users/68e6d3f15b8d4b3598895e2470096fd0` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:52.990410 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e4587-ee4e-4c00-814e-3924aab2c2c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:52.991611 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15daac13-dc94-4f46-ad0b-0eca25b33a48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68e6d3f15b8d4b3598895e2470096fd0)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:52.993562 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15daac13-dc94-4f46-ad0b-0eca25b33a48 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:53.001459 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35e4587-ee4e-4c00-814e-3924aab2c2c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:53.003993 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35e4587-ee4e-4c00-814e-3924aab2c2c1 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:53.016296 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1059/2127] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:52 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:53.017742 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e4587-ee4e-4c00-814e-3924aab2c2c1 service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:53.030710 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e4587-ee4e-4c00-814e-3924aab2c2c1 service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:53.038011 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d2f98-5415-4656-84ec-13ce13555127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:53.038793 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d2f98-5415-4656-84ec-13ce13555127 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:53.039154 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d2f98-5415-4656-84ec-13ce13555127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:53.039505 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d2f98-5415-4656-84ec-13ce13555127 admin admin] PATH_INFO: `/v3/projects/08ed3efc8b4e465cb5daefb276a094ef/users/fa44a714b2c04ca0bd0b95e6864cf917/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:53.060327 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-15daac13-dc94-4f46-ad0b-0eca25b33a48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68e6d3f15b8d4b3598895e2470096fd0'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:53.069306 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3d2f98-5415-4656-84ec-13ce13555127 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08ed3efc8b4e465cb5daefb276a094ef, user_id=fa44a714b2c04ca0bd0b95e6864cf917, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:53.072181 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3d2f98-5415-4656-84ec-13ce13555127 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:53.073949 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-15daac13-dc94-4f46-ad0b-0eca25b33a48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68e6d3f15b8d4b3598895e2470096fd0'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:53.086312 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-15daac13-dc94-4f46-ad0b-0eca25b33a48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68e6d3f15b8d4b3598895e2470096fd0'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:53.089918 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1060/2128] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:53 2022] PUT /identity/v3/projects/08ed3efc8b4e465cb5daefb276a094ef/users/fa44a714b2c04ca0bd0b95e6864cf917/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:53.090979 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d2f98-5415-4656-84ec-13ce13555127 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:53.108611 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-15daac13-dc94-4f46-ad0b-0eca25b33a48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68e6d3f15b8d4b3598895e2470096fd0'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:53.109345 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-15daac13-dc94-4f46-ad0b-0eca25b33a48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68e6d3f15b8d4b3598895e2470096fd0'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:53.117967 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1069/2129] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:18:52 2022] DELETE /identity/v3/users/68e6d3f15b8d4b3598895e2470096fd0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:53.119119 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15daac13-dc94-4f46-ad0b-0eca25b33a48 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:53.120522 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-15daac13-dc94-4f46-ad0b-0eca25b33a48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:53.165968 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d2f98-5415-4656-84ec-13ce13555127 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:53.166276 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:53.179927 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:53.191789 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15daac13-dc94-4f46-ad0b-0eca25b33a48 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:53.196993 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088ee83-06c8-4318-9b04-272550c8b3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:53.197624 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088ee83-06c8-4318-9b04-272550c8b3a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:53.197901 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088ee83-06c8-4318-9b04-272550c8b3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:53.198170 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088ee83-06c8-4318-9b04-272550c8b3a1 admin admin] PATH_INFO: `/v3/users/6752b3066eec4d8383967a6c11460d26` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:53.199328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088ee83-06c8-4318-9b04-272550c8b3a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6752b3066eec4d8383967a6c11460d26)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:53.201236 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088ee83-06c8-4318-9b04-272550c8b3a1 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:53.230999 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb550aa7-6127-48bb-afa6-99d4f8606db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:53.231680 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb550aa7-6127-48bb-afa6-99d4f8606db6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:53.231985 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb550aa7-6127-48bb-afa6-99d4f8606db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:53.232260 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb550aa7-6127-48bb-afa6-99d4f8606db6 admin admin] PATH_INFO: `/v3/projects/b16ad15746e74154a4382fd91ab394fd/users/91e3a70f8f3b4417be3083b83405fbc6/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:53.234254 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb550aa7-6127-48bb-afa6-99d4f8606db6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b16ad15746e74154a4382fd91ab394fd, user_id=91e3a70f8f3b4417be3083b83405fbc6, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:53.237602 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb550aa7-6127-48bb-afa6-99d4f8606db6 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:53.248267 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1061/2130] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:53 2022] PUT /identity/v3/projects/b16ad15746e74154a4382fd91ab394fd/users/91e3a70f8f3b4417be3083b83405fbc6/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:53.249068 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb550aa7-6127-48bb-afa6-99d4f8606db6 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:53.251122 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-fb550aa7-6127-48bb-afa6-99d4f8606db6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:53.251238 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0088ee83-06c8-4318-9b04-272550c8b3a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6752b3066eec4d8383967a6c11460d26'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:53.259614 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0088ee83-06c8-4318-9b04-272550c8b3a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6752b3066eec4d8383967a6c11460d26'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:53.266952 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0088ee83-06c8-4318-9b04-272550c8b3a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6752b3066eec4d8383967a6c11460d26'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:53.279308 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0088ee83-06c8-4318-9b04-272550c8b3a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6752b3066eec4d8383967a6c11460d26'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:53.279987 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0088ee83-06c8-4318-9b04-272550c8b3a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6752b3066eec4d8383967a6c11460d26'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:53.285882 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1070/2131] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:18:53 2022] DELETE /identity/v3/users/6752b3066eec4d8383967a6c11460d26 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:53.287445 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a3987-03b9-494b-84be-7b534a8808f1 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:53.287560 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a3987-03b9-494b-84be-7b534a8808f1 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:53.287802 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a3987-03b9-494b-84be-7b534a8808f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:53.320768 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb550aa7-6127-48bb-afa6-99d4f8606db6 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:53.322973 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-220a3987-03b9-494b-84be-7b534a8808f1 None None] MFA Rules not processed for user `fa44a714b2c04ca0bd0b95e6864cf917`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:53.324292 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-220a3987-03b9-494b-84be-7b534a8808f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:53.386946 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e699d-030f-4e41-a7fb-816561f17b0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:53.387657 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e699d-030f-4e41-a7fb-816561f17b0c service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:53.387954 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e699d-030f-4e41-a7fb-816561f17b0c service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:53.388238 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e699d-030f-4e41-a7fb-816561f17b0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:53.390318 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-b03e699d-030f-4e41-a7fb-816561f17b0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:53.409163 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1071/2132] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:53 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:53.410312 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93d680-9b1e-4ff7-8e11-a30691244a17 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:53.410664 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93d680-9b1e-4ff7-8e11-a30691244a17 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:53.411226 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93d680-9b1e-4ff7-8e11-a30691244a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:53.431124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-0b93d680-9b1e-4ff7-8e11-a30691244a17 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:53.432283 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0b93d680-9b1e-4ff7-8e11-a30691244a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:53.463645 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e699d-030f-4e41-a7fb-816561f17b0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:53.465257 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e699d-030f-4e41-a7fb-816561f17b0c service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:53.474134 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1062/2133] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:53.475467 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7c731-15d1-4090-9161-294568cd0c1e None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:53.475748 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7c731-15d1-4090-9161-294568cd0c1e None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:53.476019 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7c731-15d1-4090-9161-294568cd0c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:53.476597 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:53.497312 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1072/2134] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:53.501892 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e657b99-8442-4802-90be-7f17495cb1cd None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:53.501892 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e657b99-8442-4802-90be-7f17495cb1cd None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:53.502672 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e657b99-8442-4802-90be-7f17495cb1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:53.511559 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-8cd7c731-15d1-4090-9161-294568cd0c1e None None] MFA Rules not processed for user `91e3a70f8f3b4417be3083b83405fbc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:53.512764 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-8cd7c731-15d1-4090-9161-294568cd0c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:53.523651 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:53.523908 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-4e657b99-8442-4802-90be-7f17495cb1cd None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:53.525171 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4e657b99-8442-4802-90be-7f17495cb1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:53.542104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1073/2135] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:53.543570 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e657b99-8442-4802-90be-7f17495cb1cd None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:53.553542 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4e657b99-8442-4802-90be-7f17495cb1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:53.566579 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e657b99-8442-4802-90be-7f17495cb1cd None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:53.570964 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b60671-5dfa-48a5-a8e5-b94e9d035395 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:53.571739 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b60671-5dfa-48a5-a8e5-b94e9d035395 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:53.572228 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b60671-5dfa-48a5-a8e5-b94e9d035395 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:53.572507 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b60671-5dfa-48a5-a8e5-b94e9d035395 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:53.584811 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b60671-5dfa-48a5-a8e5-b94e9d035395 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:53.584811 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b60671-5dfa-48a5-a8e5-b94e9d035395 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:53.593855 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1074/2136] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:53 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:53.594906 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b60671-5dfa-48a5-a8e5-b94e9d035395 service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:53.597918 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-39b60671-5dfa-48a5-a8e5-b94e9d035395 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:53.613844 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1063/2137] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:53 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:53.614789 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7c731-15d1-4090-9161-294568cd0c1e None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:53.620013 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-8cd7c731-15d1-4090-9161-294568cd0c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:53.677312 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b60671-5dfa-48a5-a8e5-b94e9d035395 service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:53.682350 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc6786-c299-4e6f-bb4e-1f0a7e3311f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:53.683281 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc6786-c299-4e6f-bb4e-1f0a7e3311f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:53.683561 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc6786-c299-4e6f-bb4e-1f0a7e3311f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:53.684770 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc6786-c299-4e6f-bb4e-1f0a7e3311f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:53.688304 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7c731-15d1-4090-9161-294568cd0c1e None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:53.692817 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe6bab-5d07-454c-ad7f-c77fc62601e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:53.693432 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe6bab-5d07-454c-ad7f-c77fc62601e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:53.693710 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe6bab-5d07-454c-ad7f-c77fc62601e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:53.693980 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe6bab-5d07-454c-ad7f-c77fc62601e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:53.697967 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dc6786-c299-4e6f-bb4e-1f0a7e3311f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:53.699531 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dc6786-c299-4e6f-bb4e-1f0a7e3311f5 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:53.713011 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe6bab-5d07-454c-ad7f-c77fc62601e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:53.714515 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1075/2138] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:53.715311 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc6786-c299-4e6f-bb4e-1f0a7e3311f5 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:53.716706 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe6bab-5d07-454c-ad7f-c77fc62601e8 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:53.719799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e1dc6786-c299-4e6f-bb4e-1f0a7e3311f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:53.729064 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1064/2139] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:53.730006 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe6bab-5d07-454c-ad7f-c77fc62601e8 service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:53.735649 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc6786-c299-4e6f-bb4e-1f0a7e3311f5 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:53.741917 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe6bab-5d07-454c-ad7f-c77fc62601e8 service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:53.746643 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf5278-ebdf-4a4a-9c47-b480087afaeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:53.747251 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf5278-ebdf-4a4a-9c47-b480087afaeb service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:53.747534 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf5278-ebdf-4a4a-9c47-b480087afaeb service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:53.747800 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf5278-ebdf-4a4a-9c47-b480087afaeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:53.749316 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045aeebe-65fc-4986-8320-b5f2ff57c4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:53.750003 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045aeebe-65fc-4986-8320-b5f2ff57c4d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:53.750283 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045aeebe-65fc-4986-8320-b5f2ff57c4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:53.750613 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045aeebe-65fc-4986-8320-b5f2ff57c4d4 admin admin] PATH_INFO: `/v3/users/fa44a714b2c04ca0bd0b95e6864cf917` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:53.753718 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045aeebe-65fc-4986-8320-b5f2ff57c4d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa44a714b2c04ca0bd0b95e6864cf917)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:53.755830 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045aeebe-65fc-4986-8320-b5f2ff57c4d4 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:53.760755 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf5278-ebdf-4a4a-9c47-b480087afaeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:53.762576 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf5278-ebdf-4a4a-9c47-b480087afaeb service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:53.784413 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1065/2140] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:53 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:53.879216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf5278-ebdf-4a4a-9c47-b480087afaeb service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:53.882365 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-38bf5278-ebdf-4a4a-9c47-b480087afaeb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:53.893581 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-045aeebe-65fc-4986-8320-b5f2ff57c4d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa44a714b2c04ca0bd0b95e6864cf917'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:53.905917 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-045aeebe-65fc-4986-8320-b5f2ff57c4d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa44a714b2c04ca0bd0b95e6864cf917'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:53.916083 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-045aeebe-65fc-4986-8320-b5f2ff57c4d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa44a714b2c04ca0bd0b95e6864cf917'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:53.932665 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf5278-ebdf-4a4a-9c47-b480087afaeb service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:53.933566 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-045aeebe-65fc-4986-8320-b5f2ff57c4d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa44a714b2c04ca0bd0b95e6864cf917'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:53.934387 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-045aeebe-65fc-4986-8320-b5f2ff57c4d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa44a714b2c04ca0bd0b95e6864cf917'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:53.943513 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1076/2141] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:18:53 2022] DELETE /identity/v3/users/fa44a714b2c04ca0bd0b95e6864cf917 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:53.950467 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83011b-2413-439e-97de-b5e2839389a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:53.951138 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83011b-2413-439e-97de-b5e2839389a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:53.951418 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83011b-2413-439e-97de-b5e2839389a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:53.951679 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83011b-2413-439e-97de-b5e2839389a7 admin admin] PATH_INFO: `/v3/users/f4d7b10cf5c244f5bf2edf4b6ffce9d5` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:53.953153 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e83011b-2413-439e-97de-b5e2839389a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4d7b10cf5c244f5bf2edf4b6ffce9d5)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:53.955156 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e83011b-2413-439e-97de-b5e2839389a7 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:53.956500 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921aea09-71bb-4eec-a706-f46c57b66275 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:53.957407 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921aea09-71bb-4eec-a706-f46c57b66275 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:53.957865 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921aea09-71bb-4eec-a706-f46c57b66275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:54.006895 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-921aea09-71bb-4eec-a706-f46c57b66275 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:54.012526 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-921aea09-71bb-4eec-a706-f46c57b66275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:54.061382 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-4e83011b-2413-439e-97de-b5e2839389a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4d7b10cf5c244f5bf2edf4b6ffce9d5'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:54.063133 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-4e83011b-2413-439e-97de-b5e2839389a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4d7b10cf5c244f5bf2edf4b6ffce9d5'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:54.076864 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:54.097028 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-4e83011b-2413-439e-97de-b5e2839389a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4d7b10cf5c244f5bf2edf4b6ffce9d5'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:54.113395 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1077/2142] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:54.115336 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-4e83011b-2413-439e-97de-b5e2839389a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4d7b10cf5c244f5bf2edf4b6ffce9d5'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:54.135084 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921aea09-71bb-4eec-a706-f46c57b66275 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:54.136240 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-921aea09-71bb-4eec-a706-f46c57b66275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:54.143372 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-4e83011b-2413-439e-97de-b5e2839389a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4d7b10cf5c244f5bf2edf4b6ffce9d5'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:54.160633 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1066/2143] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:18:53 2022] DELETE /identity/v3/users/f4d7b10cf5c244f5bf2edf4b6ffce9d5 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:54.167824 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be6f2e-2b48-4ab2-adec-5c62b774d32e None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:54.168781 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be6f2e-2b48-4ab2-adec-5c62b774d32e None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:54.169183 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be6f2e-2b48-4ab2-adec-5c62b774d32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:54.198041 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-77be6f2e-2b48-4ab2-adec-5c62b774d32e None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:54.199390 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-77be6f2e-2b48-4ab2-adec-5c62b774d32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:54.204455 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:54.263203 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921aea09-71bb-4eec-a706-f46c57b66275 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:54.298653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1067/2144] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:54.302082 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be6f2e-2b48-4ab2-adec-5c62b774d32e None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:54.302082 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-77be6f2e-2b48-4ab2-adec-5c62b774d32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:54.329390 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f4403-2dab-4cbd-ba33-98d3ec886f8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:54.330491 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f4403-2dab-4cbd-ba33-98d3ec886f8c service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:54.330829 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f4403-2dab-4cbd-ba33-98d3ec886f8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:54.331137 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f4403-2dab-4cbd-ba33-98d3ec886f8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:54.333749 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d72f4403-2dab-4cbd-ba33-98d3ec886f8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:54.349857 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f4403-2dab-4cbd-ba33-98d3ec886f8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:54.351336 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f4403-2dab-4cbd-ba33-98d3ec886f8c service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:54.361330 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1078/2145] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:54.362131 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f4403-2dab-4cbd-ba33-98d3ec886f8c service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:54.364539 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d72f4403-2dab-4cbd-ba33-98d3ec886f8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:54.366937 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be6f2e-2b48-4ab2-adec-5c62b774d32e None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:54.370967 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269b61c-fbe6-4329-8626-05b3691fe6cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:54.371767 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269b61c-fbe6-4329-8626-05b3691fe6cd service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:54.372329 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269b61c-fbe6-4329-8626-05b3691fe6cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:54.372605 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269b61c-fbe6-4329-8626-05b3691fe6cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:54.374379 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-5269b61c-fbe6-4329-8626-05b3691fe6cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:54.376469 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f4403-2dab-4cbd-ba33-98d3ec886f8c service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:54.382236 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf0b1b-78e1-4e6b-a5c2-ec2ed2ea18cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:54.382893 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf0b1b-78e1-4e6b-a5c2-ec2ed2ea18cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:54.383172 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf0b1b-78e1-4e6b-a5c2-ec2ed2ea18cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:54.383445 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf0b1b-78e1-4e6b-a5c2-ec2ed2ea18cc admin admin] PATH_INFO: `/v3/projects/1fc8628fdf1f4c6397a70d300114da1a` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:54.384556 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf0b1b-78e1-4e6b-a5c2-ec2ed2ea18cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fc8628fdf1f4c6397a70d300114da1a)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:54.386480 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf0b1b-78e1-4e6b-a5c2-ec2ed2ea18cc admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:54.438819 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7fbf0b1b-78e1-4e6b-a5c2-ec2ed2ea18cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fc8628fdf1f4c6397a70d300114da1a', 'request_id': 'req-7fbf0b1b-78e1-4e6b-a5c2-ec2ed2ea18cc'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:54.446437 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7fbf0b1b-78e1-4e6b-a5c2-ec2ed2ea18cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fc8628fdf1f4c6397a70d300114da1a', 'request_id': 'req-7fbf0b1b-78e1-4e6b-a5c2-ec2ed2ea18cc'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:54.450335 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5269b61c-fbe6-4329-8626-05b3691fe6cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:54.451851 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5269b61c-fbe6-4329-8626-05b3691fe6cd service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:54.454996 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7fbf0b1b-78e1-4e6b-a5c2-ec2ed2ea18cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fc8628fdf1f4c6397a70d300114da1a', 'request_id': 'req-7fbf0b1b-78e1-4e6b-a5c2-ec2ed2ea18cc'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:54.463470 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1068/2146] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:54 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:54.464122 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269b61c-fbe6-4329-8626-05b3691fe6cd service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:54.465639 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-5269b61c-fbe6-4329-8626-05b3691fe6cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:54.479666 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269b61c-fbe6-4329-8626-05b3691fe6cd service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:54.483264 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7fbf0b1b-78e1-4e6b-a5c2-ec2ed2ea18cc admin admin] The token cache is being invalidate because project 1fc8628fdf1f4c6397a70d300114da1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:18:54.483902 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7fbf0b1b-78e1-4e6b-a5c2-ec2ed2ea18cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:54.484705 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7fbf0b1b-78e1-4e6b-a5c2-ec2ed2ea18cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:54.488747 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1079/2147] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:18:54 2022] DELETE /identity/v3/projects/1fc8628fdf1f4c6397a70d300114da1a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:54.489843 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf0b1b-78e1-4e6b-a5c2-ec2ed2ea18cc admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:54.493393 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7fbf0b1b-78e1-4e6b-a5c2-ec2ed2ea18cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:54.532012 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:54.566358 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31432d-bf43-4b59-9d1e-5f81ec16df12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:54.567148 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31432d-bf43-4b59-9d1e-5f81ec16df12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:54.567600 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31432d-bf43-4b59-9d1e-5f81ec16df12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:54.567964 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31432d-bf43-4b59-9d1e-5f81ec16df12 admin admin] PATH_INFO: `/v3/projects/b183a289c159406098e2f2bb2a570ecf` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:54.569104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31432d-bf43-4b59-9d1e-5f81ec16df12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b183a289c159406098e2f2bb2a570ecf)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:54.571239 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31432d-bf43-4b59-9d1e-5f81ec16df12 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:54.578180 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:54.580708 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf0b1b-78e1-4e6b-a5c2-ec2ed2ea18cc admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:54.589708 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ffcf4-099d-46af-98b9-b4a9fc8ce2e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:54.591044 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ffcf4-099d-46af-98b9-b4a9fc8ce2e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:54.591922 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ffcf4-099d-46af-98b9-b4a9fc8ce2e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:54.593531 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ffcf4-099d-46af-98b9-b4a9fc8ce2e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:54.597239 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f06ffcf4-099d-46af-98b9-b4a9fc8ce2e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:54.617582 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ffcf4-099d-46af-98b9-b4a9fc8ce2e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:54.620449 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ffcf4-099d-46af-98b9-b4a9fc8ce2e9 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:54.629633 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-9c31432d-bf43-4b59-9d1e-5f81ec16df12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b183a289c159406098e2f2bb2a570ecf', 'request_id': 'req-9c31432d-bf43-4b59-9d1e-5f81ec16df12'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:54.635755 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-9c31432d-bf43-4b59-9d1e-5f81ec16df12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b183a289c159406098e2f2bb2a570ecf', 'request_id': 'req-9c31432d-bf43-4b59-9d1e-5f81ec16df12'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:54.636434 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1080/2148] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:54.637484 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ffcf4-099d-46af-98b9-b4a9fc8ce2e9 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:54.639875 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f06ffcf4-099d-46af-98b9-b4a9fc8ce2e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:54.656190 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ffcf4-099d-46af-98b9-b4a9fc8ce2e9 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:54.663104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-9c31432d-bf43-4b59-9d1e-5f81ec16df12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b183a289c159406098e2f2bb2a570ecf', 'request_id': 'req-9c31432d-bf43-4b59-9d1e-5f81ec16df12'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:54.687943 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-9c31432d-bf43-4b59-9d1e-5f81ec16df12 admin admin] The token cache is being invalidate because project b183a289c159406098e2f2bb2a570ecf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:18:54.689990 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-9c31432d-bf43-4b59-9d1e-5f81ec16df12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:54.690778 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-9c31432d-bf43-4b59-9d1e-5f81ec16df12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:54.699409 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1069/2149] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:18:54 2022] DELETE /identity/v3/projects/b183a289c159406098e2f2bb2a570ecf => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:54.712853 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31432d-bf43-4b59-9d1e-5f81ec16df12 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:54.718000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-9c31432d-bf43-4b59-9d1e-5f81ec16df12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:54.757591 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36243ae5-3e89-4c43-8e3f-b0a76a9bf825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:54.759310 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36243ae5-3e89-4c43-8e3f-b0a76a9bf825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:54.760248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36243ae5-3e89-4c43-8e3f-b0a76a9bf825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:54.760574 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36243ae5-3e89-4c43-8e3f-b0a76a9bf825 admin admin] PATH_INFO: `/v3/users/22c81dad60af4611817bec9fc152d501` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:54.763529 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36243ae5-3e89-4c43-8e3f-b0a76a9bf825 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22c81dad60af4611817bec9fc152d501)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:54.765831 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36243ae5-3e89-4c43-8e3f-b0a76a9bf825 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:54.908443 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-36243ae5-3e89-4c43-8e3f-b0a76a9bf825 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22c81dad60af4611817bec9fc152d501'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:54.926137 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31432d-bf43-4b59-9d1e-5f81ec16df12 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:54.934719 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-36243ae5-3e89-4c43-8e3f-b0a76a9bf825 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22c81dad60af4611817bec9fc152d501'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:54.952062 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-36243ae5-3e89-4c43-8e3f-b0a76a9bf825 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22c81dad60af4611817bec9fc152d501'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:54.960220 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673fbb38-46fd-459e-8854-ab1024e522b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:54.961194 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673fbb38-46fd-459e-8854-ab1024e522b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:54.961901 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673fbb38-46fd-459e-8854-ab1024e522b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:54.963027 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673fbb38-46fd-459e-8854-ab1024e522b7 admin admin] PATH_INFO: `/v3/users/084893bae79a4ca2b3d63d92818ea6fe` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:54.964418 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673fbb38-46fd-459e-8854-ab1024e522b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=084893bae79a4ca2b3d63d92818ea6fe)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:54.966983 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673fbb38-46fd-459e-8854-ab1024e522b7 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:55.003404 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-36243ae5-3e89-4c43-8e3f-b0a76a9bf825 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22c81dad60af4611817bec9fc152d501'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:55.007413 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-36243ae5-3e89-4c43-8e3f-b0a76a9bf825 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22c81dad60af4611817bec9fc152d501'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:55.020977 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1081/2150] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:18:54 2022] DELETE /identity/v3/users/22c81dad60af4611817bec9fc152d501 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:55.060930 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-673fbb38-46fd-459e-8854-ab1024e522b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '084893bae79a4ca2b3d63d92818ea6fe'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:55.061607 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-673fbb38-46fd-459e-8854-ab1024e522b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '084893bae79a4ca2b3d63d92818ea6fe'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:55.087382 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-673fbb38-46fd-459e-8854-ab1024e522b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '084893bae79a4ca2b3d63d92818ea6fe'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:55.103739 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-673fbb38-46fd-459e-8854-ab1024e522b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '084893bae79a4ca2b3d63d92818ea6fe'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:55.123998 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-673fbb38-46fd-459e-8854-ab1024e522b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '084893bae79a4ca2b3d63d92818ea6fe'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:55.134078 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1070/2151] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:18:54 2022] DELETE /identity/v3/users/084893bae79a4ca2b3d63d92818ea6fe => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:55.389175 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36243ae5-3e89-4c43-8e3f-b0a76a9bf825 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:55.391049 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-36243ae5-3e89-4c43-8e3f-b0a76a9bf825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:55.450803 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673fbb38-46fd-459e-8854-ab1024e522b7 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:55.453186 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-673fbb38-46fd-459e-8854-ab1024e522b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:55.492730 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:55.557667 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:55.581365 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36243ae5-3e89-4c43-8e3f-b0a76a9bf825 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:55.633347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673fbb38-46fd-459e-8854-ab1024e522b7 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:55.644263 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ab5bb-f2b4-4372-810c-e7c89c32ba4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:55.644949 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ab5bb-f2b4-4372-810c-e7c89c32ba4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:55.645248 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ab5bb-f2b4-4372-810c-e7c89c32ba4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:55.645526 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ab5bb-f2b4-4372-810c-e7c89c32ba4d admin admin] PATH_INFO: `/v3/projects/08ed3efc8b4e465cb5daefb276a094ef` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:55.651387 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4ab5bb-f2b4-4372-810c-e7c89c32ba4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=08ed3efc8b4e465cb5daefb276a094ef)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:55.655579 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4ab5bb-f2b4-4372-810c-e7c89c32ba4d admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:55.692448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3badd1-f54f-4a3d-a785-03b4948fe74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:55.693430 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3badd1-f54f-4a3d-a785-03b4948fe74c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:55.694107 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3badd1-f54f-4a3d-a785-03b4948fe74c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:55.694606 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3badd1-f54f-4a3d-a785-03b4948fe74c admin admin] PATH_INFO: `/v3/projects/78eb8ee37bf74133aba6564c5c0bfce8` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:55.695886 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3badd1-f54f-4a3d-a785-03b4948fe74c admin admin] RBAC: Authorizing `identity:delete_project(project_id=78eb8ee37bf74133aba6564c5c0bfce8)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:55.697953 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3badd1-f54f-4a3d-a785-03b4948fe74c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:55.759608 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3d4ab5bb-f2b4-4372-810c-e7c89c32ba4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08ed3efc8b4e465cb5daefb276a094ef', 'request_id': 'req-3d4ab5bb-f2b4-4372-810c-e7c89c32ba4d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:55.765750 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3d4ab5bb-f2b4-4372-810c-e7c89c32ba4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08ed3efc8b4e465cb5daefb276a094ef', 'request_id': 'req-3d4ab5bb-f2b4-4372-810c-e7c89c32ba4d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:55.772207 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3d4ab5bb-f2b4-4372-810c-e7c89c32ba4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08ed3efc8b4e465cb5daefb276a094ef', 'request_id': 'req-3d4ab5bb-f2b4-4372-810c-e7c89c32ba4d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:55.776293 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-5b3badd1-f54f-4a3d-a785-03b4948fe74c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78eb8ee37bf74133aba6564c5c0bfce8', 'request_id': 'req-5b3badd1-f54f-4a3d-a785-03b4948fe74c'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:55.782770 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-5b3badd1-f54f-4a3d-a785-03b4948fe74c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78eb8ee37bf74133aba6564c5c0bfce8', 'request_id': 'req-5b3badd1-f54f-4a3d-a785-03b4948fe74c'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:55.787251 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3d4ab5bb-f2b4-4372-810c-e7c89c32ba4d admin admin] The token cache is being invalidate because project 08ed3efc8b4e465cb5daefb276a094ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:18:55.787546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3d4ab5bb-f2b4-4372-810c-e7c89c32ba4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:55.788194 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3d4ab5bb-f2b4-4372-810c-e7c89c32ba4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:55.789736 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1071/2152] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:18:55 2022] DELETE /identity/v3/projects/08ed3efc8b4e465cb5daefb276a094ef => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:18:55.790870 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ab5bb-f2b4-4372-810c-e7c89c32ba4d admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:55.791663 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-5b3badd1-f54f-4a3d-a785-03b4948fe74c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78eb8ee37bf74133aba6564c5c0bfce8', 'request_id': 'req-5b3badd1-f54f-4a3d-a785-03b4948fe74c'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:55.794049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-3d4ab5bb-f2b4-4372-810c-e7c89c32ba4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:55.806300 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-5b3badd1-f54f-4a3d-a785-03b4948fe74c admin admin] The token cache is being invalidate because project 78eb8ee37bf74133aba6564c5c0bfce8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:18:55.806746 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-5b3badd1-f54f-4a3d-a785-03b4948fe74c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:55.807647 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-5b3badd1-f54f-4a3d-a785-03b4948fe74c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:55.809226 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1082/2153] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:18:55 2022] DELETE /identity/v3/projects/78eb8ee37bf74133aba6564c5c0bfce8 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:55.810557 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3badd1-f54f-4a3d-a785-03b4948fe74c admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:55.811784 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5b3badd1-f54f-4a3d-a785-03b4948fe74c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:55.875016 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ab5bb-f2b4-4372-810c-e7c89c32ba4d admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:55.888760 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3badd1-f54f-4a3d-a785-03b4948fe74c admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:55.893449 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794cd931-589f-4915-b4bf-8edb45709654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:55.894095 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794cd931-589f-4915-b4bf-8edb45709654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:55.894370 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794cd931-589f-4915-b4bf-8edb45709654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:55.894823 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794cd931-589f-4915-b4bf-8edb45709654 admin admin] PATH_INFO: `/v3/projects/09daf638e2f94f0e92533737e7c91d60` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:55.895942 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794cd931-589f-4915-b4bf-8edb45709654 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09daf638e2f94f0e92533737e7c91d60)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:55.897984 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794cd931-589f-4915-b4bf-8edb45709654 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:55.929724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:55.933901 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:55.944091 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b39cf6-fce8-496a-bc47-66bb5224a9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:55.944879 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b39cf6-fce8-496a-bc47-66bb5224a9bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:55.945213 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b39cf6-fce8-496a-bc47-66bb5224a9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:55.945573 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b39cf6-fce8-496a-bc47-66bb5224a9bd admin admin] PATH_INFO: `/v3/projects/ac1e153d0aed4985ac7e0dbc787c65d4` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:55.947957 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b39cf6-fce8-496a-bc47-66bb5224a9bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac1e153d0aed4985ac7e0dbc787c65d4)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:55.950012 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b39cf6-fce8-496a-bc47-66bb5224a9bd admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:55.959696 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-794cd931-589f-4915-b4bf-8edb45709654 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09daf638e2f94f0e92533737e7c91d60', 'request_id': 'req-794cd931-589f-4915-b4bf-8edb45709654'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:55.966725 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-794cd931-589f-4915-b4bf-8edb45709654 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09daf638e2f94f0e92533737e7c91d60', 'request_id': 'req-794cd931-589f-4915-b4bf-8edb45709654'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:55.974375 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-794cd931-589f-4915-b4bf-8edb45709654 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09daf638e2f94f0e92533737e7c91d60', 'request_id': 'req-794cd931-589f-4915-b4bf-8edb45709654'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:55.990036 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-794cd931-589f-4915-b4bf-8edb45709654 admin admin] The token cache is being invalidate because project 09daf638e2f94f0e92533737e7c91d60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:18:55.990325 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-794cd931-589f-4915-b4bf-8edb45709654 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:55.990995 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-794cd931-589f-4915-b4bf-8edb45709654 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:55.992712 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1083/2154] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:18:55 2022] DELETE /identity/v3/projects/09daf638e2f94f0e92533737e7c91d60 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:55.993672 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000a555-f9c0-4e5b-bd06-68450d3db080 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:55.993949 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000a555-f9c0-4e5b-bd06-68450d3db080 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:55.994219 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000a555-f9c0-4e5b-bd06-68450d3db080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:56.008863 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-34b39cf6-fce8-496a-bc47-66bb5224a9bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac1e153d0aed4985ac7e0dbc787c65d4', 'request_id': 'req-34b39cf6-fce8-496a-bc47-66bb5224a9bd'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:56.021172 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-34b39cf6-fce8-496a-bc47-66bb5224a9bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac1e153d0aed4985ac7e0dbc787c65d4', 'request_id': 'req-34b39cf6-fce8-496a-bc47-66bb5224a9bd'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:56.022235 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-b000a555-f9c0-4e5b-bd06-68450d3db080 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:56.023971 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b000a555-f9c0-4e5b-bd06-68450d3db080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:56.029075 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-34b39cf6-fce8-496a-bc47-66bb5224a9bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac1e153d0aed4985ac7e0dbc787c65d4', 'request_id': 'req-34b39cf6-fce8-496a-bc47-66bb5224a9bd'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:56.049930 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-34b39cf6-fce8-496a-bc47-66bb5224a9bd admin admin] The token cache is being invalidate because project ac1e153d0aed4985ac7e0dbc787c65d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:18:56.050286 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-34b39cf6-fce8-496a-bc47-66bb5224a9bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:56.051060 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-34b39cf6-fce8-496a-bc47-66bb5224a9bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:56.066557 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1072/2155] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:18:55 2022] DELETE /identity/v3/projects/ac1e153d0aed4985ac7e0dbc787c65d4 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:56.066557 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b39cf6-fce8-496a-bc47-66bb5224a9bd admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:56.066557 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-34b39cf6-fce8-496a-bc47-66bb5224a9bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:56.106093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1084/2156] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:56.107417 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a8ad6-124a-47f1-8adf-4fc754e50169 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:56.107702 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a8ad6-124a-47f1-8adf-4fc754e50169 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:56.107973 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a8ad6-124a-47f1-8adf-4fc754e50169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:56.133162 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-ef8a8ad6-124a-47f1-8adf-4fc754e50169 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:56.134701 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ef8a8ad6-124a-47f1-8adf-4fc754e50169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:56.145301 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1085/2157] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:56.146673 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f216e08-6a32-4d42-81cf-11c2b0bc0d35 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:56.147077 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f216e08-6a32-4d42-81cf-11c2b0bc0d35 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:56.147442 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f216e08-6a32-4d42-81cf-11c2b0bc0d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:56.176824 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b39cf6-fce8-496a-bc47-66bb5224a9bd admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:56.181852 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-2f216e08-6a32-4d42-81cf-11c2b0bc0d35 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:56.183476 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2f216e08-6a32-4d42-81cf-11c2b0bc0d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:56.185034 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f78ad3-be09-4db6-a498-db2155a0b5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:56.185742 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f78ad3-be09-4db6-a498-db2155a0b5a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:56.185967 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f78ad3-be09-4db6-a498-db2155a0b5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:56.186245 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f78ad3-be09-4db6-a498-db2155a0b5a1 admin admin] PATH_INFO: `/v3/users/75a87a09a9df4396a42982d79623b6e4` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:56.192095 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f78ad3-be09-4db6-a498-db2155a0b5a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75a87a09a9df4396a42982d79623b6e4)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:56.196028 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f78ad3-be09-4db6-a498-db2155a0b5a1 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:56.206953 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1086/2158] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:56.206953 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b067242-7e2d-411e-8ba9-849acaf5e7df None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:56.206953 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b067242-7e2d-411e-8ba9-849acaf5e7df None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:56.206953 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b067242-7e2d-411e-8ba9-849acaf5e7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:56.244772 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-5b067242-7e2d-411e-8ba9-849acaf5e7df None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:56.247577 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5b067242-7e2d-411e-8ba9-849acaf5e7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:56.263168 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1087/2159] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:56.266430 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80cc754-c8be-4931-8e28-6ba2ce745814 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:56.266430 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80cc754-c8be-4931-8e28-6ba2ce745814 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:56.266430 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80cc754-c8be-4931-8e28-6ba2ce745814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:56.304767 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-e80cc754-c8be-4931-8e28-6ba2ce745814 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:56.307232 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e80cc754-c8be-4931-8e28-6ba2ce745814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:56.329452 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-29f78ad3-be09-4db6-a498-db2155a0b5a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75a87a09a9df4396a42982d79623b6e4'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:56.330956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-29f78ad3-be09-4db6-a498-db2155a0b5a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75a87a09a9df4396a42982d79623b6e4'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:56.343456 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1088/2160] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:56.347218 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd731c-10f7-427b-98b2-d65dda199275 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:56.350953 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd731c-10f7-427b-98b2-d65dda199275 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:56.353087 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd731c-10f7-427b-98b2-d65dda199275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:56.354013 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-29f78ad3-be09-4db6-a498-db2155a0b5a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75a87a09a9df4396a42982d79623b6e4'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:56.372841 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-29f78ad3-be09-4db6-a498-db2155a0b5a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75a87a09a9df4396a42982d79623b6e4'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:56.391060 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-29f78ad3-be09-4db6-a498-db2155a0b5a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75a87a09a9df4396a42982d79623b6e4'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:56.393477 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-fcdd731c-10f7-427b-98b2-d65dda199275 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:56.396337 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:56.399299 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-fcdd731c-10f7-427b-98b2-d65dda199275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:56.402499 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1073/2161] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:18:56 2022] DELETE /identity/v3/users/75a87a09a9df4396a42982d79623b6e4 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:56.405728 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f78ad3-be09-4db6-a498-db2155a0b5a1 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:56.407869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-29f78ad3-be09-4db6-a498-db2155a0b5a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:56.503417 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f78ad3-be09-4db6-a498-db2155a0b5a1 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:56.510689 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb8e37-587f-4828-8a17-bd684932b65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:56.511398 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb8e37-587f-4828-8a17-bd684932b65b admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:56.511760 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb8e37-587f-4828-8a17-bd684932b65b admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:56.512098 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb8e37-587f-4828-8a17-bd684932b65b admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:56.513206 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb8e37-587f-4828-8a17-bd684932b65b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:18:56.513587 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb8e37-587f-4828-8a17-bd684932b65b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:56.515347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb8e37-587f-4828-8a17-bd684932b65b admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:56.529877 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1074/2162] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:18:56.530941 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb8e37-587f-4828-8a17-bd684932b65b admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:56.534960 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d8cb8e37-587f-4828-8a17-bd684932b65b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:56.549869 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1089/2163] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:56.550866 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd731c-10f7-427b-98b2-d65dda199275 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:56.565070 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb8e37-587f-4828-8a17-bd684932b65b admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:56.570363 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0e013-3d4a-47ec-8117-0de5899d1557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:56.571074 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0e013-3d4a-47ec-8117-0de5899d1557 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:56.571425 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0e013-3d4a-47ec-8117-0de5899d1557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:56.571758 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0e013-3d4a-47ec-8117-0de5899d1557 admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:56.571940 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd731c-10f7-427b-98b2-d65dda199275 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:56.572550 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b0e013-3d4a-47ec-8117-0de5899d1557 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:18:56.572971 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b0e013-3d4a-47ec-8117-0de5899d1557 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:56.575919 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b0e013-3d4a-47ec-8117-0de5899d1557 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:56.580448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d268836-c84f-46be-88b4-b629cfab0b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:56.581544 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d268836-c84f-46be-88b4-b629cfab0b64 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:56.582513 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d268836-c84f-46be-88b4-b629cfab0b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:56.582951 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d268836-c84f-46be-88b4-b629cfab0b64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:56.583910 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d268836-c84f-46be-88b4-b629cfab0b64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:56.586051 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d268836-c84f-46be-88b4-b629cfab0b64 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:56.590880 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1075/2164] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:18:56.591785 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0e013-3d4a-47ec-8117-0de5899d1557 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:56.605563 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0e013-3d4a-47ec-8117-0de5899d1557 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:56.614220 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d128d8-4c83-4e7f-8855-d974fddfa043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:56.615127 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d128d8-4c83-4e7f-8855-d974fddfa043 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:56.615425 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d128d8-4c83-4e7f-8855-d974fddfa043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:56.615699 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d128d8-4c83-4e7f-8855-d974fddfa043 admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:56.616454 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d128d8-4c83-4e7f-8855-d974fddfa043 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:18:56.617215 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d128d8-4c83-4e7f-8855-d974fddfa043 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:56.618596 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d128d8-4c83-4e7f-8855-d974fddfa043 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:56.637128 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1090/2165] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:18:56 2022] POST /identity/v3/projects => generated 375 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:56.637128 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d268836-c84f-46be-88b4-b629cfab0b64 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:56.648102 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:56.648979 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1076/2166] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:18:56.653479 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d128d8-4c83-4e7f-8855-d974fddfa043 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:56.680397 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d128d8-4c83-4e7f-8855-d974fddfa043 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:56.717982 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d268836-c84f-46be-88b4-b629cfab0b64 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:56.732222 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8f6b2-6f95-47e8-8291-ce1be9c384fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:56.732867 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8f6b2-6f95-47e8-8291-ce1be9c384fe admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:56.733146 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8f6b2-6f95-47e8-8291-ce1be9c384fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:56.733419 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8f6b2-6f95-47e8-8291-ce1be9c384fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:56.734063 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8f6b2-6f95-47e8-8291-ce1be9c384fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:56.736769 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8f6b2-6f95-47e8-8291-ce1be9c384fe admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:56.778209 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1091/2167] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:18:56 2022] POST /identity/v3/projects => generated 361 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:56.779216 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8f6b2-6f95-47e8-8291-ce1be9c384fe admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:56.781976 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf15a04-7632-4b9a-85df-276cf9bcc3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:56.782808 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf15a04-7632-4b9a-85df-276cf9bcc3aa admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:56.783226 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf15a04-7632-4b9a-85df-276cf9bcc3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:56.783600 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf15a04-7632-4b9a-85df-276cf9bcc3aa admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:56.784674 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf15a04-7632-4b9a-85df-276cf9bcc3aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:56.786951 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf15a04-7632-4b9a-85df-276cf9bcc3aa admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:56.836898 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1077/2168] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:18:56 2022] POST /identity/v3/users => generated 288 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:56.836898 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf15a04-7632-4b9a-85df-276cf9bcc3aa admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:56.857657 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf15a04-7632-4b9a-85df-276cf9bcc3aa admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:56.909236 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8f6b2-6f95-47e8-8291-ce1be9c384fe admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:56.920224 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da40ab-c2b5-4ac3-a57f-59f66020489a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:56.920858 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da40ab-c2b5-4ac3-a57f-59f66020489a admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:56.921138 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da40ab-c2b5-4ac3-a57f-59f66020489a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:56.921515 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da40ab-c2b5-4ac3-a57f-59f66020489a admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:56.922164 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da40ab-c2b5-4ac3-a57f-59f66020489a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:56.924243 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da40ab-c2b5-4ac3-a57f-59f66020489a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:56.974124 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:56.976869 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1092/2169] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:18:56 2022] POST /identity/v3/projects => generated 373 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:56.977620 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da40ab-c2b5-4ac3-a57f-59f66020489a admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:56.988419 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212c0e4-f6dc-4d18-8ca7-f54d8a5b20a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:56.989414 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212c0e4-f6dc-4d18-8ca7-f54d8a5b20a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:56.989414 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212c0e4-f6dc-4d18-8ca7-f54d8a5b20a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:56.989640 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212c0e4-f6dc-4d18-8ca7-f54d8a5b20a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:56.990214 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b212c0e4-f6dc-4d18-8ca7-f54d8a5b20a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:56.992286 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b212c0e4-f6dc-4d18-8ca7-f54d8a5b20a0 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:57.018596 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1078/2170] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:18:56 2022] POST /identity/v3/users => generated 281 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:57.019479 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212c0e4-f6dc-4d18-8ca7-f54d8a5b20a0 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:57.021182 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-b212c0e4-f6dc-4d18-8ca7-f54d8a5b20a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:57.035693 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212c0e4-f6dc-4d18-8ca7-f54d8a5b20a0 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:57.071809 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da40ab-c2b5-4ac3-a57f-59f66020489a admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:57.077512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f383d-eafb-4ef5-8bae-14b15815e5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:57.078537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f383d-eafb-4ef5-8bae-14b15815e5c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:57.078537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f383d-eafb-4ef5-8bae-14b15815e5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:57.078818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f383d-eafb-4ef5-8bae-14b15815e5c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:57.079479 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f383d-eafb-4ef5-8bae-14b15815e5c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:57.081403 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f383d-eafb-4ef5-8bae-14b15815e5c6 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:57.093641 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1093/2171] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:57.094782 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f383d-eafb-4ef5-8bae-14b15815e5c6 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:57.108126 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f383d-eafb-4ef5-8bae-14b15815e5c6 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:57.116356 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388c182-69a2-4dce-b658-eb27d434d86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:57.116980 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388c182-69a2-4dce-b658-eb27d434d86e admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:57.117259 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388c182-69a2-4dce-b658-eb27d434d86e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:57.117532 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388c182-69a2-4dce-b658-eb27d434d86e admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:57.118184 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5388c182-69a2-4dce-b658-eb27d434d86e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:57.120152 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5388c182-69a2-4dce-b658-eb27d434d86e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:57.132988 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:57.133381 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83802a42-78c8-40be-8d71-ee9ffa2ed37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:57.134257 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83802a42-78c8-40be-8d71-ee9ffa2ed37d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:57.134631 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83802a42-78c8-40be-8d71-ee9ffa2ed37d admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:57.134974 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83802a42-78c8-40be-8d71-ee9ffa2ed37d admin admin] PATH_INFO: `/v3/projects/695f8b8490294869817a4bbaa0ac85d0` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:57.136753 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83802a42-78c8-40be-8d71-ee9ffa2ed37d admin admin] RBAC: Authorizing `identity:delete_project(project_id=695f8b8490294869817a4bbaa0ac85d0)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:57.139592 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83802a42-78c8-40be-8d71-ee9ffa2ed37d admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:57.149402 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1094/2172] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:18:57 2022] POST /identity/v3/users => generated 287 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:57.150275 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388c182-69a2-4dce-b658-eb27d434d86e admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:57.161291 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388c182-69a2-4dce-b658-eb27d434d86e admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:57.167939 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da3e60-a146-4a9b-a285-bd2cac197f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:57.168553 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da3e60-a146-4a9b-a285-bd2cac197f21 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:57.168831 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da3e60-a146-4a9b-a285-bd2cac197f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:57.169101 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da3e60-a146-4a9b-a285-bd2cac197f21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:57.169749 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da3e60-a146-4a9b-a285-bd2cac197f21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:57.171495 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da3e60-a146-4a9b-a285-bd2cac197f21 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:57.187965 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1095/2173] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:57.189070 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da3e60-a146-4a9b-a285-bd2cac197f21 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:57.200190 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da3e60-a146-4a9b-a285-bd2cac197f21 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:57.209997 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-83802a42-78c8-40be-8d71-ee9ffa2ed37d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '695f8b8490294869817a4bbaa0ac85d0', 'request_id': 'req-83802a42-78c8-40be-8d71-ee9ffa2ed37d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:57.217563 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-83802a42-78c8-40be-8d71-ee9ffa2ed37d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '695f8b8490294869817a4bbaa0ac85d0', 'request_id': 'req-83802a42-78c8-40be-8d71-ee9ffa2ed37d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:57.226219 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-83802a42-78c8-40be-8d71-ee9ffa2ed37d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '695f8b8490294869817a4bbaa0ac85d0', 'request_id': 'req-83802a42-78c8-40be-8d71-ee9ffa2ed37d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:57.243965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-83802a42-78c8-40be-8d71-ee9ffa2ed37d admin admin] The token cache is being invalidate because project 695f8b8490294869817a4bbaa0ac85d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:18:57.244257 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-83802a42-78c8-40be-8d71-ee9ffa2ed37d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:57.244919 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-83802a42-78c8-40be-8d71-ee9ffa2ed37d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:57.246751 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1079/2174] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:18:57 2022] DELETE /identity/v3/projects/695f8b8490294869817a4bbaa0ac85d0 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:57.247517 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83802a42-78c8-40be-8d71-ee9ffa2ed37d admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:57.248806 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-83802a42-78c8-40be-8d71-ee9ffa2ed37d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:57.277387 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213e426-1f37-4806-8f9b-68ff2c2ab0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:57.278250 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213e426-1f37-4806-8f9b-68ff2c2ab0d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:57.278996 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213e426-1f37-4806-8f9b-68ff2c2ab0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:57.279438 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213e426-1f37-4806-8f9b-68ff2c2ab0d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:57.280606 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213e426-1f37-4806-8f9b-68ff2c2ab0d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:57.284419 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213e426-1f37-4806-8f9b-68ff2c2ab0d2 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:57.303001 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1096/2175] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:57.305021 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213e426-1f37-4806-8f9b-68ff2c2ab0d2 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:57.307556 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3213e426-1f37-4806-8f9b-68ff2c2ab0d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:57.322867 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213e426-1f37-4806-8f9b-68ff2c2ab0d2 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:57.326958 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83802a42-78c8-40be-8d71-ee9ffa2ed37d admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:57.328664 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722ed02-1081-4e4d-8944-81eed33bc89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:57.329447 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722ed02-1081-4e4d-8944-81eed33bc89b admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:57.329951 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722ed02-1081-4e4d-8944-81eed33bc89b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:57.330445 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722ed02-1081-4e4d-8944-81eed33bc89b admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:57.331352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e722ed02-1081-4e4d-8944-81eed33bc89b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:57.333348 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e722ed02-1081-4e4d-8944-81eed33bc89b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:57.343441 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb72de-12ed-4bdb-8f15-40e29efd6ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:57.344152 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb72de-12ed-4bdb-8f15-40e29efd6ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:57.344569 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb72de-12ed-4bdb-8f15-40e29efd6ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:57.345133 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb72de-12ed-4bdb-8f15-40e29efd6ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:57.350524 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1097/2176] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:57.352264 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8dc777-3cdc-46c1-beff-87dbb26f8264 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:57.353753 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8dc777-3cdc-46c1-beff-87dbb26f8264 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:57.354926 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8dc777-3cdc-46c1-beff-87dbb26f8264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:57.370483 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb72de-12ed-4bdb-8f15-40e29efd6ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:57.372558 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb72de-12ed-4bdb-8f15-40e29efd6ce9 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:57.388870 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-ca8dc777-3cdc-46c1-beff-87dbb26f8264 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:57.389490 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1080/2177] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:57.390628 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb72de-12ed-4bdb-8f15-40e29efd6ce9 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:57.390893 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ca8dc777-3cdc-46c1-beff-87dbb26f8264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:57.392893 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-97fb72de-12ed-4bdb-8f15-40e29efd6ce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:57.415643 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1098/2178] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:57.416864 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8dc777-3cdc-46c1-beff-87dbb26f8264 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:57.429711 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8dc777-3cdc-46c1-beff-87dbb26f8264 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:57.436739 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb72de-12ed-4bdb-8f15-40e29efd6ce9 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:57.438739 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7922b6-5233-48d0-a98b-1718913a7c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:57.439411 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7922b6-5233-48d0-a98b-1718913a7c10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:57.439691 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7922b6-5233-48d0-a98b-1718913a7c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:57.439967 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7922b6-5233-48d0-a98b-1718913a7c10 admin admin] PATH_INFO: `/v3/projects/d13c92f487e74a3984823cbc1996e1a4/users/5161971f558541cab1708db7a360c92e/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:57.443558 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33781d-a973-4b61-bfab-b29864bdf686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:57.444350 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33781d-a973-4b61-bfab-b29864bdf686 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:57.444755 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33781d-a973-4b61-bfab-b29864bdf686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:57.445123 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33781d-a973-4b61-bfab-b29864bdf686 admin admin] PATH_INFO: `/v3/projects/d7c39dca7aab471382e7db75a33b1b19/users/fb27620f7d66408e993a111ff2df829a/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:57.469863 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:57.471032 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7922b6-5233-48d0-a98b-1718913a7c10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d13c92f487e74a3984823cbc1996e1a4, user_id=5161971f558541cab1708db7a360c92e, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:57.475624 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7922b6-5233-48d0-a98b-1718913a7c10 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:57.484967 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce33781d-a973-4b61-bfab-b29864bdf686 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7c39dca7aab471382e7db75a33b1b19, user_id=fb27620f7d66408e993a111ff2df829a, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:57.490575 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce33781d-a973-4b61-bfab-b29864bdf686 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:57.514342 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1099/2179] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:57 2022] PUT /identity/v3/projects/d13c92f487e74a3984823cbc1996e1a4/users/5161971f558541cab1708db7a360c92e/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:57.515496 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7922b6-5233-48d0-a98b-1718913a7c10 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:57.522560 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1081/2180] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:57 2022] PUT /identity/v3/projects/d7c39dca7aab471382e7db75a33b1b19/users/fb27620f7d66408e993a111ff2df829a/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:57.524657 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c41a9c-6c07-4f29-9d06-f2ff285684c4 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:57.525191 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c41a9c-6c07-4f29-9d06-f2ff285684c4 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:57.525686 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c41a9c-6c07-4f29-9d06-f2ff285684c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:57.559757 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-f8c41a9c-6c07-4f29-9d06-f2ff285684c4 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:57.560991 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f8c41a9c-6c07-4f29-9d06-f2ff285684c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:57.641183 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7922b6-5233-48d0-a98b-1718913a7c10 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:57.648616 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1082/2181] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:57.649846 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1db2e-0459-4fa3-bd79-563bcea1e37e None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:57.650134 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1db2e-0459-4fa3-bd79-563bcea1e37e None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:57.650409 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1db2e-0459-4fa3-bd79-563bcea1e37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:57.653749 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1c25a-8d2a-447d-998c-9e0614469db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:57.654379 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1c25a-8d2a-447d-998c-9e0614469db0 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:57.654690 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1c25a-8d2a-447d-998c-9e0614469db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:57.654951 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1c25a-8d2a-447d-998c-9e0614469db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:57.655602 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa1c25a-8d2a-447d-998c-9e0614469db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:57.657216 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa1c25a-8d2a-447d-998c-9e0614469db0 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:57.679601 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1100/2182] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:57.681317 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca0420-e6cc-4c90-958e-aacb61b1cafd None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:57.681818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca0420-e6cc-4c90-958e-aacb61b1cafd None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:57.682095 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca0420-e6cc-4c90-958e-aacb61b1cafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:57.693581 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-bbf1db2e-0459-4fa3-bd79-563bcea1e37e None None] MFA Rules not processed for user `5161971f558541cab1708db7a360c92e`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:57.695047 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-bbf1db2e-0459-4fa3-bd79-563bcea1e37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:57.714956 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-dfca0420-e6cc-4c90-958e-aacb61b1cafd None None] MFA Rules not processed for user `fb27620f7d66408e993a111ff2df829a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:57.716186 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-dfca0420-e6cc-4c90-958e-aacb61b1cafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:57.753806 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:57.843248 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1083/2183] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:57.849647 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1db2e-0459-4fa3-bd79-563bcea1e37e None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:57.860949 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1101/2184] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:57.866049 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca0420-e6cc-4c90-958e-aacb61b1cafd None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:57.892828 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1db2e-0459-4fa3-bd79-563bcea1e37e None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:57.899430 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca0420-e6cc-4c90-958e-aacb61b1cafd None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:57.905703 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ceda8-6469-45f7-82e9-ae6b57f09c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:57.906332 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ceda8-6469-45f7-82e9-ae6b57f09c76 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:57.906646 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ceda8-6469-45f7-82e9-ae6b57f09c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:57.906920 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ceda8-6469-45f7-82e9-ae6b57f09c76 admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:57.907580 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64ceda8-6469-45f7-82e9-ae6b57f09c76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:18:57.907918 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64ceda8-6469-45f7-82e9-ae6b57f09c76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:57.909133 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135863b5-fdee-42ca-8a75-a51e9a44809b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:57.909516 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64ceda8-6469-45f7-82e9-ae6b57f09c76 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:57.910020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135863b5-fdee-42ca-8a75-a51e9a44809b admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:57.910392 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135863b5-fdee-42ca-8a75-a51e9a44809b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:57.910797 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135863b5-fdee-42ca-8a75-a51e9a44809b admin admin] PATH_INFO: `/v3/projects/104882b16c3c4b60b745aaeb6e235210/users/a0bfacd81a184a74adbb16c80e722f33/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:57.931566 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135863b5-fdee-42ca-8a75-a51e9a44809b admin admin] RBAC: Authorizing `identity:create_grant(project_id=104882b16c3c4b60b745aaeb6e235210, user_id=a0bfacd81a184a74adbb16c80e722f33, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:57.934690 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135863b5-fdee-42ca-8a75-a51e9a44809b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:57.940082 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1084/2185] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:18:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:18:57.941062 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ceda8-6469-45f7-82e9-ae6b57f09c76 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:57.942971 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f64ceda8-6469-45f7-82e9-ae6b57f09c76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:57.963315 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1102/2186] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:57 2022] PUT /identity/v3/projects/104882b16c3c4b60b745aaeb6e235210/users/a0bfacd81a184a74adbb16c80e722f33/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:57.966063 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135863b5-fdee-42ca-8a75-a51e9a44809b admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:58.053809 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ceda8-6469-45f7-82e9-ae6b57f09c76 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:58.081159 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135863b5-fdee-42ca-8a75-a51e9a44809b admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:58.086217 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:58.088374 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e31194-197e-4da0-8b7f-9882b9f3efb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:58.089222 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e31194-197e-4da0-8b7f-9882b9f3efb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:58.089515 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e31194-197e-4da0-8b7f-9882b9f3efb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:58.089790 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e31194-197e-4da0-8b7f-9882b9f3efb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:58.090430 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e31194-197e-4da0-8b7f-9882b9f3efb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:58.092414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e31194-197e-4da0-8b7f-9882b9f3efb5 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:58.124278 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48eecf7-4658-4e2a-85d4-217d638a2616 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:58.124533 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1103/2187] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:18:57 2022] POST /identity/v3/projects => generated 373 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:58.125723 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18611952-f482-428b-ac13-bf73dcabbe92 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:58.125852 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48eecf7-4658-4e2a-85d4-217d638a2616 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:58.126086 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48eecf7-4658-4e2a-85d4-217d638a2616 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:58.126191 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18611952-f482-428b-ac13-bf73dcabbe92 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:58.126363 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48eecf7-4658-4e2a-85d4-217d638a2616 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:58.126550 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18611952-f482-428b-ac13-bf73dcabbe92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:58.147115 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-18611952-f482-428b-ac13-bf73dcabbe92 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:58.148353 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-18611952-f482-428b-ac13-bf73dcabbe92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:58.206251 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48eecf7-4658-4e2a-85d4-217d638a2616 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:58.208177 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48eecf7-4658-4e2a-85d4-217d638a2616 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:58.219190 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1085/2188] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:58.220368 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48eecf7-4658-4e2a-85d4-217d638a2616 service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:58.222695 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-c48eecf7-4658-4e2a-85d4-217d638a2616 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:58.228371 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1104/2189] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:58.229272 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18611952-f482-428b-ac13-bf73dcabbe92 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:58.239563 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18611952-f482-428b-ac13-bf73dcabbe92 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:58.244270 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48eecf7-4658-4e2a-85d4-217d638a2616 service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:58.245393 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894c276-dd2e-4580-8fde-27f57bd9be08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:58.246008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894c276-dd2e-4580-8fde-27f57bd9be08 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:58.246283 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894c276-dd2e-4580-8fde-27f57bd9be08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:58.246600 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894c276-dd2e-4580-8fde-27f57bd9be08 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:58.247948 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894c276-dd2e-4580-8fde-27f57bd9be08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:58.249956 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894c276-dd2e-4580-8fde-27f57bd9be08 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:58.287646 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1105/2190] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:18:58 2022] POST /identity/v3/users => generated 287 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:18:58.288653 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894c276-dd2e-4580-8fde-27f57bd9be08 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:58.294024 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d894c276-dd2e-4580-8fde-27f57bd9be08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:58.319743 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:58.336747 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb9490-4266-4edf-b63f-f1fca2b3fdfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:58.337145 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb9490-4266-4edf-b63f-f1fca2b3fdfd service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:58.337497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb9490-4266-4edf-b63f-f1fca2b3fdfd service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:58.338871 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb9490-4266-4edf-b63f-f1fca2b3fdfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:58.433953 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb9490-4266-4edf-b63f-f1fca2b3fdfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:58.435406 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb9490-4266-4edf-b63f-f1fca2b3fdfd service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:58.447168 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1086/2191] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:58.448038 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb9490-4266-4edf-b63f-f1fca2b3fdfd service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:58.448215 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894c276-dd2e-4580-8fde-27f57bd9be08 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:58.453020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79869c07-bde1-4653-b576-f5e1fd57b180 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:58.454079 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79869c07-bde1-4653-b576-f5e1fd57b180 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:58.454358 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79869c07-bde1-4653-b576-f5e1fd57b180 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:58.454776 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79869c07-bde1-4653-b576-f5e1fd57b180 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:58.461498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb9490-4266-4edf-b63f-f1fca2b3fdfd service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:58.467549 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79869c07-bde1-4653-b576-f5e1fd57b180 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:58.467731 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea016bda-9077-46d0-81ad-ce7b4cb3bdde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:58.468262 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea016bda-9077-46d0-81ad-ce7b4cb3bdde admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:58.468711 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea016bda-9077-46d0-81ad-ce7b4cb3bdde admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:58.468994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea016bda-9077-46d0-81ad-ce7b4cb3bdde admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:58.469534 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79869c07-bde1-4653-b576-f5e1fd57b180 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:58.469776 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea016bda-9077-46d0-81ad-ce7b4cb3bdde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:58.472864 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea016bda-9077-46d0-81ad-ce7b4cb3bdde admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:58.491044 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1087/2192] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:58.493268 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea016bda-9077-46d0-81ad-ce7b4cb3bdde admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:58.500039 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1106/2193] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:58.528753 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea016bda-9077-46d0-81ad-ce7b4cb3bdde admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:58.567011 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb25d1e-31fe-4f46-95eb-2eed378bf1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:58.567659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb25d1e-31fe-4f46-95eb-2eed378bf1bc admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:58.567943 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb25d1e-31fe-4f46-95eb-2eed378bf1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:58.568212 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb25d1e-31fe-4f46-95eb-2eed378bf1bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:58.568861 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb25d1e-31fe-4f46-95eb-2eed378bf1bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:58.570553 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb25d1e-31fe-4f46-95eb-2eed378bf1bc admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:58.615566 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1088/2194] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:18:58.617496 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79869c07-bde1-4653-b576-f5e1fd57b180 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:58.633589 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79869c07-bde1-4653-b576-f5e1fd57b180 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:58.647492 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc6ae9-3574-4bdf-94c1-80b77af0a785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:58.648307 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc6ae9-3574-4bdf-94c1-80b77af0a785 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:58.648734 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc6ae9-3574-4bdf-94c1-80b77af0a785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:58.650715 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc6ae9-3574-4bdf-94c1-80b77af0a785 admin admin] PATH_INFO: `/v3/projects/f7952b5ee8114bd687c07416d5e8e35b/users/31b795ee988d49b9bf9dbf283d1a2ba6/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:58.690636 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc6ae9-3574-4bdf-94c1-80b77af0a785 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7952b5ee8114bd687c07416d5e8e35b, user_id=31b795ee988d49b9bf9dbf283d1a2ba6, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:58.701617 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc6ae9-3574-4bdf-94c1-80b77af0a785 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:58.737196 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1107/2195] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:18:58 2022] PUT /identity/v3/projects/f7952b5ee8114bd687c07416d5e8e35b/users/31b795ee988d49b9bf9dbf283d1a2ba6/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:58.748481 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d2699-853f-4566-86fc-757167a15e52 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:58.748777 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d2699-853f-4566-86fc-757167a15e52 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:58.749059 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d2699-853f-4566-86fc-757167a15e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:58.827347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:58.851897 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-eb3d2699-853f-4566-86fc-757167a15e52 None None] MFA Rules not processed for user `31b795ee988d49b9bf9dbf283d1a2ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:58.853322 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-eb3d2699-853f-4566-86fc-757167a15e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:58.997429 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1089/2196] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:18:59.027816 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc6ae9-3574-4bdf-94c1-80b77af0a785 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:59.150799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc6ae9-3574-4bdf-94c1-80b77af0a785 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:59.156079 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e2aed-ba09-48ad-b456-0b9976d5c115 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:59.156755 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e2aed-ba09-48ad-b456-0b9976d5c115 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:59.157033 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e2aed-ba09-48ad-b456-0b9976d5c115 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:59.157304 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e2aed-ba09-48ad-b456-0b9976d5c115 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:59.178669 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e2aed-ba09-48ad-b456-0b9976d5c115 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:59.180888 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e2aed-ba09-48ad-b456-0b9976d5c115 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:59.203007 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1108/2197] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:18:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:59.265508 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d2699-853f-4566-86fc-757167a15e52 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:59.268022 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-eb3d2699-853f-4566-86fc-757167a15e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:59.429412 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d2699-853f-4566-86fc-757167a15e52 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:59.453556 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f40c31-f174-4e58-bda8-fb56d0ae2087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:59.458127 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f40c31-f174-4e58-bda8-fb56d0ae2087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:59.458681 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f40c31-f174-4e58-bda8-fb56d0ae2087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:59.459131 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f40c31-f174-4e58-bda8-fb56d0ae2087 admin admin] PATH_INFO: `/v3/users/79d5a74b556544d5a46bf7b6d3488910` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:59.460912 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f40c31-f174-4e58-bda8-fb56d0ae2087 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79d5a74b556544d5a46bf7b6d3488910)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:59.463304 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f40c31-f174-4e58-bda8-fb56d0ae2087 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:59.558747 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-e3f40c31-f174-4e58-bda8-fb56d0ae2087 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79d5a74b556544d5a46bf7b6d3488910'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:59.559527 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-e3f40c31-f174-4e58-bda8-fb56d0ae2087 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79d5a74b556544d5a46bf7b6d3488910'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:59.573572 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-e3f40c31-f174-4e58-bda8-fb56d0ae2087 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79d5a74b556544d5a46bf7b6d3488910'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:59.582577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-e3f40c31-f174-4e58-bda8-fb56d0ae2087 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79d5a74b556544d5a46bf7b6d3488910'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:59.592077 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-e3f40c31-f174-4e58-bda8-fb56d0ae2087 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79d5a74b556544d5a46bf7b6d3488910'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:18:59.599950 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1090/2198] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:18:59 2022] DELETE /identity/v3/users/79d5a74b556544d5a46bf7b6d3488910 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:18:59.814713 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f0ac1-d2ff-4093-a5f7-ad8123aeec7f None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:59.815270 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f0ac1-d2ff-4093-a5f7-ad8123aeec7f None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:59.815270 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f0ac1-d2ff-4093-a5f7-ad8123aeec7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:59.839935 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f40c31-f174-4e58-bda8-fb56d0ae2087 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:59.842439 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-e3f40c31-f174-4e58-bda8-fb56d0ae2087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:59.857930 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-e07f0ac1-d2ff-4093-a5f7-ad8123aeec7f None None] MFA Rules not processed for user `a0bfacd81a184a74adbb16c80e722f33`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:18:59.859721 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e07f0ac1-d2ff-4093-a5f7-ad8123aeec7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:59.877114 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:59.951298 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1109/2199] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:18:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:18:59.957355 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f0ac1-d2ff-4093-a5f7-ad8123aeec7f None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:18:59.960787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f40c31-f174-4e58-bda8-fb56d0ae2087 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:59.960925 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e07f0ac1-d2ff-4093-a5f7-ad8123aeec7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:18:59.966690 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b4922-f8f3-48d0-bf29-d7fcc747a0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:59.967461 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b4922-f8f3-48d0-bf29-d7fcc747a0a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:59.967848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b4922-f8f3-48d0-bf29-d7fcc747a0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:59.968227 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b4922-f8f3-48d0-bf29-d7fcc747a0a7 admin admin] PATH_INFO: `/v3/projects/8d80dc523a1343309bc0893f18038c1e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:59.969750 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8b4922-f8f3-48d0-bf29-d7fcc747a0a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d80dc523a1343309bc0893f18038c1e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:59.973501 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8b4922-f8f3-48d0-bf29-d7fcc747a0a7 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:18:59.977663 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f0ac1-d2ff-4093-a5f7-ad8123aeec7f None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:18:59.986697 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee56f800-1b53-4468-906b-1d06ea75c4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:18:59.987332 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56f800-1b53-4468-906b-1d06ea75c4ee admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:18:59.987614 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56f800-1b53-4468-906b-1d06ea75c4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:18:59.987883 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56f800-1b53-4468-906b-1d06ea75c4ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:18:59.988526 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee56f800-1b53-4468-906b-1d06ea75c4ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:18:59.994410 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee56f800-1b53-4468-906b-1d06ea75c4ee admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:00.025833 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:00.042149 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1110/2200] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:18:59 2022] POST /identity/v3/projects => generated 373 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:19:00.043096 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee56f800-1b53-4468-906b-1d06ea75c4ee admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:00.049523 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-9e8b4922-f8f3-48d0-bf29-d7fcc747a0a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d80dc523a1343309bc0893f18038c1e', 'request_id': 'req-9e8b4922-f8f3-48d0-bf29-d7fcc747a0a7'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:00.056442 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-9e8b4922-f8f3-48d0-bf29-d7fcc747a0a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d80dc523a1343309bc0893f18038c1e', 'request_id': 'req-9e8b4922-f8f3-48d0-bf29-d7fcc747a0a7'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:00.064183 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-9e8b4922-f8f3-48d0-bf29-d7fcc747a0a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d80dc523a1343309bc0893f18038c1e', 'request_id': 'req-9e8b4922-f8f3-48d0-bf29-d7fcc747a0a7'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:00.086902 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-9e8b4922-f8f3-48d0-bf29-d7fcc747a0a7 admin admin] The token cache is being invalidate because project 8d80dc523a1343309bc0893f18038c1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:19:00.087201 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-9e8b4922-f8f3-48d0-bf29-d7fcc747a0a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:00.087852 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-9e8b4922-f8f3-48d0-bf29-d7fcc747a0a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:00.089957 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1091/2201] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:18:59 2022] DELETE /identity/v3/projects/8d80dc523a1343309bc0893f18038c1e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:19:00.094895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c021f-58b5-4b71-b3c2-bc460fe7c1bd None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:00.095179 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c021f-58b5-4b71-b3c2-bc460fe7c1bd None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:00.095504 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c021f-58b5-4b71-b3c2-bc460fe7c1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:00.119113 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-215c021f-58b5-4b71-b3c2-bc460fe7c1bd None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:00.120496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-215c021f-58b5-4b71-b3c2-bc460fe7c1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:00.130570 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1092/2202] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:19:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:00.137309 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9560ff-b00d-435c-a873-74044801b775 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:00.137603 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9560ff-b00d-435c-a873-74044801b775 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:00.137909 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9560ff-b00d-435c-a873-74044801b775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:00.144204 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee56f800-1b53-4468-906b-1d06ea75c4ee admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:00.149741 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f1ffe4-0a34-4023-bcc1-5491125bcfe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:00.150623 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1ffe4-0a34-4023-bcc1-5491125bcfe3 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:00.150985 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1ffe4-0a34-4023-bcc1-5491125bcfe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:00.151267 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1ffe4-0a34-4023-bcc1-5491125bcfe3 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:00.151910 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f1ffe4-0a34-4023-bcc1-5491125bcfe3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:00.153879 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f1ffe4-0a34-4023-bcc1-5491125bcfe3 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:00.160184 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-cb9560ff-b00d-435c-a873-74044801b775 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:00.161593 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-cb9560ff-b00d-435c-a873-74044801b775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:00.171562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1093/2203] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:19:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:19:00.175712 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9560ff-b00d-435c-a873-74044801b775 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:00.180653 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1111/2204] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:19:00 2022] POST /identity/v3/users => generated 293 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:19:00.182138 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f1ffe4-0a34-4023-bcc1-5491125bcfe3 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:00.184305 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-39f1ffe4-0a34-4023-bcc1-5491125bcfe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:00.188486 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9560ff-b00d-435c-a873-74044801b775 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:00.197545 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f1ffe4-0a34-4023-bcc1-5491125bcfe3 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:00.202254 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c150fc-508b-49bc-a41f-4c7c21774a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:00.203006 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c150fc-508b-49bc-a41f-4c7c21774a9d admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:00.203212 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c150fc-508b-49bc-a41f-4c7c21774a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:00.203816 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c150fc-508b-49bc-a41f-4c7c21774a9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:00.204214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c150fc-508b-49bc-a41f-4c7c21774a9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:00.206418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c150fc-508b-49bc-a41f-4c7c21774a9d admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:00.209653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ce3f0-a1ac-43d8-94d6-72c863d985fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:00.210352 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ce3f0-a1ac-43d8-94d6-72c863d985fd admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:00.210920 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ce3f0-a1ac-43d8-94d6-72c863d985fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:00.212707 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ce3f0-a1ac-43d8-94d6-72c863d985fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:00.212707 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ce3f0-a1ac-43d8-94d6-72c863d985fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:19:00.212883 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ce3f0-a1ac-43d8-94d6-72c863d985fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:00.214508 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ce3f0-a1ac-43d8-94d6-72c863d985fd admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:00.217273 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1112/2205] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:19:00.221938 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c150fc-508b-49bc-a41f-4c7c21774a9d admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:00.228328 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1094/2206] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:19:00.232922 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ce3f0-a1ac-43d8-94d6-72c863d985fd admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:00.234894 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c150fc-508b-49bc-a41f-4c7c21774a9d admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:00.241460 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d592d-7b4f-413e-b486-485426d72fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:00.242391 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d592d-7b4f-413e-b486-485426d72fb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:00.242790 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d592d-7b4f-413e-b486-485426d72fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:00.243057 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d592d-7b4f-413e-b486-485426d72fb7 admin admin] PATH_INFO: `/v3/projects/38ad49e1bda548ea8f1fc07c074035fc/users/71f09fcfc59e45b1b1f8901f648cdb5d/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:00.243583 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ce3f0-a1ac-43d8-94d6-72c863d985fd admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:00.251142 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3658228-4a27-473e-ad90-3d53ea42fca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:00.252593 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3658228-4a27-473e-ad90-3d53ea42fca2 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:00.253046 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3658228-4a27-473e-ad90-3d53ea42fca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:00.253366 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3658228-4a27-473e-ad90-3d53ea42fca2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:00.254211 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3658228-4a27-473e-ad90-3d53ea42fca2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:00.256726 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3658228-4a27-473e-ad90-3d53ea42fca2 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:00.262709 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64d592d-7b4f-413e-b486-485426d72fb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38ad49e1bda548ea8f1fc07c074035fc, user_id=71f09fcfc59e45b1b1f8901f648cdb5d, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:00.265561 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64d592d-7b4f-413e-b486-485426d72fb7 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:00.286565 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1113/2207] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:19:00 2022] PUT /identity/v3/projects/38ad49e1bda548ea8f1fc07c074035fc/users/71f09fcfc59e45b1b1f8901f648cdb5d/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:19:00.290868 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d592d-7b4f-413e-b486-485426d72fb7 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:00.294445 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1095/2208] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:19:00 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:19:00.295578 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3658228-4a27-473e-ad90-3d53ea42fca2 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:00.388365 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3658228-4a27-473e-ad90-3d53ea42fca2 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:00.393753 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452fc2ab-b240-4085-a4c8-c6e320c90f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:00.394968 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fc2ab-b240-4085-a4c8-c6e320c90f95 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:00.395252 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fc2ab-b240-4085-a4c8-c6e320c90f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:00.395552 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fc2ab-b240-4085-a4c8-c6e320c90f95 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:00.396231 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452fc2ab-b240-4085-a4c8-c6e320c90f95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:00.398202 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452fc2ab-b240-4085-a4c8-c6e320c90f95 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:00.402728 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d592d-7b4f-413e-b486-485426d72fb7 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:00.406976 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:00.408792 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629da5d-f4fd-4548-b482-49665cde11ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:00.409939 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629da5d-f4fd-4548-b482-49665cde11ef admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:00.410064 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629da5d-f4fd-4548-b482-49665cde11ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:00.410309 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629da5d-f4fd-4548-b482-49665cde11ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:00.411126 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629da5d-f4fd-4548-b482-49665cde11ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:00.412973 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629da5d-f4fd-4548-b482-49665cde11ef admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:00.430496 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1114/2209] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:19:00.432412 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629da5d-f4fd-4548-b482-49665cde11ef admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:00.442697 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1096/2210] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:19:00 2022] POST /identity/v3/users => generated 288 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:19:00.443638 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629da5d-f4fd-4548-b482-49665cde11ef admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:00.446623 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452fc2ab-b240-4085-a4c8-c6e320c90f95 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:00.459686 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8da15a-8bb9-43f6-822f-d04fb4839087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:00.460385 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8da15a-8bb9-43f6-822f-d04fb4839087 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:00.460601 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452fc2ab-b240-4085-a4c8-c6e320c90f95 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:00.460733 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8da15a-8bb9-43f6-822f-d04fb4839087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:00.461002 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8da15a-8bb9-43f6-822f-d04fb4839087 admin admin] PATH_INFO: `/v3/projects/38ad49e1bda548ea8f1fc07c074035fc/users/71f09fcfc59e45b1b1f8901f648cdb5d/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:00.467259 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8da15a-8bb9-43f6-822f-d04fb4839087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38ad49e1bda548ea8f1fc07c074035fc, user_id=71f09fcfc59e45b1b1f8901f648cdb5d, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:00.467511 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4ec92-251f-4092-837c-cec4583071d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:00.468430 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4ec92-251f-4092-837c-cec4583071d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:00.468882 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4ec92-251f-4092-837c-cec4583071d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:00.469244 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4ec92-251f-4092-837c-cec4583071d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:00.470060 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4ec92-251f-4092-837c-cec4583071d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:00.472552 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4ec92-251f-4092-837c-cec4583071d0 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:00.478185 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8da15a-8bb9-43f6-822f-d04fb4839087 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:00.486570 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1097/2211] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:19:00.491976 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4ec92-251f-4092-837c-cec4583071d0 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:00.503746 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1115/2212] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:19:00 2022] PUT /identity/v3/projects/38ad49e1bda548ea8f1fc07c074035fc/users/71f09fcfc59e45b1b1f8901f648cdb5d/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:19:00.511368 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4ec92-251f-4092-837c-cec4583071d0 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:00.587476 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079df681-6e24-4edc-8bcb-86113406cb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:00.588166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079df681-6e24-4edc-8bcb-86113406cb40 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:00.588466 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079df681-6e24-4edc-8bcb-86113406cb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:00.588790 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079df681-6e24-4edc-8bcb-86113406cb40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:00.589481 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079df681-6e24-4edc-8bcb-86113406cb40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:00.591291 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079df681-6e24-4edc-8bcb-86113406cb40 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:00.605818 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1098/2213] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:19:00.610237 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8da15a-8bb9-43f6-822f-d04fb4839087 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:00.626288 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8da15a-8bb9-43f6-822f-d04fb4839087 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:00.635968 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7dd2a-bae9-48a6-a2e7-cf855e7200ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:00.636695 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7dd2a-bae9-48a6-a2e7-cf855e7200ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:00.637016 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7dd2a-bae9-48a6-a2e7-cf855e7200ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:00.637264 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7dd2a-bae9-48a6-a2e7-cf855e7200ee admin admin] PATH_INFO: `/v3/projects/042713cbb86f49a2ba1e8dbb25278604/users/4e329b952aed44d581a4a29c6070b4dd/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:00.654971 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7dd2a-bae9-48a6-a2e7-cf855e7200ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=042713cbb86f49a2ba1e8dbb25278604, user_id=4e329b952aed44d581a4a29c6070b4dd, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:00.658017 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7dd2a-bae9-48a6-a2e7-cf855e7200ee admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:00.673478 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1116/2214] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:19:00 2022] PUT /identity/v3/projects/042713cbb86f49a2ba1e8dbb25278604/users/4e329b952aed44d581a4a29c6070b4dd/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:19:00.679931 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c15fe1-95e5-43b7-bc6d-adc230d88840 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:00.680231 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c15fe1-95e5-43b7-bc6d-adc230d88840 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:00.682851 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c15fe1-95e5-43b7-bc6d-adc230d88840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:00.740369 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-d7c15fe1-95e5-43b7-bc6d-adc230d88840 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:00.741950 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d7c15fe1-95e5-43b7-bc6d-adc230d88840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:00.855085 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1099/2215] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:19:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:00.857290 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a2442-8f12-439d-9d64-4cb00b1011d8 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:00.857844 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a2442-8f12-439d-9d64-4cb00b1011d8 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:00.857921 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a2442-8f12-439d-9d64-4cb00b1011d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:00.867829 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c15fe1-95e5-43b7-bc6d-adc230d88840 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:00.870003 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d7c15fe1-95e5-43b7-bc6d-adc230d88840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:00.904112 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-198a2442-8f12-439d-9d64-4cb00b1011d8 None None] MFA Rules not processed for user `31b795ee988d49b9bf9dbf283d1a2ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:00.906015 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-198a2442-8f12-439d-9d64-4cb00b1011d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:00.918617 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:00.962560 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c15fe1-95e5-43b7-bc6d-adc230d88840 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:00.967007 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee399ee-12e5-47fe-9624-3a148b9298fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:00.967737 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee399ee-12e5-47fe-9624-3a148b9298fe service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:00.967881 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee399ee-12e5-47fe-9624-3a148b9298fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:00.968141 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee399ee-12e5-47fe-9624-3a148b9298fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:00.992091 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee399ee-12e5-47fe-9624-3a148b9298fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:00.994392 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee399ee-12e5-47fe-9624-3a148b9298fe service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:01.006410 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1100/2216] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:19:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:19:01.032314 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1117/2217] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:19:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:19:01.274926 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee399ee-12e5-47fe-9624-3a148b9298fe service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:01.276477 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-dee399ee-12e5-47fe-9624-3a148b9298fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:01.291234 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee399ee-12e5-47fe-9624-3a148b9298fe service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:01.295895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa1decb-378a-4e5e-a399-1b13fcfbdc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:01.296518 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1decb-378a-4e5e-a399-1b13fcfbdc7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:01.296793 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1decb-378a-4e5e-a399-1b13fcfbdc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:01.297060 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1decb-378a-4e5e-a399-1b13fcfbdc7a admin admin] PATH_INFO: `/v3/users/aee8987c22dc44cebed6465ef9d36951` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:01.298223 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa1decb-378a-4e5e-a399-1b13fcfbdc7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=aee8987c22dc44cebed6465ef9d36951)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:01.301120 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa1decb-378a-4e5e-a399-1b13fcfbdc7a admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:01.315403 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:INSERT=3,keystone:SELECT=96,keystone:DELETE=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:01.360496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-2aa1decb-378a-4e5e-a399-1b13fcfbdc7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aee8987c22dc44cebed6465ef9d36951'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:01.361730 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-2aa1decb-378a-4e5e-a399-1b13fcfbdc7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aee8987c22dc44cebed6465ef9d36951'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:01.375367 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-2aa1decb-378a-4e5e-a399-1b13fcfbdc7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aee8987c22dc44cebed6465ef9d36951'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:01.382883 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-2aa1decb-378a-4e5e-a399-1b13fcfbdc7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aee8987c22dc44cebed6465ef9d36951'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:01.390899 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-2aa1decb-378a-4e5e-a399-1b13fcfbdc7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aee8987c22dc44cebed6465ef9d36951'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:01.397927 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1101/2218] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:19:01 2022] DELETE /identity/v3/users/aee8987c22dc44cebed6465ef9d36951 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:19:01.402772 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6865d1-8340-4a54-8d80-9c41ab2618e3 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:01.403069 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6865d1-8340-4a54-8d80-9c41ab2618e3 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:01.403366 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6865d1-8340-4a54-8d80-9c41ab2618e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:01.425484 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-bc6865d1-8340-4a54-8d80-9c41ab2618e3 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:01.426952 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-bc6865d1-8340-4a54-8d80-9c41ab2618e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:01.492972 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1118/2219] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:19:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:19:01.507994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa1decb-378a-4e5e-a399-1b13fcfbdc7a admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:01.509463 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-2aa1decb-378a-4e5e-a399-1b13fcfbdc7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:01.572447 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa1decb-378a-4e5e-a399-1b13fcfbdc7a admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:01.576480 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780489de-7bb2-4236-8c40-09b1c8ec95ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:01.577083 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780489de-7bb2-4236-8c40-09b1c8ec95ed service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:01.577357 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780489de-7bb2-4236-8c40-09b1c8ec95ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:01.577624 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780489de-7bb2-4236-8c40-09b1c8ec95ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:01.586767 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780489de-7bb2-4236-8c40-09b1c8ec95ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:01.588190 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780489de-7bb2-4236-8c40-09b1c8ec95ed service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:01.597820 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1102/2220] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:19:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:19:02.086041 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd4a72-453f-43ae-9016-483f2cd185f2 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:02.086560 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd4a72-453f-43ae-9016-483f2cd185f2 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:02.086663 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd4a72-453f-43ae-9016-483f2cd185f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:02.088796 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780489de-7bb2-4236-8c40-09b1c8ec95ed service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:02.091476 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-780489de-7bb2-4236-8c40-09b1c8ec95ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:02.109234 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780489de-7bb2-4236-8c40-09b1c8ec95ed service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:02.127206 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad2c62-8898-432c-82dd-34b215f23fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:02.127864 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad2c62-8898-432c-82dd-34b215f23fbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:02.128235 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad2c62-8898-432c-82dd-34b215f23fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:02.128515 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad2c62-8898-432c-82dd-34b215f23fbe admin admin] PATH_INFO: `/v3/projects/7b9c47a320b24faba71ef727756ef0c9` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:02.135373 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad2c62-8898-432c-82dd-34b215f23fbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b9c47a320b24faba71ef727756ef0c9)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:02.137799 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad2c62-8898-432c-82dd-34b215f23fbe admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:02.195740 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-41dd4a72-453f-43ae-9016-483f2cd185f2 None None] MFA Rules not processed for user `71f09fcfc59e45b1b1f8901f648cdb5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:02.197350 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-41dd4a72-453f-43ae-9016-483f2cd185f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:02.292826 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-98ad2c62-8898-432c-82dd-34b215f23fbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b9c47a320b24faba71ef727756ef0c9', 'request_id': 'req-98ad2c62-8898-432c-82dd-34b215f23fbe'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:02.301670 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-98ad2c62-8898-432c-82dd-34b215f23fbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b9c47a320b24faba71ef727756ef0c9', 'request_id': 'req-98ad2c62-8898-432c-82dd-34b215f23fbe'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:02.311411 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-98ad2c62-8898-432c-82dd-34b215f23fbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b9c47a320b24faba71ef727756ef0c9', 'request_id': 'req-98ad2c62-8898-432c-82dd-34b215f23fbe'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:02.345080 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-98ad2c62-8898-432c-82dd-34b215f23fbe admin admin] The token cache is being invalidate because project 7b9c47a320b24faba71ef727756ef0c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:19:02.345628 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-98ad2c62-8898-432c-82dd-34b215f23fbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:02.347266 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-98ad2c62-8898-432c-82dd-34b215f23fbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:02.351950 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1103/2221] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:19:02 2022] DELETE /identity/v3/projects/7b9c47a320b24faba71ef727756ef0c9 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:19:02.352990 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad2c62-8898-432c-82dd-34b215f23fbe admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:02.356824 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-98ad2c62-8898-432c-82dd-34b215f23fbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:02.386504 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1119/2222] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:19:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:02.395721 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192a694-526b-4879-ae67-a638bdd9fa5b None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:02.396316 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192a694-526b-4879-ae67-a638bdd9fa5b None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:02.397801 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192a694-526b-4879-ae67-a638bdd9fa5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:02.403622 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:02.452185 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-d192a694-526b-4879-ae67-a638bdd9fa5b None None] MFA Rules not processed for user `a0bfacd81a184a74adbb16c80e722f33`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:02.455419 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d192a694-526b-4879-ae67-a638bdd9fa5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:02.496471 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad2c62-8898-432c-82dd-34b215f23fbe admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:02.513811 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b02aa8-50b1-4342-a776-9a9273a031c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:02.515645 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b02aa8-50b1-4342-a776-9a9273a031c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:02.515934 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b02aa8-50b1-4342-a776-9a9273a031c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:02.516855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b02aa8-50b1-4342-a776-9a9273a031c5 admin admin] PATH_INFO: `/v3/users/91e3a70f8f3b4417be3083b83405fbc6` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:02.521318 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b02aa8-50b1-4342-a776-9a9273a031c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91e3a70f8f3b4417be3083b83405fbc6)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:02.528537 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b02aa8-50b1-4342-a776-9a9273a031c5 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:02.579255 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:02.623374 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1120/2223] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:19:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:02.647951 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192a694-526b-4879-ae67-a638bdd9fa5b None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:02.649619 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d192a694-526b-4879-ae67-a638bdd9fa5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:02.651251 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d8b02aa8-50b1-4342-a776-9a9273a031c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91e3a70f8f3b4417be3083b83405fbc6'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:02.653197 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d8b02aa8-50b1-4342-a776-9a9273a031c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91e3a70f8f3b4417be3083b83405fbc6'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:02.680456 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d8b02aa8-50b1-4342-a776-9a9273a031c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91e3a70f8f3b4417be3083b83405fbc6'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:02.688870 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d8b02aa8-50b1-4342-a776-9a9273a031c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91e3a70f8f3b4417be3083b83405fbc6'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:02.698386 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d8b02aa8-50b1-4342-a776-9a9273a031c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91e3a70f8f3b4417be3083b83405fbc6'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:02.707262 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1104/2224] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:19:02 2022] DELETE /identity/v3/users/91e3a70f8f3b4417be3083b83405fbc6 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:19:02.792623 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192a694-526b-4879-ae67-a638bdd9fa5b None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:02.894422 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77bbd5-dae7-492a-81c3-7499e602ae56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:02.895210 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77bbd5-dae7-492a-81c3-7499e602ae56 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:02.895607 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77bbd5-dae7-492a-81c3-7499e602ae56 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:02.895945 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77bbd5-dae7-492a-81c3-7499e602ae56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:02.898572 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2c77bbd5-dae7-492a-81c3-7499e602ae56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:03.006873 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77bbd5-dae7-492a-81c3-7499e602ae56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:03.009810 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77bbd5-dae7-492a-81c3-7499e602ae56 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:03.026520 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1121/2225] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:19:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:19:03.175994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b02aa8-50b1-4342-a776-9a9273a031c5 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:03.177706 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d8b02aa8-50b1-4342-a776-9a9273a031c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:03.318573 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b02aa8-50b1-4342-a776-9a9273a031c5 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:03.327114 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8adb1d-971d-47a1-a1e8-3df9e4344878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:03.327949 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8adb1d-971d-47a1-a1e8-3df9e4344878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:03.328137 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8adb1d-971d-47a1-a1e8-3df9e4344878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:03.331029 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8adb1d-971d-47a1-a1e8-3df9e4344878 admin admin] PATH_INFO: `/v3/projects/b16ad15746e74154a4382fd91ab394fd` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:03.333698 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8adb1d-971d-47a1-a1e8-3df9e4344878 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b16ad15746e74154a4382fd91ab394fd)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:03.336041 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8adb1d-971d-47a1-a1e8-3df9e4344878 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:03.444268 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:03.475154 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3b8adb1d-971d-47a1-a1e8-3df9e4344878 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b16ad15746e74154a4382fd91ab394fd', 'request_id': 'req-3b8adb1d-971d-47a1-a1e8-3df9e4344878'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:03.487808 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3b8adb1d-971d-47a1-a1e8-3df9e4344878 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b16ad15746e74154a4382fd91ab394fd', 'request_id': 'req-3b8adb1d-971d-47a1-a1e8-3df9e4344878'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:03.503419 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3b8adb1d-971d-47a1-a1e8-3df9e4344878 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b16ad15746e74154a4382fd91ab394fd', 'request_id': 'req-3b8adb1d-971d-47a1-a1e8-3df9e4344878'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:03.528164 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3b8adb1d-971d-47a1-a1e8-3df9e4344878 admin admin] The token cache is being invalidate because project b16ad15746e74154a4382fd91ab394fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:19:03.528459 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3b8adb1d-971d-47a1-a1e8-3df9e4344878 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:03.530576 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3b8adb1d-971d-47a1-a1e8-3df9e4344878 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:03.537767 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1105/2226] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:19:03 2022] DELETE /identity/v3/projects/b16ad15746e74154a4382fd91ab394fd => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:19:03.539544 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3a3ab-44ff-4026-a7f8-226864cbdc0d None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:03.540319 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3a3ab-44ff-4026-a7f8-226864cbdc0d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:03.540744 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3a3ab-44ff-4026-a7f8-226864cbdc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:03.574066 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-a6d3a3ab-44ff-4026-a7f8-226864cbdc0d None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:03.575697 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a6d3a3ab-44ff-4026-a7f8-226864cbdc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:03.599208 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:03.670911 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1122/2227] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:19:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:03.676814 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f0a65-a423-4337-ac77-2a258d74eb52 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:03.677461 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f0a65-a423-4337-ac77-2a258d74eb52 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:03.677461 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f0a65-a423-4337-ac77-2a258d74eb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:03.703791 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-b49f0a65-a423-4337-ac77-2a258d74eb52 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:03.706820 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-b49f0a65-a423-4337-ac77-2a258d74eb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:03.720990 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d3a3ab-44ff-4026-a7f8-226864cbdc0d None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:03.721634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1106/2228] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:19:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:03.738996 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d3a3ab-44ff-4026-a7f8-226864cbdc0d None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:03.746585 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28238a-2cc6-48be-9282-f02a446a0a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:03.747585 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28238a-2cc6-48be-9282-f02a446a0a6f admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:03.748346 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28238a-2cc6-48be-9282-f02a446a0a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:03.748871 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28238a-2cc6-48be-9282-f02a446a0a6f admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:03.749761 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28238a-2cc6-48be-9282-f02a446a0a6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:19:03.750277 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28238a-2cc6-48be-9282-f02a446a0a6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:03.752837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28238a-2cc6-48be-9282-f02a446a0a6f admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:03.778978 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1123/2229] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:19:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:19:03.784164 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f0a65-a423-4337-ac77-2a258d74eb52 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:03.796839 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f0a65-a423-4337-ac77-2a258d74eb52 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:03.805042 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f58ce-bfdc-4e38-8c13-33e8486b603d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:03.805714 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f58ce-bfdc-4e38-8c13-33e8486b603d admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:03.805995 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f58ce-bfdc-4e38-8c13-33e8486b603d admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:03.806390 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f58ce-bfdc-4e38-8c13-33e8486b603d admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:03.807245 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f58ce-bfdc-4e38-8c13-33e8486b603d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:03.809246 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f58ce-bfdc-4e38-8c13-33e8486b603d admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:03.872837 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1107/2230] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:19:03 2022] POST /identity/v3/projects => generated 373 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:19:03.878113 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28238a-2cc6-48be-9282-f02a446a0a6f admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:03.889851 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28238a-2cc6-48be-9282-f02a446a0a6f admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:04.070313 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82114338-a689-433d-99de-9744d7b38a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:04.071249 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82114338-a689-433d-99de-9744d7b38a10 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:04.071680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82114338-a689-433d-99de-9744d7b38a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:04.072114 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82114338-a689-433d-99de-9744d7b38a10 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:04.072907 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82114338-a689-433d-99de-9744d7b38a10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:04.075082 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82114338-a689-433d-99de-9744d7b38a10 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:04.157115 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1124/2231] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:19:03 2022] POST /identity/v3/users => generated 287 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:19:04.160629 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f58ce-bfdc-4e38-8c13-33e8486b603d admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:04.176732 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f58ce-bfdc-4e38-8c13-33e8486b603d admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:04.188216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c8f2d-d3f6-4dd9-817d-ebf6dee40a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:04.189693 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c8f2d-d3f6-4dd9-817d-ebf6dee40a93 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:04.192291 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c8f2d-d3f6-4dd9-817d-ebf6dee40a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:04.192589 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c8f2d-d3f6-4dd9-817d-ebf6dee40a93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:04.193329 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c8f2d-d3f6-4dd9-817d-ebf6dee40a93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:04.195098 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c8f2d-d3f6-4dd9-817d-ebf6dee40a93 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:04.235615 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82114338-a689-433d-99de-9744d7b38a10 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:04.236942 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1108/2232] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:19:04.257658 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82114338-a689-433d-99de-9744d7b38a10 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:04.275591 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdaffe3-7f25-4db9-b909-10ee26f49612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:04.276855 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdaffe3-7f25-4db9-b909-10ee26f49612 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:04.277277 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdaffe3-7f25-4db9-b909-10ee26f49612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:04.277689 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdaffe3-7f25-4db9-b909-10ee26f49612 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:04.278534 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdaffe3-7f25-4db9-b909-10ee26f49612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:04.283745 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdaffe3-7f25-4db9-b909-10ee26f49612 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:04.312996 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1125/2233] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:19:04.318632 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c8f2d-d3f6-4dd9-817d-ebf6dee40a93 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:04.338333 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c8f2d-d3f6-4dd9-817d-ebf6dee40a93 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:04.355990 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5aed88-7506-4464-9abd-5d2c42242aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:04.356950 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5aed88-7506-4464-9abd-5d2c42242aaa admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:04.357331 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5aed88-7506-4464-9abd-5d2c42242aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:04.357703 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5aed88-7506-4464-9abd-5d2c42242aaa admin admin] PATH_INFO: `/v3/projects/aa789ab1f8ad4cbd9c2655882a190673/users/24121eca1b134d538d354e576a6276ba/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:04.396314 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5aed88-7506-4464-9abd-5d2c42242aaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa789ab1f8ad4cbd9c2655882a190673, user_id=24121eca1b134d538d354e576a6276ba, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:04.399529 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5aed88-7506-4464-9abd-5d2c42242aaa admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:04.448486 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1109/2234] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:19:04 2022] PUT /identity/v3/projects/aa789ab1f8ad4cbd9c2655882a190673/users/24121eca1b134d538d354e576a6276ba/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:19:04.461961 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0cab17-db55-48b5-9af7-d78062dac263 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:04.462549 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0cab17-db55-48b5-9af7-d78062dac263 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:04.462549 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0cab17-db55-48b5-9af7-d78062dac263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:04.506710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-7a0cab17-db55-48b5-9af7-d78062dac263 None None] MFA Rules not processed for user `24121eca1b134d538d354e576a6276ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:04.508278 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7a0cab17-db55-48b5-9af7-d78062dac263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:04.688395 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1126/2235] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:19:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:04.691555 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5aed88-7506-4464-9abd-5d2c42242aaa admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:04.852321 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5aed88-7506-4464-9abd-5d2c42242aaa admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:04.866024 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ba5a8-07dd-4bc1-b7d2-12eddabd3a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:04.866814 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ba5a8-07dd-4bc1-b7d2-12eddabd3a79 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:04.867172 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ba5a8-07dd-4bc1-b7d2-12eddabd3a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:04.867515 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ba5a8-07dd-4bc1-b7d2-12eddabd3a79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:04.869744 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ba5a8-07dd-4bc1-b7d2-12eddabd3a79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:04.891325 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ba5a8-07dd-4bc1-b7d2-12eddabd3a79 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:04.949104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1110/2236] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:19:04 2022] POST /identity/v3/projects => generated 375 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:19:04.949966 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0cab17-db55-48b5-9af7-d78062dac263 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:04.969503 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0cab17-db55-48b5-9af7-d78062dac263 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:05.017789 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:05.192216 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed0946-56ea-45bb-9cc3-ecc89fddf78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:05.192945 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed0946-56ea-45bb-9cc3-ecc89fddf78e admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:05.193157 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed0946-56ea-45bb-9cc3-ecc89fddf78e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:05.193435 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed0946-56ea-45bb-9cc3-ecc89fddf78e admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:05.194101 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed0946-56ea-45bb-9cc3-ecc89fddf78e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:05.196020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed0946-56ea-45bb-9cc3-ecc89fddf78e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:05.240922 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ba5a8-07dd-4bc1-b7d2-12eddabd3a79 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:05.257451 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ba5a8-07dd-4bc1-b7d2-12eddabd3a79 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:05.257618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1127/2237] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:19:04 2022] POST /identity/v3/users => generated 288 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:19:05.265252 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc02151-c288-4321-b2ea-04d9396d1967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:05.265949 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc02151-c288-4321-b2ea-04d9396d1967 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:05.266543 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc02151-c288-4321-b2ea-04d9396d1967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:05.267155 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc02151-c288-4321-b2ea-04d9396d1967 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:05.272254 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc02151-c288-4321-b2ea-04d9396d1967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:05.274970 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc02151-c288-4321-b2ea-04d9396d1967 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:05.291997 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed0946-56ea-45bb-9cc3-ecc89fddf78e admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:05.294691 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1111/2238] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:19:05.313482 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed0946-56ea-45bb-9cc3-ecc89fddf78e admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:05.321711 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981decd-171b-4680-9d0c-8b8dc224fb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:05.322705 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981decd-171b-4680-9d0c-8b8dc224fb6e admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:05.323167 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981decd-171b-4680-9d0c-8b8dc224fb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:05.323642 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981decd-171b-4680-9d0c-8b8dc224fb6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:05.324518 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7981decd-171b-4680-9d0c-8b8dc224fb6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:05.326320 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7981decd-171b-4680-9d0c-8b8dc224fb6e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:05.356137 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc02151-c288-4321-b2ea-04d9396d1967 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:05.365830 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1128/2239] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:19:05.381831 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc02151-c288-4321-b2ea-04d9396d1967 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:05.393032 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75dfc84-efc5-43ed-8e11-19456713ee4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:05.395348 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75dfc84-efc5-43ed-8e11-19456713ee4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:05.395661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75dfc84-efc5-43ed-8e11-19456713ee4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:05.395945 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75dfc84-efc5-43ed-8e11-19456713ee4e admin admin] PATH_INFO: `/v3/projects/1d854792f8dd48e4aac268c69f46daaf/users/9704642d5b8547df8c508c344d881c77/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:05.431405 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75dfc84-efc5-43ed-8e11-19456713ee4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d854792f8dd48e4aac268c69f46daaf, user_id=9704642d5b8547df8c508c344d881c77, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:05.440417 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75dfc84-efc5-43ed-8e11-19456713ee4e admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:05.515575 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1112/2240] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:19:05 2022] PUT /identity/v3/projects/1d854792f8dd48e4aac268c69f46daaf/users/9704642d5b8547df8c508c344d881c77/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:19:05.520256 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976bc4a-f2a6-4406-9456-868649b16cc3 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:05.523047 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976bc4a-f2a6-4406-9456-868649b16cc3 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:05.524390 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976bc4a-f2a6-4406-9456-868649b16cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:05.568781 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-d976bc4a-f2a6-4406-9456-868649b16cc3 None None] MFA Rules not processed for user `9704642d5b8547df8c508c344d881c77`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:05.570827 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d976bc4a-f2a6-4406-9456-868649b16cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:05.675624 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1129/2241] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:19:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:05.676835 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75dfc84-efc5-43ed-8e11-19456713ee4e admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:05.695698 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:05.797536 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75dfc84-efc5-43ed-8e11-19456713ee4e admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:05.821888 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70b320-f999-47dd-bc9c-346c9c71c0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:05.822552 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70b320-f999-47dd-bc9c-346c9c71c0c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:05.822846 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70b320-f999-47dd-bc9c-346c9c71c0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:05.824000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70b320-f999-47dd-bc9c-346c9c71c0c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:05.824000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d70b320-f999-47dd-bc9c-346c9c71c0c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:05.825717 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d70b320-f999-47dd-bc9c-346c9c71c0c9 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:05.911949 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1113/2242] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:19:05 2022] POST /identity/v3/projects => generated 375 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:19:05.915757 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976bc4a-f2a6-4406-9456-868649b16cc3 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:05.931720 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976bc4a-f2a6-4406-9456-868649b16cc3 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:06.004295 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ead92-260b-4ec4-a507-0483cd80d88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:06.004295 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ead92-260b-4ec4-a507-0483cd80d88f admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:06.004715 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ead92-260b-4ec4-a507-0483cd80d88f admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:06.004914 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ead92-260b-4ec4-a507-0483cd80d88f admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:06.005502 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ead92-260b-4ec4-a507-0483cd80d88f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:06.007495 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ead92-260b-4ec4-a507-0483cd80d88f admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:06.044441 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1130/2243] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:19:05 2022] POST /identity/v3/users => generated 294 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:19:06.045804 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70b320-f999-47dd-bc9c-346c9c71c0c9 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:06.088697 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70b320-f999-47dd-bc9c-346c9c71c0c9 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:06.113088 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f22b3-53e7-4eb1-a8eb-03cb36cb1d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:06.113716 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f22b3-53e7-4eb1-a8eb-03cb36cb1d49 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:06.114004 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f22b3-53e7-4eb1-a8eb-03cb36cb1d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:06.114266 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f22b3-53e7-4eb1-a8eb-03cb36cb1d49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:06.114946 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f22b3-53e7-4eb1-a8eb-03cb36cb1d49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:06.116553 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f22b3-53e7-4eb1-a8eb-03cb36cb1d49 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:06.167252 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1114/2244] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:19:06.168652 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ead92-260b-4ec4-a507-0483cd80d88f admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:06.185500 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ead92-260b-4ec4-a507-0483cd80d88f admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:06.198960 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf4d8a-64ab-44ba-94b0-17b3460eb473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:06.199715 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf4d8a-64ab-44ba-94b0-17b3460eb473 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:06.200085 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf4d8a-64ab-44ba-94b0-17b3460eb473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:06.208885 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf4d8a-64ab-44ba-94b0-17b3460eb473 admin admin] PATH_INFO: `/v3/projects/798b5b3b8e924183bea7418a439ca108/users/d735cf4457c6453e812add7b85a1fcf0/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:06.260751 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:06.273666 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf4d8a-64ab-44ba-94b0-17b3460eb473 admin admin] RBAC: Authorizing `identity:create_grant(project_id=798b5b3b8e924183bea7418a439ca108, user_id=d735cf4457c6453e812add7b85a1fcf0, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:06.277064 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf4d8a-64ab-44ba-94b0-17b3460eb473 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:06.325879 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f22b3-53e7-4eb1-a8eb-03cb36cb1d49 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:06.326760 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1131/2245] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:19:06 2022] PUT /identity/v3/projects/798b5b3b8e924183bea7418a439ca108/users/d735cf4457c6453e812add7b85a1fcf0/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:19:06.374843 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f22b3-53e7-4eb1-a8eb-03cb36cb1d49 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:06.533777 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124574a-fbbe-49f2-8b63-dd09d3ec5bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:06.534409 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124574a-fbbe-49f2-8b63-dd09d3ec5bdd admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:06.534743 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124574a-fbbe-49f2-8b63-dd09d3ec5bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:06.536044 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124574a-fbbe-49f2-8b63-dd09d3ec5bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:06.537089 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5124574a-fbbe-49f2-8b63-dd09d3ec5bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:06.539830 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5124574a-fbbe-49f2-8b63-dd09d3ec5bdd admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:06.558239 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1115/2246] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:19:06.559446 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf4d8a-64ab-44ba-94b0-17b3460eb473 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:06.573222 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf4d8a-64ab-44ba-94b0-17b3460eb473 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:06.579036 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db405aaa-e0b5-46cd-8b4b-6ce66ab645b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:06.580839 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db405aaa-e0b5-46cd-8b4b-6ce66ab645b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:06.581330 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db405aaa-e0b5-46cd-8b4b-6ce66ab645b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:06.581800 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db405aaa-e0b5-46cd-8b4b-6ce66ab645b3 admin admin] PATH_INFO: `/v3/projects/798b5b3b8e924183bea7418a439ca108/users/d735cf4457c6453e812add7b85a1fcf0/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:06.588897 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db405aaa-e0b5-46cd-8b4b-6ce66ab645b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=798b5b3b8e924183bea7418a439ca108, user_id=d735cf4457c6453e812add7b85a1fcf0, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:06.591652 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db405aaa-e0b5-46cd-8b4b-6ce66ab645b3 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:06.630171 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1132/2247] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:19:06 2022] PUT /identity/v3/projects/798b5b3b8e924183bea7418a439ca108/users/d735cf4457c6453e812add7b85a1fcf0/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:19:06.634043 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafae390-237d-40ac-ac0f-76a2754e1798 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:06.634330 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafae390-237d-40ac-ac0f-76a2754e1798 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:06.634640 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafae390-237d-40ac-ac0f-76a2754e1798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:06.716526 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-bafae390-237d-40ac-ac0f-76a2754e1798 None None] MFA Rules not processed for user `d735cf4457c6453e812add7b85a1fcf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:06.718664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-bafae390-237d-40ac-ac0f-76a2754e1798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:06.875311 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1116/2248] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:19:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:06.971150 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db405aaa-e0b5-46cd-8b4b-6ce66ab645b3 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:06.980619 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-db405aaa-e0b5-46cd-8b4b-6ce66ab645b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:07.140366 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db405aaa-e0b5-46cd-8b4b-6ce66ab645b3 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:07.153579 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5de3c-a84e-415b-aec5-e029e9388fe4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:07.153732 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5de3c-a84e-415b-aec5-e029e9388fe4 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:07.153913 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5de3c-a84e-415b-aec5-e029e9388fe4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:07.154188 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5de3c-a84e-415b-aec5-e029e9388fe4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:07.271788 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d5de3c-a84e-415b-aec5-e029e9388fe4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:07.273079 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d5de3c-a84e-415b-aec5-e029e9388fe4 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:07.295923 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1133/2249] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:19:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:19:09.291967 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafae390-237d-40ac-ac0f-76a2754e1798 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:09.303359 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafae390-237d-40ac-ac0f-76a2754e1798 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:09.307300 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd84b6-3b29-40e2-be19-a3f5fc1dc1b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:09.308231 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd84b6-3b29-40e2-be19-a3f5fc1dc1b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:09.308525 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd84b6-3b29-40e2-be19-a3f5fc1dc1b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:09.308799 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd84b6-3b29-40e2-be19-a3f5fc1dc1b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:09.318345 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:09.426741 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd84b6-3b29-40e2-be19-a3f5fc1dc1b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:09.428224 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd84b6-3b29-40e2-be19-a3f5fc1dc1b8 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:09.446914 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1117/2250] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:19:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:19:10.013490 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21af74c-6220-4615-a7dd-b14432e237c9 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:10.014334 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21af74c-6220-4615-a7dd-b14432e237c9 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:10.014861 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21af74c-6220-4615-a7dd-b14432e237c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:10.065370 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-f21af74c-6220-4615-a7dd-b14432e237c9 None None] MFA Rules not processed for user `4e329b952aed44d581a4a29c6070b4dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:10.066806 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f21af74c-6220-4615-a7dd-b14432e237c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:10.179949 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1134/2251] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:19:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:10.258008 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd84b6-3b29-40e2-be19-a3f5fc1dc1b8 service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:10.260113 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-90fd84b6-3b29-40e2-be19-a3f5fc1dc1b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:10.277505 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd84b6-3b29-40e2-be19-a3f5fc1dc1b8 service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:10.283230 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912b105-875e-4a82-b6fa-6c450ac6f4f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:10.284102 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912b105-875e-4a82-b6fa-6c450ac6f4f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:10.284353 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912b105-875e-4a82-b6fa-6c450ac6f4f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:10.284631 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912b105-875e-4a82-b6fa-6c450ac6f4f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:10.306325 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912b105-875e-4a82-b6fa-6c450ac6f4f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:10.307827 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912b105-875e-4a82-b6fa-6c450ac6f4f0 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:10.325319 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1118/2252] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:19:10 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:19:10.328091 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21af74c-6220-4615-a7dd-b14432e237c9 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:10.331095 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f21af74c-6220-4615-a7dd-b14432e237c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:10.368517 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:10.479237 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21af74c-6220-4615-a7dd-b14432e237c9 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:10.494830 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9acac-a499-4204-9ecc-198fce6564fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:10.494830 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9acac-a499-4204-9ecc-198fce6564fe service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:10.494830 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9acac-a499-4204-9ecc-198fce6564fe service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:10.494830 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9acac-a499-4204-9ecc-198fce6564fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:10.512986 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d9acac-a499-4204-9ecc-198fce6564fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:10.519168 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d9acac-a499-4204-9ecc-198fce6564fe service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:10.556918 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1135/2253] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:19:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:19:12.286820 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912b105-875e-4a82-b6fa-6c450ac6f4f0 service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:12.288652 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-c912b105-875e-4a82-b6fa-6c450ac6f4f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:12.414824 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912b105-875e-4a82-b6fa-6c450ac6f4f0 service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:12.425348 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0013e-6730-4160-b190-634450aba084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:12.426062 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0013e-6730-4160-b190-634450aba084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:12.426376 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0013e-6730-4160-b190-634450aba084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:12.426642 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0013e-6730-4160-b190-634450aba084 admin admin] PATH_INFO: `/v3/users/fb27620f7d66408e993a111ff2df829a` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:12.430313 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0013e-6730-4160-b190-634450aba084 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb27620f7d66408e993a111ff2df829a)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:12.432809 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0013e-6730-4160-b190-634450aba084 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:12.560259 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d0c0013e-6730-4160-b190-634450aba084 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb27620f7d66408e993a111ff2df829a'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:12.561205 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d0c0013e-6730-4160-b190-634450aba084 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb27620f7d66408e993a111ff2df829a'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:12.584252 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d0c0013e-6730-4160-b190-634450aba084 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb27620f7d66408e993a111ff2df829a'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:12.593737 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d0c0013e-6730-4160-b190-634450aba084 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb27620f7d66408e993a111ff2df829a'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:12.611175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d0c0013e-6730-4160-b190-634450aba084 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb27620f7d66408e993a111ff2df829a'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:12.634746 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1119/2254] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:19:12 2022] DELETE /identity/v3/users/fb27620f7d66408e993a111ff2df829a => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:19:12.639249 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333e8b0-3991-4815-96c4-5e9c790afb25 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:12.640075 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333e8b0-3991-4815-96c4-5e9c790afb25 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:12.640522 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333e8b0-3991-4815-96c4-5e9c790afb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:12.680851 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-3333e8b0-3991-4815-96c4-5e9c790afb25 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:12.682084 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3333e8b0-3991-4815-96c4-5e9c790afb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:12.941351 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1136/2255] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:19:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:12.963019 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0013e-6730-4160-b190-634450aba084 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:12.964944 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d0c0013e-6730-4160-b190-634450aba084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:13.000357 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:13.141234 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0013e-6730-4160-b190-634450aba084 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:13.156775 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc995e-4b54-42a0-9a15-9ee58a1f86d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:13.157398 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc995e-4b54-42a0-9a15-9ee58a1f86d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:13.157684 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc995e-4b54-42a0-9a15-9ee58a1f86d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:13.158206 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc995e-4b54-42a0-9a15-9ee58a1f86d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:13.177259 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc995e-4b54-42a0-9a15-9ee58a1f86d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:13.184656 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc995e-4b54-42a0-9a15-9ee58a1f86d6 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:13.209752 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1120/2256] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:19:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:19:13.356265 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7fc99-4385-45cd-8647-b513b1f6959e None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:13.356841 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7fc99-4385-45cd-8647-b513b1f6959e None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:13.358179 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7fc99-4385-45cd-8647-b513b1f6959e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:13.400964 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-42c7fc99-4385-45cd-8647-b513b1f6959e None None] MFA Rules not processed for user `4e329b952aed44d581a4a29c6070b4dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:13.402628 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-42c7fc99-4385-45cd-8647-b513b1f6959e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:13.569268 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1137/2257] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:19:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:13.651067 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc995e-4b54-42a0-9a15-9ee58a1f86d6 service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:13.657227 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d0fc995e-4b54-42a0-9a15-9ee58a1f86d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:13.709923 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc995e-4b54-42a0-9a15-9ee58a1f86d6 service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:13.733223 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10c646-ed36-4537-b083-9c83c0770bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:13.733927 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10c646-ed36-4537-b083-9c83c0770bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:13.734211 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10c646-ed36-4537-b083-9c83c0770bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:13.734523 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10c646-ed36-4537-b083-9c83c0770bd1 admin admin] PATH_INFO: `/v3/projects/d7c39dca7aab471382e7db75a33b1b19` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:13.738790 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10c646-ed36-4537-b083-9c83c0770bd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7c39dca7aab471382e7db75a33b1b19)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:13.744262 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10c646-ed36-4537-b083-9c83c0770bd1 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:13.931756 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-9c10c646-ed36-4537-b083-9c83c0770bd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7c39dca7aab471382e7db75a33b1b19', 'request_id': 'req-9c10c646-ed36-4537-b083-9c83c0770bd1'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:13.941734 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-9c10c646-ed36-4537-b083-9c83c0770bd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7c39dca7aab471382e7db75a33b1b19', 'request_id': 'req-9c10c646-ed36-4537-b083-9c83c0770bd1'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:13.951184 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-9c10c646-ed36-4537-b083-9c83c0770bd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7c39dca7aab471382e7db75a33b1b19', 'request_id': 'req-9c10c646-ed36-4537-b083-9c83c0770bd1'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:13.979240 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-9c10c646-ed36-4537-b083-9c83c0770bd1 admin admin] The token cache is being invalidate because project d7c39dca7aab471382e7db75a33b1b19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:19:13.979639 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-9c10c646-ed36-4537-b083-9c83c0770bd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:13.981205 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-9c10c646-ed36-4537-b083-9c83c0770bd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:13.985009 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1121/2258] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:19:13 2022] DELETE /identity/v3/projects/d7c39dca7aab471382e7db75a33b1b19 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:19:15.184893 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7fc99-4385-45cd-8647-b513b1f6959e None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:15.191508 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-42c7fc99-4385-45cd-8647-b513b1f6959e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:15.209783 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7fc99-4385-45cd-8647-b513b1f6959e None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:15.277113 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:15.288246 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489de1f-a0d4-4777-b1ff-34e23ef8316c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:15.289294 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489de1f-a0d4-4777-b1ff-34e23ef8316c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:15.289587 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489de1f-a0d4-4777-b1ff-34e23ef8316c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:15.289866 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489de1f-a0d4-4777-b1ff-34e23ef8316c admin admin] PATH_INFO: `/v3/users/24121eca1b134d538d354e576a6276ba` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:15.291279 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1489de1f-a0d4-4777-b1ff-34e23ef8316c admin admin] RBAC: Authorizing `identity:delete_user(user_id=24121eca1b134d538d354e576a6276ba)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:15.293506 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1489de1f-a0d4-4777-b1ff-34e23ef8316c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:15.344695 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1489de1f-a0d4-4777-b1ff-34e23ef8316c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24121eca1b134d538d354e576a6276ba'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:15.354058 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1489de1f-a0d4-4777-b1ff-34e23ef8316c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24121eca1b134d538d354e576a6276ba'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:15.361085 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1489de1f-a0d4-4777-b1ff-34e23ef8316c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24121eca1b134d538d354e576a6276ba'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:15.372727 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1489de1f-a0d4-4777-b1ff-34e23ef8316c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24121eca1b134d538d354e576a6276ba'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:15.373368 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1489de1f-a0d4-4777-b1ff-34e23ef8316c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24121eca1b134d538d354e576a6276ba'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:15.379655 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1138/2259] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:19:15 2022] DELETE /identity/v3/users/24121eca1b134d538d354e576a6276ba => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:19:15.384382 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907e2cc-e6e3-4d70-ac56-1eddd71a5ca5 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:15.384977 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907e2cc-e6e3-4d70-ac56-1eddd71a5ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:15.384977 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907e2cc-e6e3-4d70-ac56-1eddd71a5ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:15.404542 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-5907e2cc-e6e3-4d70-ac56-1eddd71a5ca5 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:15.406020 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-5907e2cc-e6e3-4d70-ac56-1eddd71a5ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:15.468288 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1122/2260] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:19:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:15.478471 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489de1f-a0d4-4777-b1ff-34e23ef8316c admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:15.479893 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1489de1f-a0d4-4777-b1ff-34e23ef8316c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:15.539822 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489de1f-a0d4-4777-b1ff-34e23ef8316c admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:15.543549 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb6918-91bd-4311-9869-b837314fe68c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:15.544159 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb6918-91bd-4311-9869-b837314fe68c service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:15.544439 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb6918-91bd-4311-9869-b837314fe68c service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:15.544712 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb6918-91bd-4311-9869-b837314fe68c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:15.553918 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb6918-91bd-4311-9869-b837314fe68c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:15.555447 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb6918-91bd-4311-9869-b837314fe68c service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:15.565419 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1139/2261] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:19:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:19:16.008126 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907e2cc-e6e3-4d70-ac56-1eddd71a5ca5 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:16.011928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-5907e2cc-e6e3-4d70-ac56-1eddd71a5ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:16.038115 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907e2cc-e6e3-4d70-ac56-1eddd71a5ca5 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:16.046523 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009bd63a-cdd8-450a-8696-8e7ee88986dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:16.047270 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009bd63a-cdd8-450a-8696-8e7ee88986dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:16.047711 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009bd63a-cdd8-450a-8696-8e7ee88986dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:16.048530 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009bd63a-cdd8-450a-8696-8e7ee88986dd admin admin] PATH_INFO: `/v3/projects/aa789ab1f8ad4cbd9c2655882a190673` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:16.049665 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009bd63a-cdd8-450a-8696-8e7ee88986dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa789ab1f8ad4cbd9c2655882a190673)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:16.051788 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009bd63a-cdd8-450a-8696-8e7ee88986dd admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:16.094082 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:16.113284 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-009bd63a-cdd8-450a-8696-8e7ee88986dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa789ab1f8ad4cbd9c2655882a190673', 'request_id': 'req-009bd63a-cdd8-450a-8696-8e7ee88986dd'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:16.119522 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-009bd63a-cdd8-450a-8696-8e7ee88986dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa789ab1f8ad4cbd9c2655882a190673', 'request_id': 'req-009bd63a-cdd8-450a-8696-8e7ee88986dd'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:16.130101 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-009bd63a-cdd8-450a-8696-8e7ee88986dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa789ab1f8ad4cbd9c2655882a190673', 'request_id': 'req-009bd63a-cdd8-450a-8696-8e7ee88986dd'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:16.146627 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-009bd63a-cdd8-450a-8696-8e7ee88986dd admin admin] The token cache is being invalidate because project aa789ab1f8ad4cbd9c2655882a190673 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:19:16.146989 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-009bd63a-cdd8-450a-8696-8e7ee88986dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:16.147692 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-009bd63a-cdd8-450a-8696-8e7ee88986dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:16.149424 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1123/2262] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:19:16 2022] DELETE /identity/v3/projects/aa789ab1f8ad4cbd9c2655882a190673 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:19:16.153800 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb6918-91bd-4311-9869-b837314fe68c service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:16.165569 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb6918-91bd-4311-9869-b837314fe68c service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:16.242587 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c9ee6-84ff-4b6c-ae19-16892b60cbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:16.247231 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c9ee6-84ff-4b6c-ae19-16892b60cbf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:16.247589 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c9ee6-84ff-4b6c-ae19-16892b60cbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:16.247940 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c9ee6-84ff-4b6c-ae19-16892b60cbf5 admin admin] PATH_INFO: `/v3/users/9704642d5b8547df8c508c344d881c77` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:16.249197 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c9ee6-84ff-4b6c-ae19-16892b60cbf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9704642d5b8547df8c508c344d881c77)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:16.251971 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c9ee6-84ff-4b6c-ae19-16892b60cbf5 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:16.283111 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:16.325384 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-710c9ee6-84ff-4b6c-ae19-16892b60cbf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9704642d5b8547df8c508c344d881c77'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:16.336376 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-710c9ee6-84ff-4b6c-ae19-16892b60cbf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9704642d5b8547df8c508c344d881c77'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:16.344580 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-710c9ee6-84ff-4b6c-ae19-16892b60cbf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9704642d5b8547df8c508c344d881c77'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:16.365388 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-710c9ee6-84ff-4b6c-ae19-16892b60cbf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9704642d5b8547df8c508c344d881c77'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:16.366160 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-710c9ee6-84ff-4b6c-ae19-16892b60cbf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9704642d5b8547df8c508c344d881c77'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:16.372686 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1140/2263] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:19:16 2022] DELETE /identity/v3/users/9704642d5b8547df8c508c344d881c77 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:19:16.686179 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009bd63a-cdd8-450a-8696-8e7ee88986dd admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:16.687636 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-009bd63a-cdd8-450a-8696-8e7ee88986dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:16.701134 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009bd63a-cdd8-450a-8696-8e7ee88986dd admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:16.760797 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a44c8-072b-4d86-83be-3009dba94eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:16.761432 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a44c8-072b-4d86-83be-3009dba94eab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:16.761703 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a44c8-072b-4d86-83be-3009dba94eab admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:16.761970 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a44c8-072b-4d86-83be-3009dba94eab admin admin] PATH_INFO: `/v3/projects/1d854792f8dd48e4aac268c69f46daaf` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:16.763229 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a44c8-072b-4d86-83be-3009dba94eab admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d854792f8dd48e4aac268c69f46daaf)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:16.765220 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a44c8-072b-4d86-83be-3009dba94eab admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:16.814899 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-fb8a44c8-072b-4d86-83be-3009dba94eab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d854792f8dd48e4aac268c69f46daaf', 'request_id': 'req-fb8a44c8-072b-4d86-83be-3009dba94eab'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:16.822232 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-fb8a44c8-072b-4d86-83be-3009dba94eab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d854792f8dd48e4aac268c69f46daaf', 'request_id': 'req-fb8a44c8-072b-4d86-83be-3009dba94eab'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:16.828537 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-fb8a44c8-072b-4d86-83be-3009dba94eab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d854792f8dd48e4aac268c69f46daaf', 'request_id': 'req-fb8a44c8-072b-4d86-83be-3009dba94eab'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:16.841661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-fb8a44c8-072b-4d86-83be-3009dba94eab admin admin] The token cache is being invalidate because project 1d854792f8dd48e4aac268c69f46daaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:19:16.841953 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-fb8a44c8-072b-4d86-83be-3009dba94eab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:16.842614 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-fb8a44c8-072b-4d86-83be-3009dba94eab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:16.844118 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1124/2264] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:19:16 2022] DELETE /identity/v3/projects/1d854792f8dd48e4aac268c69f46daaf => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:19:16.848917 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c9ee6-84ff-4b6c-ae19-16892b60cbf5 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:16.850322 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-710c9ee6-84ff-4b6c-ae19-16892b60cbf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:16.865902 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c9ee6-84ff-4b6c-ae19-16892b60cbf5 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:16.930442 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cab863-683e-4e52-9c99-6fa8f16091e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:16.931167 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cab863-683e-4e52-9c99-6fa8f16091e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:16.931448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cab863-683e-4e52-9c99-6fa8f16091e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:16.932065 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cab863-683e-4e52-9c99-6fa8f16091e3 admin admin] PATH_INFO: `/v3/users/d735cf4457c6453e812add7b85a1fcf0` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:16.932902 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cab863-683e-4e52-9c99-6fa8f16091e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d735cf4457c6453e812add7b85a1fcf0)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:16.934899 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cab863-683e-4e52-9c99-6fa8f16091e3 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:17.013401 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-88cab863-683e-4e52-9c99-6fa8f16091e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd735cf4457c6453e812add7b85a1fcf0'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:17.024114 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-88cab863-683e-4e52-9c99-6fa8f16091e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd735cf4457c6453e812add7b85a1fcf0'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:17.035406 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-88cab863-683e-4e52-9c99-6fa8f16091e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd735cf4457c6453e812add7b85a1fcf0'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:17.049773 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-88cab863-683e-4e52-9c99-6fa8f16091e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd735cf4457c6453e812add7b85a1fcf0'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:17.050616 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-88cab863-683e-4e52-9c99-6fa8f16091e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd735cf4457c6453e812add7b85a1fcf0'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:17.056619 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1141/2265] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:19:16 2022] DELETE /identity/v3/users/d735cf4457c6453e812add7b85a1fcf0 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:19:17.417062 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a44c8-072b-4d86-83be-3009dba94eab admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:17.418407 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-fb8a44c8-072b-4d86-83be-3009dba94eab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:17.446195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a44c8-072b-4d86-83be-3009dba94eab admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:17.498670 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:17.511114 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7d01e-3d21-47dd-b709-59c79354ab39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:17.511837 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7d01e-3d21-47dd-b709-59c79354ab39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:17.512249 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7d01e-3d21-47dd-b709-59c79354ab39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:17.512533 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7d01e-3d21-47dd-b709-59c79354ab39 admin admin] PATH_INFO: `/v3/projects/798b5b3b8e924183bea7418a439ca108` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:17.519071 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd7d01e-3d21-47dd-b709-59c79354ab39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=798b5b3b8e924183bea7418a439ca108)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:17.521061 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd7d01e-3d21-47dd-b709-59c79354ab39 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:17.576621 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cbd7d01e-3d21-47dd-b709-59c79354ab39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '798b5b3b8e924183bea7418a439ca108', 'request_id': 'req-cbd7d01e-3d21-47dd-b709-59c79354ab39'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:17.583007 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cbd7d01e-3d21-47dd-b709-59c79354ab39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '798b5b3b8e924183bea7418a439ca108', 'request_id': 'req-cbd7d01e-3d21-47dd-b709-59c79354ab39'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:17.589448 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cbd7d01e-3d21-47dd-b709-59c79354ab39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '798b5b3b8e924183bea7418a439ca108', 'request_id': 'req-cbd7d01e-3d21-47dd-b709-59c79354ab39'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:17.602182 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cbd7d01e-3d21-47dd-b709-59c79354ab39 admin admin] The token cache is being invalidate because project 798b5b3b8e924183bea7418a439ca108 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:19:17.602761 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cbd7d01e-3d21-47dd-b709-59c79354ab39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:17.605407 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cbd7d01e-3d21-47dd-b709-59c79354ab39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:17.607003 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1125/2266] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:19:17 2022] DELETE /identity/v3/projects/798b5b3b8e924183bea7418a439ca108 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:19:17.613278 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f056c4f-3dd5-487d-96a2-26f22d648c56 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:17.613756 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f056c4f-3dd5-487d-96a2-26f22d648c56 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:17.613868 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f056c4f-3dd5-487d-96a2-26f22d648c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:17.634490 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-2f056c4f-3dd5-487d-96a2-26f22d648c56 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:17.635716 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2f056c4f-3dd5-487d-96a2-26f22d648c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:17.644967 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:17.696655 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1142/2267] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:19:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:17.704733 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e7cd5-ccd6-4525-b3ea-89d7c3fdfda2 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:17.705923 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e7cd5-ccd6-4525-b3ea-89d7c3fdfda2 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:17.705923 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e7cd5-ccd6-4525-b3ea-89d7c3fdfda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:17.727415 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-0d5e7cd5-ccd6-4525-b3ea-89d7c3fdfda2 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:17.728615 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-0d5e7cd5-ccd6-4525-b3ea-89d7c3fdfda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:17.736407 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1126/2268] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:19:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:17.740792 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f056c4f-3dd5-487d-96a2-26f22d648c56 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:17.750639 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f056c4f-3dd5-487d-96a2-26f22d648c56 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:17.755866 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a19c1-0285-42e4-8c4f-d8b44fcb5aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:17.756472 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a19c1-0285-42e4-8c4f-d8b44fcb5aba admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:17.756831 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a19c1-0285-42e4-8c4f-d8b44fcb5aba admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:17.757106 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a19c1-0285-42e4-8c4f-d8b44fcb5aba admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:17.758091 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a19c1-0285-42e4-8c4f-d8b44fcb5aba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:19:17.758392 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a19c1-0285-42e4-8c4f-d8b44fcb5aba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:17.760011 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a19c1-0285-42e4-8c4f-d8b44fcb5aba admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:17.775551 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1143/2269] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:19:17.779673 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e7cd5-ccd6-4525-b3ea-89d7c3fdfda2 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:17.792734 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e7cd5-ccd6-4525-b3ea-89d7c3fdfda2 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:17.797653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3f083-ba08-4659-ac32-89da3f9922c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:17.798857 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3f083-ba08-4659-ac32-89da3f9922c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:17.799140 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3f083-ba08-4659-ac32-89da3f9922c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:17.799414 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3f083-ba08-4659-ac32-89da3f9922c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:17.800060 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be3f083-ba08-4659-ac32-89da3f9922c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:17.802075 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be3f083-ba08-4659-ac32-89da3f9922c3 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:17.841963 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1127/2270] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:19:17 2022] POST /identity/v3/projects => generated 381 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:19:17.847988 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a19c1-0285-42e4-8c4f-d8b44fcb5aba admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:17.859051 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a19c1-0285-42e4-8c4f-d8b44fcb5aba admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:17.928526 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b34f5f-4510-4980-b637-a97c115ac331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:17.929255 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b34f5f-4510-4980-b637-a97c115ac331 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:17.929576 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b34f5f-4510-4980-b637-a97c115ac331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:17.929797 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b34f5f-4510-4980-b637-a97c115ac331 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:17.930470 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b34f5f-4510-4980-b637-a97c115ac331 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:17.932473 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b34f5f-4510-4980-b637-a97c115ac331 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:17.958251 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1144/2271] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:19:17 2022] POST /identity/v3/users => generated 291 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:19:17.961846 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3f083-ba08-4659-ac32-89da3f9922c3 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:17.973969 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3f083-ba08-4659-ac32-89da3f9922c3 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:17.978929 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe19904-6332-422d-aa9f-f6ff56b60308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:17.979539 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe19904-6332-422d-aa9f-f6ff56b60308 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:17.979848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe19904-6332-422d-aa9f-f6ff56b60308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:17.980124 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe19904-6332-422d-aa9f-f6ff56b60308 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:17.980766 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe19904-6332-422d-aa9f-f6ff56b60308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:17.982408 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe19904-6332-422d-aa9f-f6ff56b60308 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:17.994583 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1128/2272] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:19:17.998394 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b34f5f-4510-4980-b637-a97c115ac331 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:18.009562 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b34f5f-4510-4980-b637-a97c115ac331 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:18.015922 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34a01f-c94d-4840-a9a3-fdb53f64c10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:18.015922 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34a01f-c94d-4840-a9a3-fdb53f64c10c admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:18.016509 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34a01f-c94d-4840-a9a3-fdb53f64c10c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:18.016509 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34a01f-c94d-4840-a9a3-fdb53f64c10c admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:18.018088 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34a01f-c94d-4840-a9a3-fdb53f64c10c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:18.019664 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34a01f-c94d-4840-a9a3-fdb53f64c10c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:18.034496 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1145/2273] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:19:18.038736 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe19904-6332-422d-aa9f-f6ff56b60308 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:18.053771 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe19904-6332-422d-aa9f-f6ff56b60308 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:18.064912 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8e577-b579-479f-9266-5eec223a7191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:18.065607 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8e577-b579-479f-9266-5eec223a7191 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:18.065891 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8e577-b579-479f-9266-5eec223a7191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:18.066166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8e577-b579-479f-9266-5eec223a7191 admin admin] PATH_INFO: `/v3/projects/bbb343b0bfa94b5d97b47878a7cbc9e7/users/c9e09fa8b9d74b418bed6a3126b6b18b/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:18.086541 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8e577-b579-479f-9266-5eec223a7191 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbb343b0bfa94b5d97b47878a7cbc9e7, user_id=c9e09fa8b9d74b418bed6a3126b6b18b, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:18.089883 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8e577-b579-479f-9266-5eec223a7191 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:18.111233 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1129/2274] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:19:18 2022] PUT /identity/v3/projects/bbb343b0bfa94b5d97b47878a7cbc9e7/users/c9e09fa8b9d74b418bed6a3126b6b18b/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:19:18.122302 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa02d3-217a-4917-90a6-e16580ab2c2d None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:18.122615 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa02d3-217a-4917-90a6-e16580ab2c2d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:18.122890 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa02d3-217a-4917-90a6-e16580ab2c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:18.154511 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-bbfa02d3-217a-4917-90a6-e16580ab2c2d None None] MFA Rules not processed for user `c9e09fa8b9d74b418bed6a3126b6b18b`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:18.155791 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-bbfa02d3-217a-4917-90a6-e16580ab2c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:18.241321 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1146/2275] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:19:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:19:18.253393 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8e577-b579-479f-9266-5eec223a7191 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:18.255230 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-30a8e577-b579-479f-9266-5eec223a7191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:18.337245 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8e577-b579-479f-9266-5eec223a7191 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:18.342509 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ed142-261e-4201-ba77-126335a48e9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:18.343151 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ed142-261e-4201-ba77-126335a48e9a service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:18.343416 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ed142-261e-4201-ba77-126335a48e9a service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:18.343710 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ed142-261e-4201-ba77-126335a48e9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:18.355672 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8ed142-261e-4201-ba77-126335a48e9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:18.357681 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8ed142-261e-4201-ba77-126335a48e9a service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:18.370644 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1130/2276] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:19:18 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:19:21.162156 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa02d3-217a-4917-90a6-e16580ab2c2d None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:21.174609 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:21.244541 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa02d3-217a-4917-90a6-e16580ab2c2d None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:21.250102 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c480e60-45c0-492d-8298-5772da9a0dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:21.250909 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c480e60-45c0-492d-8298-5772da9a0dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:21.251241 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c480e60-45c0-492d-8298-5772da9a0dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:21.251521 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c480e60-45c0-492d-8298-5772da9a0dda admin admin] PATH_INFO: `/v3/users/c9e09fa8b9d74b418bed6a3126b6b18b` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:21.253883 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c480e60-45c0-492d-8298-5772da9a0dda admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9e09fa8b9d74b418bed6a3126b6b18b)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:21.256589 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c480e60-45c0-492d-8298-5772da9a0dda admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:21.333132 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-2c480e60-45c0-492d-8298-5772da9a0dda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9e09fa8b9d74b418bed6a3126b6b18b'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:21.344408 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-2c480e60-45c0-492d-8298-5772da9a0dda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9e09fa8b9d74b418bed6a3126b6b18b'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:21.353814 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-2c480e60-45c0-492d-8298-5772da9a0dda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9e09fa8b9d74b418bed6a3126b6b18b'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:21.369824 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-2c480e60-45c0-492d-8298-5772da9a0dda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9e09fa8b9d74b418bed6a3126b6b18b'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:21.370768 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-2c480e60-45c0-492d-8298-5772da9a0dda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9e09fa8b9d74b418bed6a3126b6b18b'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:21.376971 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1147/2277] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:19:21 2022] DELETE /identity/v3/users/c9e09fa8b9d74b418bed6a3126b6b18b => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:19:21.381588 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fcf3b9-559e-4ff5-89ee-f18726169358 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:21.382590 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fcf3b9-559e-4ff5-89ee-f18726169358 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:21.382843 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fcf3b9-559e-4ff5-89ee-f18726169358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:21.402090 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-72fcf3b9-559e-4ff5-89ee-f18726169358 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:21.403311 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-72fcf3b9-559e-4ff5-89ee-f18726169358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:21.418094 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:21.466744 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1131/2278] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:19:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:21.479697 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c480e60-45c0-492d-8298-5772da9a0dda admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:21.481612 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2c480e60-45c0-492d-8298-5772da9a0dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:21.542650 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c480e60-45c0-492d-8298-5772da9a0dda admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:21.545749 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71027dad-e20b-456d-9d52-c7764ebcceb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:21.546351 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71027dad-e20b-456d-9d52-c7764ebcceb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:21.546664 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71027dad-e20b-456d-9d52-c7764ebcceb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:21.546951 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71027dad-e20b-456d-9d52-c7764ebcceb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:21.556714 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71027dad-e20b-456d-9d52-c7764ebcceb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:21.558139 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71027dad-e20b-456d-9d52-c7764ebcceb3 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:21.567197 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1148/2279] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:19:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:19:21.841245 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fcf3b9-559e-4ff5-89ee-f18726169358 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:21.842792 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-72fcf3b9-559e-4ff5-89ee-f18726169358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:21.856092 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fcf3b9-559e-4ff5-89ee-f18726169358 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:21.860755 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9542da-a04c-4424-8e8e-d6a5bbd7f340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:21.861400 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9542da-a04c-4424-8e8e-d6a5bbd7f340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:21.861678 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9542da-a04c-4424-8e8e-d6a5bbd7f340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:21.861949 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9542da-a04c-4424-8e8e-d6a5bbd7f340 admin admin] PATH_INFO: `/v3/projects/bbb343b0bfa94b5d97b47878a7cbc9e7` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:21.863333 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9542da-a04c-4424-8e8e-d6a5bbd7f340 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbb343b0bfa94b5d97b47878a7cbc9e7)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:21.865256 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9542da-a04c-4424-8e8e-d6a5bbd7f340 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:21.913777 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-2a9542da-a04c-4424-8e8e-d6a5bbd7f340 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbb343b0bfa94b5d97b47878a7cbc9e7', 'request_id': 'req-2a9542da-a04c-4424-8e8e-d6a5bbd7f340'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:21.919776 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-2a9542da-a04c-4424-8e8e-d6a5bbd7f340 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbb343b0bfa94b5d97b47878a7cbc9e7', 'request_id': 'req-2a9542da-a04c-4424-8e8e-d6a5bbd7f340'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:21.927416 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-2a9542da-a04c-4424-8e8e-d6a5bbd7f340 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbb343b0bfa94b5d97b47878a7cbc9e7', 'request_id': 'req-2a9542da-a04c-4424-8e8e-d6a5bbd7f340'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:21.940799 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-2a9542da-a04c-4424-8e8e-d6a5bbd7f340 admin admin] The token cache is being invalidate because project bbb343b0bfa94b5d97b47878a7cbc9e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:19:21.941083 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-2a9542da-a04c-4424-8e8e-d6a5bbd7f340 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:21.941745 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-2a9542da-a04c-4424-8e8e-d6a5bbd7f340 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:21.944515 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1132/2280] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:19:21 2022] DELETE /identity/v3/projects/bbb343b0bfa94b5d97b47878a7cbc9e7 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:19:21.950723 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac66fe-f578-401e-9f9c-feab78c55b9d None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:21.951106 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac66fe-f578-401e-9f9c-feab78c55b9d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:21.951431 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac66fe-f578-401e-9f9c-feab78c55b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:21.981220 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-59ac66fe-f578-401e-9f9c-feab78c55b9d None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:21.982498 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-59ac66fe-f578-401e-9f9c-feab78c55b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:22.019161 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:22.079974 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1149/2281] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:19:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:22.092398 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca51b48-e221-48c7-9e31-d2e4ca1a97ad None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:22.092874 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca51b48-e221-48c7-9e31-d2e4ca1a97ad None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:22.093150 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca51b48-e221-48c7-9e31-d2e4ca1a97ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:22.115547 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-6ca51b48-e221-48c7-9e31-d2e4ca1a97ad None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:22.116782 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-6ca51b48-e221-48c7-9e31-d2e4ca1a97ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:22.124803 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1133/2282] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:19:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:22.130175 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac66fe-f578-401e-9f9c-feab78c55b9d None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:22.143483 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac66fe-f578-401e-9f9c-feab78c55b9d None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:22.149682 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866485d-67ae-4960-8cc7-0fe739a01462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:22.150389 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866485d-67ae-4960-8cc7-0fe739a01462 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:22.150612 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866485d-67ae-4960-8cc7-0fe739a01462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:22.150873 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866485d-67ae-4960-8cc7-0fe739a01462 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:22.151530 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1866485d-67ae-4960-8cc7-0fe739a01462 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:19:22.151828 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1866485d-67ae-4960-8cc7-0fe739a01462 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:22.153771 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1866485d-67ae-4960-8cc7-0fe739a01462 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:22.181531 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1150/2283] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:19:22.191673 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca51b48-e221-48c7-9e31-d2e4ca1a97ad None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:22.211236 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca51b48-e221-48c7-9e31-d2e4ca1a97ad None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:22.221551 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017b5bd-f01c-4b42-8595-ea765746145f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:22.222187 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017b5bd-f01c-4b42-8595-ea765746145f admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:22.222493 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017b5bd-f01c-4b42-8595-ea765746145f admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:22.222804 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017b5bd-f01c-4b42-8595-ea765746145f admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:22.223460 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d017b5bd-f01c-4b42-8595-ea765746145f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:22.225440 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d017b5bd-f01c-4b42-8595-ea765746145f admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:22.255215 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1134/2284] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:19:22 2022] POST /identity/v3/projects => generated 371 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:19:22.259432 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866485d-67ae-4960-8cc7-0fe739a01462 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:22.270066 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866485d-67ae-4960-8cc7-0fe739a01462 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:22.341610 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a468855-020a-4fae-acf3-ca87b5d84605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:22.342326 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a468855-020a-4fae-acf3-ca87b5d84605 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:22.342723 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a468855-020a-4fae-acf3-ca87b5d84605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:22.343074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a468855-020a-4fae-acf3-ca87b5d84605 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:22.344437 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a468855-020a-4fae-acf3-ca87b5d84605 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:22.348073 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a468855-020a-4fae-acf3-ca87b5d84605 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:22.396027 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1151/2285] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:19:22 2022] POST /identity/v3/users => generated 286 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:19:22.401948 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017b5bd-f01c-4b42-8595-ea765746145f admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:22.414358 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017b5bd-f01c-4b42-8595-ea765746145f admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:22.419251 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaeefef-09fb-4f1a-b6c6-52ba42df256f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:22.419860 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaeefef-09fb-4f1a-b6c6-52ba42df256f admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:22.420140 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaeefef-09fb-4f1a-b6c6-52ba42df256f admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:22.420408 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaeefef-09fb-4f1a-b6c6-52ba42df256f admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:22.421186 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaeefef-09fb-4f1a-b6c6-52ba42df256f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:22.422886 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaeefef-09fb-4f1a-b6c6-52ba42df256f admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:22.445771 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1135/2286] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:19:22.450699 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a468855-020a-4fae-acf3-ca87b5d84605 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:22.464887 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a468855-020a-4fae-acf3-ca87b5d84605 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:22.470538 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94993bdc-db54-49eb-88d1-c6c57a2d8995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:22.471515 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94993bdc-db54-49eb-88d1-c6c57a2d8995 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:22.471883 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94993bdc-db54-49eb-88d1-c6c57a2d8995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:22.472158 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94993bdc-db54-49eb-88d1-c6c57a2d8995 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:22.472932 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94993bdc-db54-49eb-88d1-c6c57a2d8995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:22.478718 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94993bdc-db54-49eb-88d1-c6c57a2d8995 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:22.494641 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1152/2287] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:19:22.496753 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaeefef-09fb-4f1a-b6c6-52ba42df256f admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:22.509183 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaeefef-09fb-4f1a-b6c6-52ba42df256f admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:22.514781 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aced6f-fa5b-40d5-be11-f76fd0fca5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:22.515473 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aced6f-fa5b-40d5-be11-f76fd0fca5c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:22.515757 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aced6f-fa5b-40d5-be11-f76fd0fca5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:22.516490 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aced6f-fa5b-40d5-be11-f76fd0fca5c8 admin admin] PATH_INFO: `/v3/projects/1fa484f252b744e08c35cb5328b14ffe/users/abed66138e4d482a985e2f6754a7a573/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:22.549419 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aced6f-fa5b-40d5-be11-f76fd0fca5c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fa484f252b744e08c35cb5328b14ffe, user_id=abed66138e4d482a985e2f6754a7a573, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:22.556040 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aced6f-fa5b-40d5-be11-f76fd0fca5c8 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:22.571014 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1136/2288] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:19:22 2022] PUT /identity/v3/projects/1fa484f252b744e08c35cb5328b14ffe/users/abed66138e4d482a985e2f6754a7a573/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:19:22.576219 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5fae17-b640-49c2-b79d-00777118ad45 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:22.576529 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5fae17-b640-49c2-b79d-00777118ad45 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:22.576801 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5fae17-b640-49c2-b79d-00777118ad45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:22.598234 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-bd5fae17-b640-49c2-b79d-00777118ad45 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:22.599404 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-bd5fae17-b640-49c2-b79d-00777118ad45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:22.666080 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1153/2289] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:19:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:22.675990 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aced6f-fa5b-40d5-be11-f76fd0fca5c8 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:22.677705 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-e9aced6f-fa5b-40d5-be11-f76fd0fca5c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:22.723991 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:22.742324 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aced6f-fa5b-40d5-be11-f76fd0fca5c8 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:22.746040 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf254f3-3524-4a90-9b5a-1e97cc2fc634 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:22.746679 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf254f3-3524-4a90-9b5a-1e97cc2fc634 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:22.746991 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf254f3-3524-4a90-9b5a-1e97cc2fc634 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:22.747368 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf254f3-3524-4a90-9b5a-1e97cc2fc634 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:22.756925 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf254f3-3524-4a90-9b5a-1e97cc2fc634 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:22.758766 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf254f3-3524-4a90-9b5a-1e97cc2fc634 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:22.769446 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1137/2290] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:19:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:19:27.042762 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5fae17-b640-49c2-b79d-00777118ad45 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:27.043781 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-bd5fae17-b640-49c2-b79d-00777118ad45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:27.113884 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:27.140166 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5fae17-b640-49c2-b79d-00777118ad45 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:27.146998 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80fea34-d391-4baa-a37c-f3c50fabfdc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:27.148629 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fea34-d391-4baa-a37c-f3c50fabfdc8 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:27.149042 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fea34-d391-4baa-a37c-f3c50fabfdc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:27.149424 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fea34-d391-4baa-a37c-f3c50fabfdc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:27.153058 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c80fea34-d391-4baa-a37c-f3c50fabfdc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:27.257559 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80fea34-d391-4baa-a37c-f3c50fabfdc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:27.259256 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80fea34-d391-4baa-a37c-f3c50fabfdc8 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:27.284427 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1154/2291] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:19:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:19:27.784972 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64346f-8cf8-4636-8d02-bbc34ccd6ff9 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:27.785629 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64346f-8cf8-4636-8d02-bbc34ccd6ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:27.785629 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64346f-8cf8-4636-8d02-bbc34ccd6ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:27.827430 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-ef64346f-8cf8-4636-8d02-bbc34ccd6ff9 None None] MFA Rules not processed for user `abed66138e4d482a985e2f6754a7a573`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:27.828668 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-ef64346f-8cf8-4636-8d02-bbc34ccd6ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:27.941719 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1138/2292] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:19:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:27.952826 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80fea34-d391-4baa-a37c-f3c50fabfdc8 service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:27.974972 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80fea34-d391-4baa-a37c-f3c50fabfdc8 service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:27.983714 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c39d12-6ef9-4387-b959-ac9ba2002719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:27.984349 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c39d12-6ef9-4387-b959-ac9ba2002719 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:27.984635 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c39d12-6ef9-4387-b959-ac9ba2002719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:27.984939 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c39d12-6ef9-4387-b959-ac9ba2002719 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:27.986124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c39d12-6ef9-4387-b959-ac9ba2002719 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:27.989535 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c39d12-6ef9-4387-b959-ac9ba2002719 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:28.042630 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1155/2293] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:19:27 2022] POST /identity/v3/projects => generated 371 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:19:28.050562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64346f-8cf8-4636-8d02-bbc34ccd6ff9 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:28.097082 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64346f-8cf8-4636-8d02-bbc34ccd6ff9 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:28.277258 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37299753-6538-4e79-9eea-9340c8c41c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:28.278199 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37299753-6538-4e79-9eea-9340c8c41c22 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:28.278549 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37299753-6538-4e79-9eea-9340c8c41c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:28.278869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37299753-6538-4e79-9eea-9340c8c41c22 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:28.279596 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37299753-6538-4e79-9eea-9340c8c41c22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:28.281871 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37299753-6538-4e79-9eea-9340c8c41c22 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:28.340707 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1139/2294] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:19:28 2022] POST /identity/v3/users => generated 292 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:19:28.343891 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c39d12-6ef9-4387-b959-ac9ba2002719 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:28.359474 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c39d12-6ef9-4387-b959-ac9ba2002719 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:28.364709 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ddb97-e4a8-402c-ba1a-449a7290e7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:28.365304 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ddb97-e4a8-402c-ba1a-449a7290e7e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:28.365585 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ddb97-e4a8-402c-ba1a-449a7290e7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:28.365857 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ddb97-e4a8-402c-ba1a-449a7290e7e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:28.366589 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ddb97-e4a8-402c-ba1a-449a7290e7e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:28.368217 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ddb97-e4a8-402c-ba1a-449a7290e7e3 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:28.392969 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1156/2295] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:19:28.397981 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37299753-6538-4e79-9eea-9340c8c41c22 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:28.426802 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37299753-6538-4e79-9eea-9340c8c41c22 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:28.452378 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5b8b7-809b-4f05-8609-1012cfe38340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:28.453936 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5b8b7-809b-4f05-8609-1012cfe38340 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:28.455738 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5b8b7-809b-4f05-8609-1012cfe38340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:28.456241 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5b8b7-809b-4f05-8609-1012cfe38340 admin admin] PATH_INFO: `/v3/projects/f39e1bd9e83e47fe8d52d2c3299c1ab6/users/37af2ca3d04d4662b0eeb73b90c662fb/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:28.505787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff5b8b7-809b-4f05-8609-1012cfe38340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f39e1bd9e83e47fe8d52d2c3299c1ab6, user_id=37af2ca3d04d4662b0eeb73b90c662fb, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:28.508747 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff5b8b7-809b-4f05-8609-1012cfe38340 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:28.537389 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ddb97-e4a8-402c-ba1a-449a7290e7e3 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:28.538922 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1140/2296] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:19:28 2022] PUT /identity/v3/projects/f39e1bd9e83e47fe8d52d2c3299c1ab6/users/37af2ca3d04d4662b0eeb73b90c662fb/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:19:28.549761 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ddb97-e4a8-402c-ba1a-449a7290e7e3 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:28.651921 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4385eca-7423-4770-91f7-f0fa44199ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:28.652877 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4385eca-7423-4770-91f7-f0fa44199ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:28.653241 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4385eca-7423-4770-91f7-f0fa44199ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:28.653725 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4385eca-7423-4770-91f7-f0fa44199ab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:28.654604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4385eca-7423-4770-91f7-f0fa44199ab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:28.657672 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4385eca-7423-4770-91f7-f0fa44199ab4 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:28.683006 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5b8b7-809b-4f05-8609-1012cfe38340 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:28.683892 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1157/2297] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:19:28.710271 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5b8b7-809b-4f05-8609-1012cfe38340 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:28.720307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55aa138-6da5-4a91-b32e-c3f0aa1c3708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:28.722011 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55aa138-6da5-4a91-b32e-c3f0aa1c3708 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:28.723209 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55aa138-6da5-4a91-b32e-c3f0aa1c3708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:28.723700 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55aa138-6da5-4a91-b32e-c3f0aa1c3708 admin admin] PATH_INFO: `/v3/projects/f39e1bd9e83e47fe8d52d2c3299c1ab6/users/37af2ca3d04d4662b0eeb73b90c662fb/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:28.726816 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55aa138-6da5-4a91-b32e-c3f0aa1c3708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f39e1bd9e83e47fe8d52d2c3299c1ab6, user_id=37af2ca3d04d4662b0eeb73b90c662fb, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:28.731238 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55aa138-6da5-4a91-b32e-c3f0aa1c3708 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:28.763265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1141/2298] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:19:28 2022] PUT /identity/v3/projects/f39e1bd9e83e47fe8d52d2c3299c1ab6/users/37af2ca3d04d4662b0eeb73b90c662fb/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:19:29.572160 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767d97b-9e39-40b9-9da2-291e498dfc6b None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:29.572694 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767d97b-9e39-40b9-9da2-291e498dfc6b None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:29.574508 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767d97b-9e39-40b9-9da2-291e498dfc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:29.607833 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-4767d97b-9e39-40b9-9da2-291e498dfc6b None None] MFA Rules not processed for user `3e070c93f47045ecb5bf0a1622395091`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:29.609875 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4767d97b-9e39-40b9-9da2-291e498dfc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:29.690153 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:29.714813 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1158/2299] 10.222.0.79 () {58 vars in 1009 bytes} [Wed Aug 31 19:19:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:29.804205 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55aa138-6da5-4a91-b32e-c3f0aa1c3708 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:29.806557 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-a55aa138-6da5-4a91-b32e-c3f0aa1c3708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:29.872274 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:29.966049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55aa138-6da5-4a91-b32e-c3f0aa1c3708 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:29.978966 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b43f0-dd2c-4e8f-833b-6d6cad7636b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b289a0bef53460ca5173ad946394d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:29.979836 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b43f0-dd2c-4e8f-833b-6d6cad7636b2 service swift] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:29.980332 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b43f0-dd2c-4e8f-833b-6d6cad7636b2 service swift] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:29.980885 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b43f0-dd2c-4e8f-833b-6d6cad7636b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:30.003759 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b43f0-dd2c-4e8f-833b-6d6cad7636b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:30.005450 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b43f0-dd2c-4e8f-833b-6d6cad7636b2 service swift] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:30.045684 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1142/2300] 10.222.0.79 () {60 vars in 1384 bytes} [Wed Aug 31 19:19:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 19:19:30.870402 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22d313-8b8c-444f-9cfb-f9ac35bcf021 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:30.870978 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22d313-8b8c-444f-9cfb-f9ac35bcf021 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:30.871413 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22d313-8b8c-444f-9cfb-f9ac35bcf021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:30.923975 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-be22d313-8b8c-444f-9cfb-f9ac35bcf021 None None] MFA Rules not processed for user `3e070c93f47045ecb5bf0a1622395091`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:30.927712 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-be22d313-8b8c-444f-9cfb-f9ac35bcf021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:30.949127 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1159/2301] 10.222.0.79 () {58 vars in 967 bytes} [Wed Aug 31 19:19:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:30.966166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b43f0-dd2c-4e8f-833b-6d6cad7636b2 service swift] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:30.991482 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b43f0-dd2c-4e8f-833b-6d6cad7636b2 service swift] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:31.014010 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed150a0-cdad-4bbc-9f55-cc9baf48209f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b289a0bef53460ca5173ad946394d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:31.014689 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed150a0-cdad-4bbc-9f55-cc9baf48209f service swift] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:31.016318 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed150a0-cdad-4bbc-9f55-cc9baf48209f service swift] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:31.016637 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed150a0-cdad-4bbc-9f55-cc9baf48209f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:31.044317 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed150a0-cdad-4bbc-9f55-cc9baf48209f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:31.046676 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed150a0-cdad-4bbc-9f55-cc9baf48209f service swift] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:31.091441 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1143/2302] 10.222.0.79 () {60 vars in 1384 bytes} [Wed Aug 31 19:19:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:19:31.439573 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa362565-b851-4d65-9b43-454bd0e42f59 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:31.440268 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa362565-b851-4d65-9b43-454bd0e42f59 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:31.440823 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa362565-b851-4d65-9b43-454bd0e42f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:31.466257 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-fa362565-b851-4d65-9b43-454bd0e42f59 None None] MFA Rules not processed for user `3e070c93f47045ecb5bf0a1622395091`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:31.467757 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-fa362565-b851-4d65-9b43-454bd0e42f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:31.495436 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1160/2303] 10.222.0.79 () {58 vars in 1009 bytes} [Wed Aug 31 19:19:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:31.501962 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed150a0-cdad-4bbc-9f55-cc9baf48209f service swift] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:31.521060 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed150a0-cdad-4bbc-9f55-cc9baf48209f service swift] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:31.537378 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86a11b-0289-46a1-a86f-9c1be59faffc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b289a0bef53460ca5173ad946394d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:31.538105 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86a11b-0289-46a1-a86f-9c1be59faffc service swift] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:31.538542 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86a11b-0289-46a1-a86f-9c1be59faffc service swift] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:31.539394 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86a11b-0289-46a1-a86f-9c1be59faffc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:31.561810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b86a11b-0289-46a1-a86f-9c1be59faffc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:31.564487 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b86a11b-0289-46a1-a86f-9c1be59faffc service swift] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:31.577362 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1144/2304] 10.222.0.79 () {60 vars in 1384 bytes} [Wed Aug 31 19:19:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:19:32.274006 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb76e5-6cac-4769-9eb2-7e152f0672e0 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:32.274515 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb76e5-6cac-4769-9eb2-7e152f0672e0 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:32.274730 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb76e5-6cac-4769-9eb2-7e152f0672e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:32.336042 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-c7bb76e5-6cac-4769-9eb2-7e152f0672e0 None None] MFA Rules not processed for user `3e070c93f47045ecb5bf0a1622395091`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:32.337466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c7bb76e5-6cac-4769-9eb2-7e152f0672e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:32.365703 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1161/2305] 10.222.0.79 () {58 vars in 967 bytes} [Wed Aug 31 19:19:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:32.370723 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86a11b-0289-46a1-a86f-9c1be59faffc service swift] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:32.389296 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86a11b-0289-46a1-a86f-9c1be59faffc service swift] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:32.404691 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819464c-3a7c-4945-b8f0-8626996c8137 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b289a0bef53460ca5173ad946394d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:32.405650 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819464c-3a7c-4945-b8f0-8626996c8137 service swift] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:32.406121 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819464c-3a7c-4945-b8f0-8626996c8137 service swift] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:32.406633 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819464c-3a7c-4945-b8f0-8626996c8137 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:32.425693 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819464c-3a7c-4945-b8f0-8626996c8137 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:32.427682 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819464c-3a7c-4945-b8f0-8626996c8137 service swift] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:32.446767 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1145/2306] 10.222.0.79 () {60 vars in 1384 bytes} [Wed Aug 31 19:19:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:19:35.273391 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb76e5-6cac-4769-9eb2-7e152f0672e0 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:35.274884 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c7bb76e5-6cac-4769-9eb2-7e152f0672e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:35.428344 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb76e5-6cac-4769-9eb2-7e152f0672e0 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:35.445438 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79812f-d6ee-4a9b-a656-a1c556f1ebaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:35.450565 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79812f-d6ee-4a9b-a656-a1c556f1ebaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:35.451087 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79812f-d6ee-4a9b-a656-a1c556f1ebaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:35.451446 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79812f-d6ee-4a9b-a656-a1c556f1ebaa admin admin] PATH_INFO: `/v3/users/31b795ee988d49b9bf9dbf283d1a2ba6` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:35.453022 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79812f-d6ee-4a9b-a656-a1c556f1ebaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=31b795ee988d49b9bf9dbf283d1a2ba6)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:35.455885 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79812f-d6ee-4a9b-a656-a1c556f1ebaa admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:35.582838 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-bc79812f-d6ee-4a9b-a656-a1c556f1ebaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31b795ee988d49b9bf9dbf283d1a2ba6'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:35.600140 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-bc79812f-d6ee-4a9b-a656-a1c556f1ebaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31b795ee988d49b9bf9dbf283d1a2ba6'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:35.609637 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-bc79812f-d6ee-4a9b-a656-a1c556f1ebaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31b795ee988d49b9bf9dbf283d1a2ba6'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:35.646134 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-bc79812f-d6ee-4a9b-a656-a1c556f1ebaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31b795ee988d49b9bf9dbf283d1a2ba6'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:35.648006 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-bc79812f-d6ee-4a9b-a656-a1c556f1ebaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31b795ee988d49b9bf9dbf283d1a2ba6'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:35.660489 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1162/2307] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:19:35 2022] DELETE /identity/v3/users/31b795ee988d49b9bf9dbf283d1a2ba6 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:19:35.664850 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba65e3-5f1e-4bfd-8d3e-3aa811ca5252 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:35.666126 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba65e3-5f1e-4bfd-8d3e-3aa811ca5252 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:35.666667 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba65e3-5f1e-4bfd-8d3e-3aa811ca5252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:35.695712 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-bbba65e3-5f1e-4bfd-8d3e-3aa811ca5252 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:35.697330 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-bbba65e3-5f1e-4bfd-8d3e-3aa811ca5252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:35.759707 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106328dd-76f5-4dcb-aa71-632166131c2c None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:35.759998 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106328dd-76f5-4dcb-aa71-632166131c2c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:35.760278 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106328dd-76f5-4dcb-aa71-632166131c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:35.797243 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-106328dd-76f5-4dcb-aa71-632166131c2c None None] MFA Rules not processed for user `37af2ca3d04d4662b0eeb73b90c662fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:35.799845 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-106328dd-76f5-4dcb-aa71-632166131c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:35.861546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1146/2308] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:35.863114 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:35.872998 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba65e3-5f1e-4bfd-8d3e-3aa811ca5252 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:35.874421 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-bbba65e3-5f1e-4bfd-8d3e-3aa811ca5252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:35.897277 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1163/2309] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:19:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:35.911399 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106328dd-76f5-4dcb-aa71-632166131c2c None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:35.912897 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-106328dd-76f5-4dcb-aa71-632166131c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:35.947689 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba65e3-5f1e-4bfd-8d3e-3aa811ca5252 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:35.954782 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e74458-d167-4f0a-89f2-a4236b633c10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:35.955394 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e74458-d167-4f0a-89f2-a4236b633c10 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:35.955846 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e74458-d167-4f0a-89f2-a4236b633c10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:35.956424 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e74458-d167-4f0a-89f2-a4236b633c10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:35.967612 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e74458-d167-4f0a-89f2-a4236b633c10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:35.969039 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e74458-d167-4f0a-89f2-a4236b633c10 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:35.983769 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1147/2310] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:19:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:19:36.005803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106328dd-76f5-4dcb-aa71-632166131c2c None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:36.013682 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985d7c5-8ce7-48b5-820c-5fc6c55342c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:36.014332 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985d7c5-8ce7-48b5-820c-5fc6c55342c7 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:36.014652 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985d7c5-8ce7-48b5-820c-5fc6c55342c7 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:36.014933 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985d7c5-8ce7-48b5-820c-5fc6c55342c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:36.017545 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6985d7c5-8ce7-48b5-820c-5fc6c55342c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:36.089775 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6985d7c5-8ce7-48b5-820c-5fc6c55342c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:36.091677 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6985d7c5-8ce7-48b5-820c-5fc6c55342c7 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:36.104692 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1164/2311] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:19:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:19:36.193546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e74458-d167-4f0a-89f2-a4236b633c10 service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:36.195162 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-44e74458-d167-4f0a-89f2-a4236b633c10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:36.218451 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e74458-d167-4f0a-89f2-a4236b633c10 service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:36.228532 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f011e-8430-4984-b9cc-1ced21694485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:36.231059 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f011e-8430-4984-b9cc-1ced21694485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:36.232238 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f011e-8430-4984-b9cc-1ced21694485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:36.233372 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f011e-8430-4984-b9cc-1ced21694485 admin admin] PATH_INFO: `/v3/projects/f7952b5ee8114bd687c07416d5e8e35b` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:36.236326 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f011e-8430-4984-b9cc-1ced21694485 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7952b5ee8114bd687c07416d5e8e35b)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:36.241308 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f011e-8430-4984-b9cc-1ced21694485 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:36.261190 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:36.341850 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1b5f011e-8430-4984-b9cc-1ced21694485 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7952b5ee8114bd687c07416d5e8e35b', 'request_id': 'req-1b5f011e-8430-4984-b9cc-1ced21694485'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:36.362944 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1b5f011e-8430-4984-b9cc-1ced21694485 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7952b5ee8114bd687c07416d5e8e35b', 'request_id': 'req-1b5f011e-8430-4984-b9cc-1ced21694485'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:36.370944 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1b5f011e-8430-4984-b9cc-1ced21694485 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7952b5ee8114bd687c07416d5e8e35b', 'request_id': 'req-1b5f011e-8430-4984-b9cc-1ced21694485'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:36.399082 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1b5f011e-8430-4984-b9cc-1ced21694485 admin admin] The token cache is being invalidate because project f7952b5ee8114bd687c07416d5e8e35b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:19:36.399586 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1b5f011e-8430-4984-b9cc-1ced21694485 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:36.400815 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1b5f011e-8430-4984-b9cc-1ced21694485 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:36.407146 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1148/2312] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:19:36 2022] DELETE /identity/v3/projects/f7952b5ee8114bd687c07416d5e8e35b => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:19:36.408929 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ced08d-c701-4753-8b80-215f68790a06 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:36.409402 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ced08d-c701-4753-8b80-215f68790a06 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:36.409517 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ced08d-c701-4753-8b80-215f68790a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:36.449463 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-84ced08d-c701-4753-8b80-215f68790a06 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:36.450737 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-84ced08d-c701-4753-8b80-215f68790a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:36.570502 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1165/2313] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:36.578076 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4b2c0-51f8-415d-8fd1-7991f10dad35 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:36.578372 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4b2c0-51f8-415d-8fd1-7991f10dad35 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:36.579503 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4b2c0-51f8-415d-8fd1-7991f10dad35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:36.631177 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-deb4b2c0-51f8-415d-8fd1-7991f10dad35 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:36.632590 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-deb4b2c0-51f8-415d-8fd1-7991f10dad35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:36.649639 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1149/2314] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:36.650306 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ced08d-c701-4753-8b80-215f68790a06 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:36.663651 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ced08d-c701-4753-8b80-215f68790a06 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:36.672030 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e5a3a-f4b3-40ec-8bf2-d3c7ed521f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:36.672769 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e5a3a-f4b3-40ec-8bf2-d3c7ed521f82 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:36.673133 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e5a3a-f4b3-40ec-8bf2-d3c7ed521f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:36.673470 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e5a3a-f4b3-40ec-8bf2-d3c7ed521f82 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:36.674199 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e5a3a-f4b3-40ec-8bf2-d3c7ed521f82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:19:36.674608 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e5a3a-f4b3-40ec-8bf2-d3c7ed521f82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:36.677075 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e5a3a-f4b3-40ec-8bf2-d3c7ed521f82 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:36.696188 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1166/2315] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:19:36.703024 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4b2c0-51f8-415d-8fd1-7991f10dad35 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:36.725548 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4b2c0-51f8-415d-8fd1-7991f10dad35 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:36.733990 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a91844-fb8f-4788-bab8-d75b4d73d0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:36.735032 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a91844-fb8f-4788-bab8-d75b4d73d0b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:36.736307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a91844-fb8f-4788-bab8-d75b4d73d0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:36.736662 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a91844-fb8f-4788-bab8-d75b4d73d0b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:36.738278 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a91844-fb8f-4788-bab8-d75b4d73d0b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:36.739710 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a91844-fb8f-4788-bab8-d75b4d73d0b0 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:36.784329 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1150/2316] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:19:36 2022] POST /identity/v3/projects => generated 383 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:19:36.785248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e5a3a-f4b3-40ec-8bf2-d3c7ed521f82 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:36.792605 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:36.798853 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e5a3a-f4b3-40ec-8bf2-d3c7ed521f82 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:36.936378 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2686e-fb9c-4be2-a76f-74aa6395179e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:36.937207 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2686e-fb9c-4be2-a76f-74aa6395179e admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:36.937592 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2686e-fb9c-4be2-a76f-74aa6395179e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:36.938129 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2686e-fb9c-4be2-a76f-74aa6395179e admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:36.940083 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2686e-fb9c-4be2-a76f-74aa6395179e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:36.943788 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2686e-fb9c-4be2-a76f-74aa6395179e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:37.002741 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1167/2317] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:19:36 2022] POST /identity/v3/users => generated 292 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:19:37.007321 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a91844-fb8f-4788-bab8-d75b4d73d0b0 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:37.021900 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a91844-fb8f-4788-bab8-d75b4d73d0b0 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:37.033647 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddb9b5-09d4-4023-9f21-de447f20f88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:37.034707 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddb9b5-09d4-4023-9f21-de447f20f88a admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:37.035494 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddb9b5-09d4-4023-9f21-de447f20f88a admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:37.035987 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddb9b5-09d4-4023-9f21-de447f20f88a admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:37.037107 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceddb9b5-09d4-4023-9f21-de447f20f88a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:37.039224 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceddb9b5-09d4-4023-9f21-de447f20f88a admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:37.056588 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1151/2318] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:19:37.062431 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2686e-fb9c-4be2-a76f-74aa6395179e admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:37.095518 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2686e-fb9c-4be2-a76f-74aa6395179e admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:37.105086 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec7d90-3100-4a4a-bf70-e1b97c5ff226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:37.105835 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec7d90-3100-4a4a-bf70-e1b97c5ff226 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:37.106403 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec7d90-3100-4a4a-bf70-e1b97c5ff226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:37.106791 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec7d90-3100-4a4a-bf70-e1b97c5ff226 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:37.107592 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec7d90-3100-4a4a-bf70-e1b97c5ff226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:37.109784 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec7d90-3100-4a4a-bf70-e1b97c5ff226 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:37.129306 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1168/2319] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:19:37.133283 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddb9b5-09d4-4023-9f21-de447f20f88a admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:37.146274 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddb9b5-09d4-4023-9f21-de447f20f88a admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:37.156140 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e9a61-edd8-4388-987b-b801fe8ed024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:37.157025 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e9a61-edd8-4388-987b-b801fe8ed024 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:37.157487 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e9a61-edd8-4388-987b-b801fe8ed024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:37.157914 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e9a61-edd8-4388-987b-b801fe8ed024 admin admin] PATH_INFO: `/v3/projects/ad54277b8e5047fcac19393ac656f119/users/25dc9e2a730f4d63828ddb059d15d5d3/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:37.175133 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119e9a61-edd8-4388-987b-b801fe8ed024 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad54277b8e5047fcac19393ac656f119, user_id=25dc9e2a730f4d63828ddb059d15d5d3, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:37.180068 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119e9a61-edd8-4388-987b-b801fe8ed024 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:37.211660 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1152/2320] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:19:37 2022] PUT /identity/v3/projects/ad54277b8e5047fcac19393ac656f119/users/25dc9e2a730f4d63828ddb059d15d5d3/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:19:37.217157 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5782af-7296-48cc-9222-3f4b6af3f07f None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:37.217632 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5782af-7296-48cc-9222-3f4b6af3f07f None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:37.218009 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5782af-7296-48cc-9222-3f4b6af3f07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:37.247117 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-8c5782af-7296-48cc-9222-3f4b6af3f07f None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:37.248656 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8c5782af-7296-48cc-9222-3f4b6af3f07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:37.340253 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1169/2321] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:19:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:37.388980 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e9a61-edd8-4388-987b-b801fe8ed024 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:37.399417 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-119e9a61-edd8-4388-987b-b801fe8ed024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:37.523588 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e9a61-edd8-4388-987b-b801fe8ed024 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:37.535861 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288f704-9745-4c60-85db-d72813f2ed07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:37.540070 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288f704-9745-4c60-85db-d72813f2ed07 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:37.541407 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288f704-9745-4c60-85db-d72813f2ed07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:37.542779 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288f704-9745-4c60-85db-d72813f2ed07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:37.596393 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7288f704-9745-4c60-85db-d72813f2ed07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:37.600341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7288f704-9745-4c60-85db-d72813f2ed07 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:37.627132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1153/2322] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:19:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:19:38.382390 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3976eb5-6a94-417c-afc1-9251c715fdd0 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:38.382939 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3976eb5-6a94-417c-afc1-9251c715fdd0 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:38.383021 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3976eb5-6a94-417c-afc1-9251c715fdd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:38.415949 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-a3976eb5-6a94-417c-afc1-9251c715fdd0 None None] MFA Rules not processed for user `abed66138e4d482a985e2f6754a7a573`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:38.417176 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a3976eb5-6a94-417c-afc1-9251c715fdd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:38.517806 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1170/2323] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:19:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:43.576440 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288f704-9745-4c60-85db-d72813f2ed07 service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:43.577937 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-7288f704-9745-4c60-85db-d72813f2ed07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:43.600179 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288f704-9745-4c60-85db-d72813f2ed07 service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:43.607976 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354989e-cc56-407c-a544-b9b5c931df75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:43.608708 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354989e-cc56-407c-a544-b9b5c931df75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:43.609196 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354989e-cc56-407c-a544-b9b5c931df75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:43.609660 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354989e-cc56-407c-a544-b9b5c931df75 admin admin] PATH_INFO: `/v3/users/5161971f558541cab1708db7a360c92e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:43.614399 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354989e-cc56-407c-a544-b9b5c931df75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5161971f558541cab1708db7a360c92e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:43.621663 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354989e-cc56-407c-a544-b9b5c931df75 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:43.691895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:43.706235 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-8354989e-cc56-407c-a544-b9b5c931df75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5161971f558541cab1708db7a360c92e'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:43.707836 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-8354989e-cc56-407c-a544-b9b5c931df75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5161971f558541cab1708db7a360c92e'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:43.729726 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-8354989e-cc56-407c-a544-b9b5c931df75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5161971f558541cab1708db7a360c92e'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:43.740498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-8354989e-cc56-407c-a544-b9b5c931df75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5161971f558541cab1708db7a360c92e'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:43.749641 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-8354989e-cc56-407c-a544-b9b5c931df75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5161971f558541cab1708db7a360c92e'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:43.759815 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1154/2324] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:19:43 2022] DELETE /identity/v3/users/5161971f558541cab1708db7a360c92e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:19:43.764141 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed6778-432f-4bb5-af57-e8bb1453a674 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:43.764692 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed6778-432f-4bb5-af57-e8bb1453a674 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:43.765076 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed6778-432f-4bb5-af57-e8bb1453a674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:43.791541 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-e2ed6778-432f-4bb5-af57-e8bb1453a674 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:43.793285 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e2ed6778-432f-4bb5-af57-e8bb1453a674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:43.823949 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:43.886308 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1171/2325] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:19:43.900572 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354989e-cc56-407c-a544-b9b5c931df75 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:43.902593 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-8354989e-cc56-407c-a544-b9b5c931df75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:44.021114 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354989e-cc56-407c-a544-b9b5c931df75 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:44.032707 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078770b6-f475-44c0-a489-5975a4b5bbb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:44.034528 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078770b6-f475-44c0-a489-5975a4b5bbb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:44.035053 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078770b6-f475-44c0-a489-5975a4b5bbb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:44.035355 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078770b6-f475-44c0-a489-5975a4b5bbb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:44.059238 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078770b6-f475-44c0-a489-5975a4b5bbb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:44.060714 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078770b6-f475-44c0-a489-5975a4b5bbb2 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:44.076286 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1155/2326] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:19:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:19:44.443231 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bbf1c-e113-4797-8784-54ae32543f57 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:44.443517 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bbf1c-e113-4797-8784-54ae32543f57 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:44.443794 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bbf1c-e113-4797-8784-54ae32543f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:44.514089 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-668bbf1c-e113-4797-8784-54ae32543f57 None None] MFA Rules not processed for user `25dc9e2a730f4d63828ddb059d15d5d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:44.515331 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-668bbf1c-e113-4797-8784-54ae32543f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:44.681311 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1172/2327] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:19:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:44.685804 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078770b6-f475-44c0-a489-5975a4b5bbb2 service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:44.687782 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-078770b6-f475-44c0-a489-5975a4b5bbb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:44.709409 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078770b6-f475-44c0-a489-5975a4b5bbb2 service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:44.716549 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668bbf1c-e113-4797-8784-54ae32543f57 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:44.718046 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-668bbf1c-e113-4797-8784-54ae32543f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:44.728936 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33691ee-590a-468c-87ed-a05867f72b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:44.729576 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33691ee-590a-468c-87ed-a05867f72b22 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:44.729858 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33691ee-590a-468c-87ed-a05867f72b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:44.730141 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33691ee-590a-468c-87ed-a05867f72b22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:44.730828 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33691ee-590a-468c-87ed-a05867f72b22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:44.732819 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33691ee-590a-468c-87ed-a05867f72b22 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:44.740968 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668bbf1c-e113-4797-8784-54ae32543f57 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:44.756768 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b60d9-2b4a-4931-8172-68f25919d413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:44.757467 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b60d9-2b4a-4931-8172-68f25919d413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:44.757783 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b60d9-2b4a-4931-8172-68f25919d413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:44.758054 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b60d9-2b4a-4931-8172-68f25919d413 admin admin] PATH_INFO: `/v3/projects/d13c92f487e74a3984823cbc1996e1a4` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:44.764603 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6b60d9-2b4a-4931-8172-68f25919d413 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d13c92f487e74a3984823cbc1996e1a4)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:44.767450 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6b60d9-2b4a-4931-8172-68f25919d413 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:44.812962 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1156/2328] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:19:44 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:19:44.817431 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33691ee-590a-468c-87ed-a05867f72b22 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:44.870991 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0a6b60d9-2b4a-4931-8172-68f25919d413 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd13c92f487e74a3984823cbc1996e1a4', 'request_id': 'req-0a6b60d9-2b4a-4931-8172-68f25919d413'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:44.877950 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0a6b60d9-2b4a-4931-8172-68f25919d413 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd13c92f487e74a3984823cbc1996e1a4', 'request_id': 'req-0a6b60d9-2b4a-4931-8172-68f25919d413'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:44.885285 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0a6b60d9-2b4a-4931-8172-68f25919d413 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd13c92f487e74a3984823cbc1996e1a4', 'request_id': 'req-0a6b60d9-2b4a-4931-8172-68f25919d413'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:44.909556 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0a6b60d9-2b4a-4931-8172-68f25919d413 admin admin] The token cache is being invalidate because project d13c92f487e74a3984823cbc1996e1a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:19:44.909957 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0a6b60d9-2b4a-4931-8172-68f25919d413 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:44.911342 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0a6b60d9-2b4a-4931-8172-68f25919d413 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:44.914517 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1173/2329] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:19:44 2022] DELETE /identity/v3/projects/d13c92f487e74a3984823cbc1996e1a4 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:19:44.993513 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33691ee-590a-468c-87ed-a05867f72b22 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:45.059445 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:45.095437 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3ac99-9f20-4ec5-9fbf-88a264324b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:45.096439 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3ac99-9f20-4ec5-9fbf-88a264324b8e admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:45.096773 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3ac99-9f20-4ec5-9fbf-88a264324b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:45.096876 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3ac99-9f20-4ec5-9fbf-88a264324b8e admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:45.097970 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f3ac99-9f20-4ec5-9fbf-88a264324b8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:45.100577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f3ac99-9f20-4ec5-9fbf-88a264324b8e admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:45.131819 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1157/2330] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:19:44 2022] POST /identity/v3/users => generated 299 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:19:45.135513 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b60d9-2b4a-4931-8172-68f25919d413 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:45.137350 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0a6b60d9-2b4a-4931-8172-68f25919d413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:45.150870 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b60d9-2b4a-4931-8172-68f25919d413 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:45.155454 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68e393-371f-4fbd-bb04-b34788dcf6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:45.156198 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68e393-371f-4fbd-bb04-b34788dcf6ee admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:45.156480 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68e393-371f-4fbd-bb04-b34788dcf6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:45.156989 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68e393-371f-4fbd-bb04-b34788dcf6ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:45.158230 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68e393-371f-4fbd-bb04-b34788dcf6ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:45.160007 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68e393-371f-4fbd-bb04-b34788dcf6ee admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:45.170967 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1174/2331] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:19:45.175220 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3ac99-9f20-4ec5-9fbf-88a264324b8e admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:45.186213 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3ac99-9f20-4ec5-9fbf-88a264324b8e admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:45.192519 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8bb4cc-90d6-4a8d-b6cf-800f16a188c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:45.193374 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8bb4cc-90d6-4a8d-b6cf-800f16a188c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:45.193754 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8bb4cc-90d6-4a8d-b6cf-800f16a188c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:45.194157 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8bb4cc-90d6-4a8d-b6cf-800f16a188c3 admin admin] PATH_INFO: `/v3/projects/850e40e823c242388ae3ac053458bf28/users/19b0c8708dfe44b6a51d62a0b19a8728/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:45.210810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8bb4cc-90d6-4a8d-b6cf-800f16a188c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=850e40e823c242388ae3ac053458bf28, user_id=19b0c8708dfe44b6a51d62a0b19a8728, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:45.214074 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8bb4cc-90d6-4a8d-b6cf-800f16a188c3 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:45.229475 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1158/2332] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:19:45 2022] PUT /identity/v3/projects/850e40e823c242388ae3ac053458bf28/users/19b0c8708dfe44b6a51d62a0b19a8728/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:19:45.233062 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68e393-371f-4fbd-bb04-b34788dcf6ee admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:45.243238 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68e393-371f-4fbd-bb04-b34788dcf6ee admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:45.289284 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:45.331976 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500897a-01b7-44ef-ae1a-9e59430ad41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:45.332701 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500897a-01b7-44ef-ae1a-9e59430ad41b admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:45.333014 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500897a-01b7-44ef-ae1a-9e59430ad41b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:45.333286 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500897a-01b7-44ef-ae1a-9e59430ad41b admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:45.333944 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a500897a-01b7-44ef-ae1a-9e59430ad41b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:45.335726 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a500897a-01b7-44ef-ae1a-9e59430ad41b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:45.349740 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1175/2333] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:19:45.352085 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8bb4cc-90d6-4a8d-b6cf-800f16a188c3 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:45.365614 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8bb4cc-90d6-4a8d-b6cf-800f16a188c3 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:45.371070 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390daf2-eae1-4743-b5af-f17c5f756a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:45.371779 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390daf2-eae1-4743-b5af-f17c5f756a2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:45.372057 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390daf2-eae1-4743-b5af-f17c5f756a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:45.372326 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390daf2-eae1-4743-b5af-f17c5f756a2e admin admin] PATH_INFO: `/v3/projects/850e40e823c242388ae3ac053458bf28/users/19b0c8708dfe44b6a51d62a0b19a8728/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:45.374404 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b390daf2-eae1-4743-b5af-f17c5f756a2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=850e40e823c242388ae3ac053458bf28, user_id=19b0c8708dfe44b6a51d62a0b19a8728, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:45.377607 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b390daf2-eae1-4743-b5af-f17c5f756a2e admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:45.388750 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1159/2334] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:19:45 2022] PUT /identity/v3/projects/850e40e823c242388ae3ac053458bf28/users/19b0c8708dfe44b6a51d62a0b19a8728/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:19:50.655519 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d1622-bd1d-4461-92df-3797ccfa61f1 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:50.656088 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d1622-bd1d-4461-92df-3797ccfa61f1 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:50.657115 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d1622-bd1d-4461-92df-3797ccfa61f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:50.716618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-9f5d1622-bd1d-4461-92df-3797ccfa61f1 None None] MFA Rules not processed for user `19b0c8708dfe44b6a51d62a0b19a8728`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:50.717878 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9f5d1622-bd1d-4461-92df-3797ccfa61f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:50.848255 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1176/2335] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:19:50 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:50.864617 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390daf2-eae1-4743-b5af-f17c5f756a2e admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:50.866474 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-b390daf2-eae1-4743-b5af-f17c5f756a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:51.053953 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390daf2-eae1-4743-b5af-f17c5f756a2e admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:51.069073 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08328dc-2c16-44b0-b62f-5774092da6c0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '254dd957da6345f79bcab42b27b8d2cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:51.072911 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08328dc-2c16-44b0-b62f-5774092da6c0 service glance] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:51.075374 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08328dc-2c16-44b0-b62f-5774092da6c0 service glance] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:51.075870 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08328dc-2c16-44b0-b62f-5774092da6c0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:51.080141 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-b08328dc-2c16-44b0-b62f-5774092da6c0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:51.222514 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08328dc-2c16-44b0-b62f-5774092da6c0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:51.224631 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08328dc-2c16-44b0-b62f-5774092da6c0 service glance] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:51.244204 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1160/2336] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:19:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:19:51.384881 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b4694-9c42-43a7-b515-f72a0479a519 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:51.385389 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b4694-9c42-43a7-b515-f72a0479a519 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:51.385948 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b4694-9c42-43a7-b515-f72a0479a519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:51.407585 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-5c7b4694-9c42-43a7-b515-f72a0479a519 None None] MFA Rules not processed for user `3e070c93f47045ecb5bf0a1622395091`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:51.408997 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5c7b4694-9c42-43a7-b515-f72a0479a519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:51.525531 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1177/2337] 10.222.0.79 () {58 vars in 1009 bytes} [Wed Aug 31 19:19:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:51.552585 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08328dc-2c16-44b0-b62f-5774092da6c0 service glance] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:51.555508 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-b08328dc-2c16-44b0-b62f-5774092da6c0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:51.601598 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:51.648056 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08328dc-2c16-44b0-b62f-5774092da6c0 service glance] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:51.654642 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4e17d-d732-46f9-bc15-ad311a8ae1f5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b289a0bef53460ca5173ad946394d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:51.655099 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4e17d-d732-46f9-bc15-ad311a8ae1f5 service swift] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:51.655393 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4e17d-d732-46f9-bc15-ad311a8ae1f5 service swift] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:51.655677 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4e17d-d732-46f9-bc15-ad311a8ae1f5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:51.666443 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4e17d-d732-46f9-bc15-ad311a8ae1f5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:51.676048 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4e17d-d732-46f9-bc15-ad311a8ae1f5 service swift] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:51.694701 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1161/2338] 10.222.0.79 () {60 vars in 1384 bytes} [Wed Aug 31 19:19:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:19:56.773642 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db2d79-4a33-4cee-8eaf-2b302b0f3c39 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:56.774617 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db2d79-4a33-4cee-8eaf-2b302b0f3c39 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:56.775066 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db2d79-4a33-4cee-8eaf-2b302b0f3c39 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:56.777110 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1178/2339] 10.222.0.79 () {54 vars in 921 bytes} [Wed Aug 31 19:19:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:19:56.799446 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fb7bb-778c-4622-aebd-ea2230d1fe24 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:56.800029 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fb7bb-778c-4622-aebd-ea2230d1fe24 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:56.800029 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fb7bb-778c-4622-aebd-ea2230d1fe24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:56.831452 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-332fb7bb-778c-4622-aebd-ea2230d1fe24 None None] MFA Rules not processed for user `ece00ea631594381bf1c27cfc2ece6f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:56.834500 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-332fb7bb-778c-4622-aebd-ea2230d1fe24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:56.935203 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1162/2340] 10.222.0.79 () {58 vars in 1018 bytes} [Wed Aug 31 19:19:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:56.964433 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8affc524-549f-4752-9ecb-6390a1fc48c2 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:56.964715 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8affc524-549f-4752-9ecb-6390a1fc48c2 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:56.965159 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8affc524-549f-4752-9ecb-6390a1fc48c2 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:56.966506 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1179/2341] 10.222.0.79 () {54 vars in 961 bytes} [Wed Aug 31 19:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:19:56.973596 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756a770-29a8-426c-b899-a01eb314d6aa None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:56.974907 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756a770-29a8-426c-b899-a01eb314d6aa None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:56.975464 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756a770-29a8-426c-b899-a01eb314d6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:57.006430 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-9756a770-29a8-426c-b899-a01eb314d6aa None None] MFA Rules not processed for user `ece00ea631594381bf1c27cfc2ece6f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:57.008059 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-9756a770-29a8-426c-b899-a01eb314d6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:57.019146 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1163/2342] 10.222.0.79 () {58 vars in 1058 bytes} [Wed Aug 31 19:19:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:57.035671 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8affc524-549f-4752-9ecb-6390a1fc48c2 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:57.079424 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8affc524-549f-4752-9ecb-6390a1fc48c2 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:57.090272 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52eb3a-ec34-4dc2-bf13-72628f45c16f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece00ea631594381bf1c27cfc2ece6f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:57.090928 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52eb3a-ec34-4dc2-bf13-72628f45c16f service placement] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:57.091206 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52eb3a-ec34-4dc2-bf13-72628f45c16f service placement] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:57.091595 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52eb3a-ec34-4dc2-bf13-72628f45c16f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:57.107693 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52eb3a-ec34-4dc2-bf13-72628f45c16f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:57.109455 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52eb3a-ec34-4dc2-bf13-72628f45c16f service placement] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:57.140026 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1180/2343] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:19:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:19:57.916271 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756a770-29a8-426c-b899-a01eb314d6aa None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:57.917953 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-9756a770-29a8-426c-b899-a01eb314d6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:58.007375 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756a770-29a8-426c-b899-a01eb314d6aa None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:58.013707 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d80a2-fe0f-40ef-becf-c3692a692bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:58.014602 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d80a2-fe0f-40ef-becf-c3692a692bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:58.015067 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d80a2-fe0f-40ef-becf-c3692a692bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:58.015671 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d80a2-fe0f-40ef-becf-c3692a692bc9 admin admin] PATH_INFO: `/v3/users/a0bfacd81a184a74adbb16c80e722f33` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:58.017538 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d80a2-fe0f-40ef-becf-c3692a692bc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0bfacd81a184a74adbb16c80e722f33)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:58.022868 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d80a2-fe0f-40ef-becf-c3692a692bc9 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:58.109354 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-652d80a2-fe0f-40ef-becf-c3692a692bc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0bfacd81a184a74adbb16c80e722f33'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:58.110612 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-652d80a2-fe0f-40ef-becf-c3692a692bc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0bfacd81a184a74adbb16c80e722f33'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:58.112110 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:58.133506 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-652d80a2-fe0f-40ef-becf-c3692a692bc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0bfacd81a184a74adbb16c80e722f33'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:58.143277 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-652d80a2-fe0f-40ef-becf-c3692a692bc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0bfacd81a184a74adbb16c80e722f33'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:58.162206 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-652d80a2-fe0f-40ef-becf-c3692a692bc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0bfacd81a184a74adbb16c80e722f33'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:58.180034 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1164/2344] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:19:57 2022] DELETE /identity/v3/users/a0bfacd81a184a74adbb16c80e722f33 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:19:58.575226 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52eb3a-ec34-4dc2-bf13-72628f45c16f service placement] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:58.590136 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52eb3a-ec34-4dc2-bf13-72628f45c16f service placement] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:58.749382 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:58.781092 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c6325-524f-4026-ba7f-4509ea5c2e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:58.782970 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c6325-524f-4026-ba7f-4509ea5c2e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:58.783565 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c6325-524f-4026-ba7f-4509ea5c2e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:58.784011 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c6325-524f-4026-ba7f-4509ea5c2e6d admin admin] PATH_INFO: `/v3/projects/104882b16c3c4b60b745aaeb6e235210` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:58.787639 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c6325-524f-4026-ba7f-4509ea5c2e6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=104882b16c3c4b60b745aaeb6e235210)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:58.790293 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c6325-524f-4026-ba7f-4509ea5c2e6d admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:58.856450 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-054c6325-524f-4026-ba7f-4509ea5c2e6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '104882b16c3c4b60b745aaeb6e235210', 'request_id': 'req-054c6325-524f-4026-ba7f-4509ea5c2e6d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:58.866242 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-054c6325-524f-4026-ba7f-4509ea5c2e6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '104882b16c3c4b60b745aaeb6e235210', 'request_id': 'req-054c6325-524f-4026-ba7f-4509ea5c2e6d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:58.873728 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-054c6325-524f-4026-ba7f-4509ea5c2e6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '104882b16c3c4b60b745aaeb6e235210', 'request_id': 'req-054c6325-524f-4026-ba7f-4509ea5c2e6d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:58.898696 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-054c6325-524f-4026-ba7f-4509ea5c2e6d admin admin] The token cache is being invalidate because project 104882b16c3c4b60b745aaeb6e235210 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:19:58.899320 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-054c6325-524f-4026-ba7f-4509ea5c2e6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:58.900153 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-054c6325-524f-4026-ba7f-4509ea5c2e6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:58.901935 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1181/2345] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:19:58 2022] DELETE /identity/v3/projects/104882b16c3c4b60b745aaeb6e235210 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:19:58.905960 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d80a2-fe0f-40ef-becf-c3692a692bc9 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:58.907505 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-652d80a2-fe0f-40ef-becf-c3692a692bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:58.924613 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d80a2-fe0f-40ef-becf-c3692a692bc9 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:58.996781 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e614b-f3d8-43d2-8f5f-b50a703435ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:58.997607 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e614b-f3d8-43d2-8f5f-b50a703435ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:58.997983 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e614b-f3d8-43d2-8f5f-b50a703435ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:58.998355 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e614b-f3d8-43d2-8f5f-b50a703435ee admin admin] PATH_INFO: `/v3/users/71f09fcfc59e45b1b1f8901f648cdb5d` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:59.000017 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e614b-f3d8-43d2-8f5f-b50a703435ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=71f09fcfc59e45b1b1f8901f648cdb5d)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:59.002649 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e614b-f3d8-43d2-8f5f-b50a703435ee admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:59.103107 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-c40e614b-f3d8-43d2-8f5f-b50a703435ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71f09fcfc59e45b1b1f8901f648cdb5d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:59.107223 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-c40e614b-f3d8-43d2-8f5f-b50a703435ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71f09fcfc59e45b1b1f8901f648cdb5d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:59.137615 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-c40e614b-f3d8-43d2-8f5f-b50a703435ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71f09fcfc59e45b1b1f8901f648cdb5d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:59.139887 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-c40e614b-f3d8-43d2-8f5f-b50a703435ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71f09fcfc59e45b1b1f8901f648cdb5d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:59.156536 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-c40e614b-f3d8-43d2-8f5f-b50a703435ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71f09fcfc59e45b1b1f8901f648cdb5d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:59.164313 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1165/2346] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:19:58 2022] DELETE /identity/v3/users/71f09fcfc59e45b1b1f8901f648cdb5d => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:19:59.335923 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715fab2-633c-4182-b01b-a118d7bd86bd None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:59.336340 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715fab2-633c-4182-b01b-a118d7bd86bd None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:59.336714 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715fab2-633c-4182-b01b-a118d7bd86bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:59.360496 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-2715fab2-633c-4182-b01b-a118d7bd86bd None None] MFA Rules not processed for user `f8ae8fa948c34e75a7dec755f29d5c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:59.377420 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2715fab2-633c-4182-b01b-a118d7bd86bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:59.432873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e614b-f3d8-43d2-8f5f-b50a703435ee admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:59.435281 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-c40e614b-f3d8-43d2-8f5f-b50a703435ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:59.469519 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1182/2347] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:19:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:59.582932 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:59.616398 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e614b-f3d8-43d2-8f5f-b50a703435ee admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:59.624798 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd75eb-2c41-44dc-afb0-c87055f2640e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:59.626680 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd75eb-2c41-44dc-afb0-c87055f2640e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:59.627196 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd75eb-2c41-44dc-afb0-c87055f2640e admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:59.627694 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd75eb-2c41-44dc-afb0-c87055f2640e admin admin] PATH_INFO: `/v3/projects/38ad49e1bda548ea8f1fc07c074035fc` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:59.630710 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd75eb-2c41-44dc-afb0-c87055f2640e admin admin] RBAC: Authorizing `identity:delete_project(project_id=38ad49e1bda548ea8f1fc07c074035fc)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:59.634218 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd75eb-2c41-44dc-afb0-c87055f2640e admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:19:59.729315 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-62cd75eb-2c41-44dc-afb0-c87055f2640e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38ad49e1bda548ea8f1fc07c074035fc', 'request_id': 'req-62cd75eb-2c41-44dc-afb0-c87055f2640e'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:59.745636 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-62cd75eb-2c41-44dc-afb0-c87055f2640e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38ad49e1bda548ea8f1fc07c074035fc', 'request_id': 'req-62cd75eb-2c41-44dc-afb0-c87055f2640e'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:59.759240 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-62cd75eb-2c41-44dc-afb0-c87055f2640e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38ad49e1bda548ea8f1fc07c074035fc', 'request_id': 'req-62cd75eb-2c41-44dc-afb0-c87055f2640e'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:59.784504 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-62cd75eb-2c41-44dc-afb0-c87055f2640e admin admin] The token cache is being invalidate because project 38ad49e1bda548ea8f1fc07c074035fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:19:59.785003 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-62cd75eb-2c41-44dc-afb0-c87055f2640e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:59.786089 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-62cd75eb-2c41-44dc-afb0-c87055f2640e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:19:59.789183 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1166/2348] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:19:59 2022] DELETE /identity/v3/projects/38ad49e1bda548ea8f1fc07c074035fc => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:19:59.793807 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550324c0-f2ea-4618-82fe-295e8021cb42 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:59.794726 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550324c0-f2ea-4618-82fe-295e8021cb42 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:59.794726 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550324c0-f2ea-4618-82fe-295e8021cb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:59.820447 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-550324c0-f2ea-4618-82fe-295e8021cb42 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:59.821991 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-550324c0-f2ea-4618-82fe-295e8021cb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:59.917755 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1183/2349] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:19:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:19:59.925296 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd961564-77db-495c-9e99-0927c91aab56 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:59.926360 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd961564-77db-495c-9e99-0927c91aab56 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:59.926857 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd961564-77db-495c-9e99-0927c91aab56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:59.951443 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-cd961564-77db-495c-9e99-0927c91aab56 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:19:59.952896 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-cd961564-77db-495c-9e99-0927c91aab56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:19:59.962111 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1167/2350] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:19:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:19:59.967593 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550324c0-f2ea-4618-82fe-295e8021cb42 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:19:59.982525 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550324c0-f2ea-4618-82fe-295e8021cb42 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:19:59.989060 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e16b47-6d6f-4018-9564-1e6f0482d966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:19:59.989672 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e16b47-6d6f-4018-9564-1e6f0482d966 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:19:59.989948 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e16b47-6d6f-4018-9564-1e6f0482d966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:19:59.990408 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e16b47-6d6f-4018-9564-1e6f0482d966 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:19:59.991275 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e16b47-6d6f-4018-9564-1e6f0482d966 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:19:59.991708 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e16b47-6d6f-4018-9564-1e6f0482d966 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:19:59.993489 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e16b47-6d6f-4018-9564-1e6f0482d966 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:00.015196 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1184/2351] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:20:00.015555 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd961564-77db-495c-9e99-0927c91aab56 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:00.031357 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd961564-77db-495c-9e99-0927c91aab56 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:00.036982 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5d4d6-b873-405f-9dcc-f01cbf1b0294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:00.037326 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5d4d6-b873-405f-9dcc-f01cbf1b0294 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:00.037683 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5d4d6-b873-405f-9dcc-f01cbf1b0294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:00.038021 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5d4d6-b873-405f-9dcc-f01cbf1b0294 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:00.038757 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5d4d6-b873-405f-9dcc-f01cbf1b0294 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:00.040732 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5d4d6-b873-405f-9dcc-f01cbf1b0294 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:00.080525 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1168/2352] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:20:00 2022] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:20:00.086672 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e16b47-6d6f-4018-9564-1e6f0482d966 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:00.099012 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e16b47-6d6f-4018-9564-1e6f0482d966 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:00.103666 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:00.192598 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d330082b-f004-4a56-95dc-cebcfae5d5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:00.193188 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330082b-f004-4a56-95dc-cebcfae5d5ae admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:00.193574 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330082b-f004-4a56-95dc-cebcfae5d5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:00.193723 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330082b-f004-4a56-95dc-cebcfae5d5ae admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:00.194352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d330082b-f004-4a56-95dc-cebcfae5d5ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:00.196479 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d330082b-f004-4a56-95dc-cebcfae5d5ae admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:00.225895 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1185/2353] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:20:00 2022] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:20:00.230572 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5d4d6-b873-405f-9dcc-f01cbf1b0294 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:00.245472 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5d4d6-b873-405f-9dcc-f01cbf1b0294 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:00.251697 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf389c-95ea-4dc6-abec-200113bf5c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:00.252158 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf389c-95ea-4dc6-abec-200113bf5c0d admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:00.252611 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf389c-95ea-4dc6-abec-200113bf5c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:00.252953 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf389c-95ea-4dc6-abec-200113bf5c0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:00.253863 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf389c-95ea-4dc6-abec-200113bf5c0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:00.255627 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf389c-95ea-4dc6-abec-200113bf5c0d admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:00.273630 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1169/2354] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:20:00.277694 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d330082b-f004-4a56-95dc-cebcfae5d5ae admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:00.288595 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d330082b-f004-4a56-95dc-cebcfae5d5ae admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:00.296088 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddcb13e-9646-49fd-bc49-b05ab602c68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:00.296834 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddcb13e-9646-49fd-bc49-b05ab602c68b admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:00.298386 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddcb13e-9646-49fd-bc49-b05ab602c68b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:00.298751 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddcb13e-9646-49fd-bc49-b05ab602c68b admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:00.299526 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddcb13e-9646-49fd-bc49-b05ab602c68b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:00.301640 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddcb13e-9646-49fd-bc49-b05ab602c68b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:00.319385 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1186/2355] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:20:00.320903 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf389c-95ea-4dc6-abec-200113bf5c0d admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:00.348024 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf389c-95ea-4dc6-abec-200113bf5c0d admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:00.357711 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2952ea7-c1d7-420f-b10a-bea66e9adad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:00.361290 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2952ea7-c1d7-420f-b10a-bea66e9adad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:00.361848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2952ea7-c1d7-420f-b10a-bea66e9adad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:00.362340 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2952ea7-c1d7-420f-b10a-bea66e9adad9 admin admin] PATH_INFO: `/v3/projects/6ea5d74efc2c44b2b9efb65f4e160532/users/d762e2c2f5ff4019a43bc9fb511efcb9/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:00.385259 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2952ea7-c1d7-420f-b10a-bea66e9adad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ea5d74efc2c44b2b9efb65f4e160532, user_id=d762e2c2f5ff4019a43bc9fb511efcb9, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:00.389027 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2952ea7-c1d7-420f-b10a-bea66e9adad9 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:00.414395 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1170/2356] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:20:00 2022] PUT /identity/v3/projects/6ea5d74efc2c44b2b9efb65f4e160532/users/d762e2c2f5ff4019a43bc9fb511efcb9/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:20:00.427565 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5cab7-4f01-4f49-8742-485a53488596 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:00.428103 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5cab7-4f01-4f49-8742-485a53488596 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:00.428651 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5cab7-4f01-4f49-8742-485a53488596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:00.461633 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-7ba5cab7-4f01-4f49-8742-485a53488596 None None] MFA Rules not processed for user `d762e2c2f5ff4019a43bc9fb511efcb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:20:00.463135 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7ba5cab7-4f01-4f49-8742-485a53488596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:00.589697 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1187/2357] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:20:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:20:00.590899 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2952ea7-c1d7-420f-b10a-bea66e9adad9 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:00.717242 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2952ea7-c1d7-420f-b10a-bea66e9adad9 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:00.725773 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3b22d-69fe-4fa2-9d65-637f187fa092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:00.725773 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3b22d-69fe-4fa2-9d65-637f187fa092 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:00.725773 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3b22d-69fe-4fa2-9d65-637f187fa092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:00.725773 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3b22d-69fe-4fa2-9d65-637f187fa092 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:00.726234 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f3b22d-69fe-4fa2-9d65-637f187fa092 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:00.727281 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f3b22d-69fe-4fa2-9d65-637f187fa092 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:00.745390 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:00.764516 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1171/2358] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:20:00 2022] POST /identity/v3/projects => generated 385 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:20:00.765082 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5cab7-4f01-4f49-8742-485a53488596 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:00.778631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5cab7-4f01-4f49-8742-485a53488596 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:00.863035 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05fac1-aba3-49de-84cd-2de202101eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:00.864563 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05fac1-aba3-49de-84cd-2de202101eab admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:00.865029 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05fac1-aba3-49de-84cd-2de202101eab admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:00.865648 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05fac1-aba3-49de-84cd-2de202101eab admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:00.867163 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f05fac1-aba3-49de-84cd-2de202101eab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:00.869372 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f05fac1-aba3-49de-84cd-2de202101eab admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:00.903678 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1188/2359] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:20:00 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:20:00.908189 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3b22d-69fe-4fa2-9d65-637f187fa092 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:00.923457 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3b22d-69fe-4fa2-9d65-637f187fa092 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:00.935531 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e6837-7d9b-4344-96e3-e24f38ed9072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:00.936802 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e6837-7d9b-4344-96e3-e24f38ed9072 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:00.937304 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e6837-7d9b-4344-96e3-e24f38ed9072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:00.937856 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e6837-7d9b-4344-96e3-e24f38ed9072 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:00.939437 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e6837-7d9b-4344-96e3-e24f38ed9072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:00.941644 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e6837-7d9b-4344-96e3-e24f38ed9072 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:00.956062 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1172/2360] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:20:00.960227 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05fac1-aba3-49de-84cd-2de202101eab admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:00.967797 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:00.975337 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05fac1-aba3-49de-84cd-2de202101eab admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:00.986369 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946a7e4-4aec-40eb-98ea-0cb2ab27be84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:00.988269 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946a7e4-4aec-40eb-98ea-0cb2ab27be84 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:00.988615 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946a7e4-4aec-40eb-98ea-0cb2ab27be84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:00.988893 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946a7e4-4aec-40eb-98ea-0cb2ab27be84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:00.989554 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2946a7e4-4aec-40eb-98ea-0cb2ab27be84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:00.992212 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2946a7e4-4aec-40eb-98ea-0cb2ab27be84 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:01.009303 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1189/2361] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:20:01.014258 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e6837-7d9b-4344-96e3-e24f38ed9072 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:01.026102 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e6837-7d9b-4344-96e3-e24f38ed9072 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:01.031107 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4516ee-bf81-4bd5-8117-5074e0acb58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:01.031998 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4516ee-bf81-4bd5-8117-5074e0acb58b admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:01.032456 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4516ee-bf81-4bd5-8117-5074e0acb58b admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:01.032734 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4516ee-bf81-4bd5-8117-5074e0acb58b admin admin] PATH_INFO: `/v3/projects/63592e12d8c44d459cbdae2539b6dcfb/users/dcc1ff4d6f8a4eb28ce49b3a202467fb/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:01.056868 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4516ee-bf81-4bd5-8117-5074e0acb58b admin admin] RBAC: Authorizing `identity:create_grant(project_id=63592e12d8c44d459cbdae2539b6dcfb, user_id=dcc1ff4d6f8a4eb28ce49b3a202467fb, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:01.059732 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4516ee-bf81-4bd5-8117-5074e0acb58b admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:01.078272 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1173/2362] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:20:01 2022] PUT /identity/v3/projects/63592e12d8c44d459cbdae2539b6dcfb/users/dcc1ff4d6f8a4eb28ce49b3a202467fb/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:20:01.090272 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4896ecc-1a1c-476c-8f4c-4562714ce230 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:01.093396 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4896ecc-1a1c-476c-8f4c-4562714ce230 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:01.094263 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4896ecc-1a1c-476c-8f4c-4562714ce230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:01.132416 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-c4896ecc-1a1c-476c-8f4c-4562714ce230 None None] MFA Rules not processed for user `dcc1ff4d6f8a4eb28ce49b3a202467fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:20:01.133799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c4896ecc-1a1c-476c-8f4c-4562714ce230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:01.236548 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1190/2363] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:20:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:20:01.241176 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4516ee-bf81-4bd5-8117-5074e0acb58b admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:01.342355 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4516ee-bf81-4bd5-8117-5074e0acb58b admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:01.348708 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349902bf-f200-4d2e-a43e-64fbeff98888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:01.349525 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349902bf-f200-4d2e-a43e-64fbeff98888 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:01.349909 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349902bf-f200-4d2e-a43e-64fbeff98888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:01.352367 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349902bf-f200-4d2e-a43e-64fbeff98888 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:01.353168 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349902bf-f200-4d2e-a43e-64fbeff98888 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:01.355229 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349902bf-f200-4d2e-a43e-64fbeff98888 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:01.396848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1174/2364] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:20:01 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:20:01.398112 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4896ecc-1a1c-476c-8f4c-4562714ce230 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:01.412493 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4896ecc-1a1c-476c-8f4c-4562714ce230 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:01.494130 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d451e81a-c375-46e3-b191-0b8abf7845ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:01.494748 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451e81a-c375-46e3-b191-0b8abf7845ed admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:01.495019 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451e81a-c375-46e3-b191-0b8abf7845ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:01.495296 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451e81a-c375-46e3-b191-0b8abf7845ed admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:01.495943 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d451e81a-c375-46e3-b191-0b8abf7845ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:01.498047 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d451e81a-c375-46e3-b191-0b8abf7845ed admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:01.540283 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1191/2365] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:20:01 2022] POST /identity/v3/users => generated 299 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:20:01.541078 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349902bf-f200-4d2e-a43e-64fbeff98888 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:01.552753 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349902bf-f200-4d2e-a43e-64fbeff98888 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:01.557896 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74834c1a-e2d3-4bd3-9e74-4c3af3d4ad32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:01.558531 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74834c1a-e2d3-4bd3-9e74-4c3af3d4ad32 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:01.560876 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74834c1a-e2d3-4bd3-9e74-4c3af3d4ad32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:01.560876 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74834c1a-e2d3-4bd3-9e74-4c3af3d4ad32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:01.560876 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74834c1a-e2d3-4bd3-9e74-4c3af3d4ad32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:01.561432 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74834c1a-e2d3-4bd3-9e74-4c3af3d4ad32 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:01.572973 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1175/2366] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:20:01.578848 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d451e81a-c375-46e3-b191-0b8abf7845ed admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:01.590244 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d451e81a-c375-46e3-b191-0b8abf7845ed admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:01.596405 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b924e7-c822-4eaf-b7a9-67a3e3b7417b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:01.597083 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b924e7-c822-4eaf-b7a9-67a3e3b7417b admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:01.597364 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b924e7-c822-4eaf-b7a9-67a3e3b7417b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:01.597639 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b924e7-c822-4eaf-b7a9-67a3e3b7417b admin admin] PATH_INFO: `/v3/projects/6576c420e377421d834db62fe6f9cd4d/users/7ea13910dd884bfea5e09de264a4bfbf/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:01.619191 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b924e7-c822-4eaf-b7a9-67a3e3b7417b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6576c420e377421d834db62fe6f9cd4d, user_id=7ea13910dd884bfea5e09de264a4bfbf, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:01.621828 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b924e7-c822-4eaf-b7a9-67a3e3b7417b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:01.637198 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1192/2367] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:20:01 2022] PUT /identity/v3/projects/6576c420e377421d834db62fe6f9cd4d/users/7ea13910dd884bfea5e09de264a4bfbf/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:20:01.642325 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74834c1a-e2d3-4bd3-9e74-4c3af3d4ad32 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:01.652924 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74834c1a-e2d3-4bd3-9e74-4c3af3d4ad32 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:01.724679 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc595b63-32d3-4499-b935-dbb04b21a191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:01.725314 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc595b63-32d3-4499-b935-dbb04b21a191 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:01.725594 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc595b63-32d3-4499-b935-dbb04b21a191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:01.725862 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc595b63-32d3-4499-b935-dbb04b21a191 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:01.726537 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc595b63-32d3-4499-b935-dbb04b21a191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:01.728193 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc595b63-32d3-4499-b935-dbb04b21a191 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:01.739458 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1176/2368] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:20:01.743330 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b924e7-c822-4eaf-b7a9-67a3e3b7417b admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:01.754223 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b924e7-c822-4eaf-b7a9-67a3e3b7417b admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:01.761402 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b977b09-6acc-45ca-97c0-02c39bd63f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:01.762077 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b977b09-6acc-45ca-97c0-02c39bd63f4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:01.762494 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b977b09-6acc-45ca-97c0-02c39bd63f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:01.762777 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b977b09-6acc-45ca-97c0-02c39bd63f4e admin admin] PATH_INFO: `/v3/projects/6576c420e377421d834db62fe6f9cd4d/users/7ea13910dd884bfea5e09de264a4bfbf/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:01.764917 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b977b09-6acc-45ca-97c0-02c39bd63f4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6576c420e377421d834db62fe6f9cd4d, user_id=7ea13910dd884bfea5e09de264a4bfbf, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:01.768249 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b977b09-6acc-45ca-97c0-02c39bd63f4e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:01.780836 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1193/2369] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:20:01 2022] PUT /identity/v3/projects/6576c420e377421d834db62fe6f9cd4d/users/7ea13910dd884bfea5e09de264a4bfbf/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:20:01.791795 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f3628-f73d-4020-825f-e1ccdbdd19ed None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:01.792082 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f3628-f73d-4020-825f-e1ccdbdd19ed None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:01.792356 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f3628-f73d-4020-825f-e1ccdbdd19ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:01.847601 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-df6f3628-f73d-4020-825f-e1ccdbdd19ed None None] MFA Rules not processed for user `7ea13910dd884bfea5e09de264a4bfbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:20:01.848848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-df6f3628-f73d-4020-825f-e1ccdbdd19ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:01.873600 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:01.947041 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1177/2370] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:20:01 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:20:01.958475 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b977b09-6acc-45ca-97c0-02c39bd63f4e admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:01.967135 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0b977b09-6acc-45ca-97c0-02c39bd63f4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:02.073441 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:02.112796 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b977b09-6acc-45ca-97c0-02c39bd63f4e admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:02.117400 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e4280-7a09-4eb2-affe-25968e92bad7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:02.118900 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e4280-7a09-4eb2-affe-25968e92bad7 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:02.119344 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e4280-7a09-4eb2-affe-25968e92bad7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:02.119754 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e4280-7a09-4eb2-affe-25968e92bad7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:02.198659 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9e4280-7a09-4eb2-affe-25968e92bad7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:02.200439 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9e4280-7a09-4eb2-affe-25968e92bad7 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:02.214866 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1194/2371] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:20:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:20:04.059946 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f3628-f73d-4020-825f-e1ccdbdd19ed None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:04.074083 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f3628-f73d-4020-825f-e1ccdbdd19ed None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:04.081033 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dcf5ca-08e3-440b-8bdb-9d9285b388e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:04.082685 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dcf5ca-08e3-440b-8bdb-9d9285b388e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:04.083175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dcf5ca-08e3-440b-8bdb-9d9285b388e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:04.083634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dcf5ca-08e3-440b-8bdb-9d9285b388e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:04.174485 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dcf5ca-08e3-440b-8bdb-9d9285b388e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:04.176064 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dcf5ca-08e3-440b-8bdb-9d9285b388e7 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:04.201718 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1178/2372] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:20:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:20:04.225168 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d5b46-2d30-4284-b314-5d100eb9e6b9 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:04.225751 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d5b46-2d30-4284-b314-5d100eb9e6b9 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:04.225751 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d5b46-2d30-4284-b314-5d100eb9e6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:04.247491 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-462d5b46-2d30-4284-b314-5d100eb9e6b9 None None] MFA Rules not processed for user `25dc9e2a730f4d63828ddb059d15d5d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:20:04.249090 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-462d5b46-2d30-4284-b314-5d100eb9e6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:04.390375 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1195/2373] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:20:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:20:05.078386 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dcf5ca-08e3-440b-8bdb-9d9285b388e7 service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:05.088916 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dcf5ca-08e3-440b-8bdb-9d9285b388e7 service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:05.096462 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676f69b-b871-43aa-9935-652a974eaf90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:05.097130 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676f69b-b871-43aa-9935-652a974eaf90 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:05.097408 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676f69b-b871-43aa-9935-652a974eaf90 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:05.097673 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676f69b-b871-43aa-9935-652a974eaf90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:05.110675 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b676f69b-b871-43aa-9935-652a974eaf90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:05.113234 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b676f69b-b871-43aa-9935-652a974eaf90 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:05.134930 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1179/2374] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:20:05 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:20:09.065901 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d5b46-2d30-4284-b314-5d100eb9e6b9 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:09.154276 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d5b46-2d30-4284-b314-5d100eb9e6b9 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:09.163409 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeaef22-2028-4971-af83-20db2d68e085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:09.164408 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeaef22-2028-4971-af83-20db2d68e085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:09.164831 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeaef22-2028-4971-af83-20db2d68e085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:09.165102 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeaef22-2028-4971-af83-20db2d68e085 admin admin] PATH_INFO: `/v3/users/d762e2c2f5ff4019a43bc9fb511efcb9` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:09.166398 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeaef22-2028-4971-af83-20db2d68e085 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d762e2c2f5ff4019a43bc9fb511efcb9)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:09.168445 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeaef22-2028-4971-af83-20db2d68e085 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:09.223196 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:09.234869 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-bdeaef22-2028-4971-af83-20db2d68e085 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd762e2c2f5ff4019a43bc9fb511efcb9'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:09.249043 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-bdeaef22-2028-4971-af83-20db2d68e085 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd762e2c2f5ff4019a43bc9fb511efcb9'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:09.262024 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-bdeaef22-2028-4971-af83-20db2d68e085 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd762e2c2f5ff4019a43bc9fb511efcb9'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:09.277437 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-bdeaef22-2028-4971-af83-20db2d68e085 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd762e2c2f5ff4019a43bc9fb511efcb9'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:09.278224 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-bdeaef22-2028-4971-af83-20db2d68e085 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd762e2c2f5ff4019a43bc9fb511efcb9'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:09.284736 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1196/2375] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:20:09 2022] DELETE /identity/v3/users/d762e2c2f5ff4019a43bc9fb511efcb9 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:20:09.289311 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcf87a-1052-4a07-b71c-96f93bc99009 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:09.290144 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcf87a-1052-4a07-b71c-96f93bc99009 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:09.290745 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcf87a-1052-4a07-b71c-96f93bc99009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:09.321571 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-82dcf87a-1052-4a07-b71c-96f93bc99009 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:20:09.323261 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-82dcf87a-1052-4a07-b71c-96f93bc99009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:09.386261 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1180/2376] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:20:09.395903 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeaef22-2028-4971-af83-20db2d68e085 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:09.397368 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-bdeaef22-2028-4971-af83-20db2d68e085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:09.456483 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeaef22-2028-4971-af83-20db2d68e085 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:09.460081 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a34423-4d26-479b-8e41-7c36dac3f1a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:09.460712 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a34423-4d26-479b-8e41-7c36dac3f1a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:09.460988 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a34423-4d26-479b-8e41-7c36dac3f1a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:09.461253 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a34423-4d26-479b-8e41-7c36dac3f1a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:09.470826 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a34423-4d26-479b-8e41-7c36dac3f1a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:09.472247 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a34423-4d26-479b-8e41-7c36dac3f1a6 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:09.481340 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1197/2377] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:20:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:20:09.783122 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dcf87a-1052-4a07-b71c-96f93bc99009 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:09.785145 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-82dcf87a-1052-4a07-b71c-96f93bc99009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:09.797344 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dcf87a-1052-4a07-b71c-96f93bc99009 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:09.802233 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d2d3b-c134-4b3f-aefa-5390ce1d22c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:09.802929 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d2d3b-c134-4b3f-aefa-5390ce1d22c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:09.803264 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d2d3b-c134-4b3f-aefa-5390ce1d22c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:09.803555 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d2d3b-c134-4b3f-aefa-5390ce1d22c3 admin admin] PATH_INFO: `/v3/projects/6ea5d74efc2c44b2b9efb65f4e160532` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:09.804865 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819d2d3b-c134-4b3f-aefa-5390ce1d22c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ea5d74efc2c44b2b9efb65f4e160532)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:09.807667 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819d2d3b-c134-4b3f-aefa-5390ce1d22c3 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:09.850812 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:09.862155 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-819d2d3b-c134-4b3f-aefa-5390ce1d22c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ea5d74efc2c44b2b9efb65f4e160532', 'request_id': 'req-819d2d3b-c134-4b3f-aefa-5390ce1d22c3'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:09.868318 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-819d2d3b-c134-4b3f-aefa-5390ce1d22c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ea5d74efc2c44b2b9efb65f4e160532', 'request_id': 'req-819d2d3b-c134-4b3f-aefa-5390ce1d22c3'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:09.874570 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-819d2d3b-c134-4b3f-aefa-5390ce1d22c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ea5d74efc2c44b2b9efb65f4e160532', 'request_id': 'req-819d2d3b-c134-4b3f-aefa-5390ce1d22c3'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:09.888675 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-819d2d3b-c134-4b3f-aefa-5390ce1d22c3 admin admin] The token cache is being invalidate because project 6ea5d74efc2c44b2b9efb65f4e160532 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:20:09.888971 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-819d2d3b-c134-4b3f-aefa-5390ce1d22c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:09.889605 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-819d2d3b-c134-4b3f-aefa-5390ce1d22c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:09.891158 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1181/2378] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:20:09 2022] DELETE /identity/v3/projects/6ea5d74efc2c44b2b9efb65f4e160532 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:20:09.895680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a34423-4d26-479b-8e41-7c36dac3f1a6 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:09.905204 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a34423-4d26-479b-8e41-7c36dac3f1a6 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:09.999710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485da9f-f438-45d7-bd55-aa7f5c952e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:10.000519 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485da9f-f438-45d7-bd55-aa7f5c952e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:10.000789 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485da9f-f438-45d7-bd55-aa7f5c952e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:10.001158 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485da9f-f438-45d7-bd55-aa7f5c952e0f admin admin] PATH_INFO: `/v3/users/dcc1ff4d6f8a4eb28ce49b3a202467fb` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:10.002324 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b485da9f-f438-45d7-bd55-aa7f5c952e0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcc1ff4d6f8a4eb28ce49b3a202467fb)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:10.004518 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b485da9f-f438-45d7-bd55-aa7f5c952e0f admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:10.070806 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-b485da9f-f438-45d7-bd55-aa7f5c952e0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcc1ff4d6f8a4eb28ce49b3a202467fb'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:10.099010 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-b485da9f-f438-45d7-bd55-aa7f5c952e0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcc1ff4d6f8a4eb28ce49b3a202467fb'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:10.110089 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:10.120962 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-b485da9f-f438-45d7-bd55-aa7f5c952e0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcc1ff4d6f8a4eb28ce49b3a202467fb'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:10.144938 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-b485da9f-f438-45d7-bd55-aa7f5c952e0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcc1ff4d6f8a4eb28ce49b3a202467fb'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:10.146680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-b485da9f-f438-45d7-bd55-aa7f5c952e0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcc1ff4d6f8a4eb28ce49b3a202467fb'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:10.154971 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1198/2379] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:20:09 2022] DELETE /identity/v3/users/dcc1ff4d6f8a4eb28ce49b3a202467fb => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:20:10.414503 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d18a07-928e-4c2f-bc2a-e8ed52b208cc None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:10.415021 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d18a07-928e-4c2f-bc2a-e8ed52b208cc None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:10.415021 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d18a07-928e-4c2f-bc2a-e8ed52b208cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:10.445108 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-c2d18a07-928e-4c2f-bc2a-e8ed52b208cc None None] MFA Rules not processed for user `3e070c93f47045ecb5bf0a1622395091`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:20:10.447369 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-c2d18a07-928e-4c2f-bc2a-e8ed52b208cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:10.544578 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1182/2380] 10.222.0.79 () {58 vars in 1009 bytes} [Wed Aug 31 19:20:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:20:10.573456 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485da9f-f438-45d7-bd55-aa7f5c952e0f admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:10.575023 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b485da9f-f438-45d7-bd55-aa7f5c952e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:10.729976 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485da9f-f438-45d7-bd55-aa7f5c952e0f admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:10.744699 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8af9d-1e98-4f12-860f-b350b813ba8c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b289a0bef53460ca5173ad946394d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:10.745679 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8af9d-1e98-4f12-860f-b350b813ba8c service swift] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:10.746165 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8af9d-1e98-4f12-860f-b350b813ba8c service swift] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:10.746707 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8af9d-1e98-4f12-860f-b350b813ba8c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:10.766790 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed8af9d-1e98-4f12-860f-b350b813ba8c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:10.769070 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed8af9d-1e98-4f12-860f-b350b813ba8c service swift] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:10.789178 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1199/2381] 10.222.0.79 () {60 vars in 1384 bytes} [Wed Aug 31 19:20:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:20:11.142719 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d18a07-928e-4c2f-bc2a-e8ed52b208cc None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:11.145003 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-c2d18a07-928e-4c2f-bc2a-e8ed52b208cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:11.311303 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d18a07-928e-4c2f-bc2a-e8ed52b208cc None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:11.324526 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440c586-edd3-4ee3-8602-f5e00c25c220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:11.325197 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440c586-edd3-4ee3-8602-f5e00c25c220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:11.325795 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440c586-edd3-4ee3-8602-f5e00c25c220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:11.326571 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440c586-edd3-4ee3-8602-f5e00c25c220 admin admin] PATH_INFO: `/v3/projects/63592e12d8c44d459cbdae2539b6dcfb` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:11.328327 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1440c586-edd3-4ee3-8602-f5e00c25c220 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63592e12d8c44d459cbdae2539b6dcfb)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:11.330647 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1440c586-edd3-4ee3-8602-f5e00c25c220 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:11.485430 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1440c586-edd3-4ee3-8602-f5e00c25c220 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63592e12d8c44d459cbdae2539b6dcfb', 'request_id': 'req-1440c586-edd3-4ee3-8602-f5e00c25c220'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:11.493016 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1440c586-edd3-4ee3-8602-f5e00c25c220 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63592e12d8c44d459cbdae2539b6dcfb', 'request_id': 'req-1440c586-edd3-4ee3-8602-f5e00c25c220'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:11.500787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1440c586-edd3-4ee3-8602-f5e00c25c220 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63592e12d8c44d459cbdae2539b6dcfb', 'request_id': 'req-1440c586-edd3-4ee3-8602-f5e00c25c220'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:11.515763 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:11.522698 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1440c586-edd3-4ee3-8602-f5e00c25c220 admin admin] The token cache is being invalidate because project 63592e12d8c44d459cbdae2539b6dcfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:20:11.523394 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1440c586-edd3-4ee3-8602-f5e00c25c220 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:11.525326 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1440c586-edd3-4ee3-8602-f5e00c25c220 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:11.530450 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1183/2382] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:20:11 2022] DELETE /identity/v3/projects/63592e12d8c44d459cbdae2539b6dcfb => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:20:11.531676 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8af9d-1e98-4f12-860f-b350b813ba8c service swift] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:11.551640 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8af9d-1e98-4f12-860f-b350b813ba8c service swift] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:11.634850 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630660a-03aa-457c-8c8a-5d50f636fc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:11.635653 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630660a-03aa-457c-8c8a-5d50f636fc8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:11.635940 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630660a-03aa-457c-8c8a-5d50f636fc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:11.636213 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630660a-03aa-457c-8c8a-5d50f636fc8b admin admin] PATH_INFO: `/v3/users/7ea13910dd884bfea5e09de264a4bfbf` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:11.637562 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9630660a-03aa-457c-8c8a-5d50f636fc8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ea13910dd884bfea5e09de264a4bfbf)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:11.640002 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9630660a-03aa-457c-8c8a-5d50f636fc8b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:11.736014 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9630660a-03aa-457c-8c8a-5d50f636fc8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ea13910dd884bfea5e09de264a4bfbf'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:11.746155 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9630660a-03aa-457c-8c8a-5d50f636fc8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ea13910dd884bfea5e09de264a4bfbf'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:11.754492 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9630660a-03aa-457c-8c8a-5d50f636fc8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ea13910dd884bfea5e09de264a4bfbf'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:11.759011 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:11.781963 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9630660a-03aa-457c-8c8a-5d50f636fc8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ea13910dd884bfea5e09de264a4bfbf'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:11.783063 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9630660a-03aa-457c-8c8a-5d50f636fc8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ea13910dd884bfea5e09de264a4bfbf'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:11.791445 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1200/2383] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:20:11 2022] DELETE /identity/v3/users/7ea13910dd884bfea5e09de264a4bfbf => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:20:12.359010 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440c586-edd3-4ee3-8602-f5e00c25c220 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:12.360522 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1440c586-edd3-4ee3-8602-f5e00c25c220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:12.397802 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440c586-edd3-4ee3-8602-f5e00c25c220 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:12.489308 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df15e45-5e99-4bf1-b499-922d8c533bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:12.490031 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df15e45-5e99-4bf1-b499-922d8c533bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:12.490285 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df15e45-5e99-4bf1-b499-922d8c533bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:12.490600 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df15e45-5e99-4bf1-b499-922d8c533bf8 admin admin] PATH_INFO: `/v3/projects/6576c420e377421d834db62fe6f9cd4d` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:12.491724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df15e45-5e99-4bf1-b499-922d8c533bf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6576c420e377421d834db62fe6f9cd4d)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:12.493663 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df15e45-5e99-4bf1-b499-922d8c533bf8 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:12.550824 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-5df15e45-5e99-4bf1-b499-922d8c533bf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6576c420e377421d834db62fe6f9cd4d', 'request_id': 'req-5df15e45-5e99-4bf1-b499-922d8c533bf8'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:12.560803 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-5df15e45-5e99-4bf1-b499-922d8c533bf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6576c420e377421d834db62fe6f9cd4d', 'request_id': 'req-5df15e45-5e99-4bf1-b499-922d8c533bf8'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:12.569490 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-5df15e45-5e99-4bf1-b499-922d8c533bf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6576c420e377421d834db62fe6f9cd4d', 'request_id': 'req-5df15e45-5e99-4bf1-b499-922d8c533bf8'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:12.584786 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-5df15e45-5e99-4bf1-b499-922d8c533bf8 admin admin] The token cache is being invalidate because project 6576c420e377421d834db62fe6f9cd4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:20:12.585175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-5df15e45-5e99-4bf1-b499-922d8c533bf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:12.585906 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-5df15e45-5e99-4bf1-b499-922d8c533bf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:12.587724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1184/2384] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:20:12 2022] DELETE /identity/v3/projects/6576c420e377421d834db62fe6f9cd4d => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:20:12.592625 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bb29f-f409-4063-ba6b-3277e3e2b60d None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:12.593137 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bb29f-f409-4063-ba6b-3277e3e2b60d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:12.593242 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bb29f-f409-4063-ba6b-3277e3e2b60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:12.617038 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-819bb29f-f409-4063-ba6b-3277e3e2b60d None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:20:12.618692 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-819bb29f-f409-4063-ba6b-3277e3e2b60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:12.688145 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1201/2385] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:20:12.697337 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efd86e-e67d-47d2-beee-614d802e521c None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:12.697619 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efd86e-e67d-47d2-beee-614d802e521c None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:12.697921 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efd86e-e67d-47d2-beee-614d802e521c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:12.717775 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-64efd86e-e67d-47d2-beee-614d802e521c None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:20:12.718921 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-64efd86e-e67d-47d2-beee-614d802e521c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:12.727243 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1185/2386] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:20:12.731449 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bb29f-f409-4063-ba6b-3277e3e2b60d None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:12.741836 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bb29f-f409-4063-ba6b-3277e3e2b60d None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:12.746905 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d27b4-56ce-4927-869e-6565e64e52ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:12.747509 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d27b4-56ce-4927-869e-6565e64e52ff admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:12.747818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d27b4-56ce-4927-869e-6565e64e52ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:12.748092 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d27b4-56ce-4927-869e-6565e64e52ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:12.748770 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d27b4-56ce-4927-869e-6565e64e52ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:20:12.749304 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d27b4-56ce-4927-869e-6565e64e52ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:12.750809 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d27b4-56ce-4927-869e-6565e64e52ff admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:12.766517 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1202/2387] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:20:12.770152 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efd86e-e67d-47d2-beee-614d802e521c None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:12.779970 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efd86e-e67d-47d2-beee-614d802e521c None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:12.784825 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa8018-d0bc-41bd-807d-5ab6be3d304e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:12.785434 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa8018-d0bc-41bd-807d-5ab6be3d304e admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:12.785712 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa8018-d0bc-41bd-807d-5ab6be3d304e admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:12.785984 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa8018-d0bc-41bd-807d-5ab6be3d304e admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:12.786659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aa8018-d0bc-41bd-807d-5ab6be3d304e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:12.788572 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aa8018-d0bc-41bd-807d-5ab6be3d304e admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:12.819581 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1186/2388] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:20:12 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:20:12.823802 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d27b4-56ce-4927-869e-6565e64e52ff admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:12.834041 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d27b4-56ce-4927-869e-6565e64e52ff admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:12.891681 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b27ea1-ba2e-4e64-9729-e4c165de6da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:12.892325 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b27ea1-ba2e-4e64-9729-e4c165de6da1 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:12.892599 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b27ea1-ba2e-4e64-9729-e4c165de6da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:12.892897 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b27ea1-ba2e-4e64-9729-e4c165de6da1 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:12.893569 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b27ea1-ba2e-4e64-9729-e4c165de6da1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:12.895533 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b27ea1-ba2e-4e64-9729-e4c165de6da1 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:12.919776 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1203/2389] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:20:12 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:20:12.923493 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa8018-d0bc-41bd-807d-5ab6be3d304e admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:12.936268 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa8018-d0bc-41bd-807d-5ab6be3d304e admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:12.942994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8941d53-595b-4926-a916-2df7eb5f397f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:12.943779 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8941d53-595b-4926-a916-2df7eb5f397f admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:12.944132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8941d53-595b-4926-a916-2df7eb5f397f admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:12.944567 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8941d53-595b-4926-a916-2df7eb5f397f admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:12.945402 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8941d53-595b-4926-a916-2df7eb5f397f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:12.947368 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8941d53-595b-4926-a916-2df7eb5f397f admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:12.971175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1187/2390] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:20:12.972877 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b27ea1-ba2e-4e64-9729-e4c165de6da1 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:12.986014 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b27ea1-ba2e-4e64-9729-e4c165de6da1 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:12.992724 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cea4cc-3183-4c4d-a18e-157e695d43ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:12.993655 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cea4cc-3183-4c4d-a18e-157e695d43ba admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:12.993936 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cea4cc-3183-4c4d-a18e-157e695d43ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:12.994313 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cea4cc-3183-4c4d-a18e-157e695d43ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:12.995000 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cea4cc-3183-4c4d-a18e-157e695d43ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:12.996612 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cea4cc-3183-4c4d-a18e-157e695d43ba admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:13.014044 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1204/2391] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:20:13.015376 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8941d53-595b-4926-a916-2df7eb5f397f admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:13.027707 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8941d53-595b-4926-a916-2df7eb5f397f admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:13.032869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af13139-f931-438f-963b-12bd5c3b5167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:13.033634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af13139-f931-438f-963b-12bd5c3b5167 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:13.034736 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af13139-f931-438f-963b-12bd5c3b5167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:13.035011 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af13139-f931-438f-963b-12bd5c3b5167 admin admin] PATH_INFO: `/v3/projects/50f670c3ed074a20a0a8cbd8a79b7518/users/522c94f5d2a3441c91f0afcf8db74d28/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:13.057757 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af13139-f931-438f-963b-12bd5c3b5167 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50f670c3ed074a20a0a8cbd8a79b7518, user_id=522c94f5d2a3441c91f0afcf8db74d28, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:13.060450 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af13139-f931-438f-963b-12bd5c3b5167 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:13.088097 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1188/2392] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:20:13 2022] PUT /identity/v3/projects/50f670c3ed074a20a0a8cbd8a79b7518/users/522c94f5d2a3441c91f0afcf8db74d28/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:20:13.099157 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c37b2-9239-4d8d-ad81-356af02e3f9f None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:13.099439 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c37b2-9239-4d8d-ad81-356af02e3f9f None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:13.099719 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c37b2-9239-4d8d-ad81-356af02e3f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:13.136871 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-6f4c37b2-9239-4d8d-ad81-356af02e3f9f None None] MFA Rules not processed for user `522c94f5d2a3441c91f0afcf8db74d28`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:20:13.138182 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6f4c37b2-9239-4d8d-ad81-356af02e3f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:13.210375 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:13.243326 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1205/2393] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:20:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:20:13.247815 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af13139-f931-438f-963b-12bd5c3b5167 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:13.359760 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:13.481912 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af13139-f931-438f-963b-12bd5c3b5167 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:13.487494 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3f695-d43d-47f0-a6b9-5354515ff158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:13.488119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3f695-d43d-47f0-a6b9-5354515ff158 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:13.488404 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3f695-d43d-47f0-a6b9-5354515ff158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:13.488674 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3f695-d43d-47f0-a6b9-5354515ff158 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:13.489329 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e3f695-d43d-47f0-a6b9-5354515ff158 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:13.491348 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e3f695-d43d-47f0-a6b9-5354515ff158 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:13.550855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1189/2394] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:20:13 2022] POST /identity/v3/projects => generated 385 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:20:13.555091 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c37b2-9239-4d8d-ad81-356af02e3f9f None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:13.569314 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c37b2-9239-4d8d-ad81-356af02e3f9f None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:13.641381 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2cb8fe-84df-4bd7-bf56-95eb84239b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:13.642155 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2cb8fe-84df-4bd7-bf56-95eb84239b42 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:13.642594 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2cb8fe-84df-4bd7-bf56-95eb84239b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:13.642871 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2cb8fe-84df-4bd7-bf56-95eb84239b42 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:13.643553 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2cb8fe-84df-4bd7-bf56-95eb84239b42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:13.645679 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2cb8fe-84df-4bd7-bf56-95eb84239b42 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:13.678212 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1206/2395] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:20:13 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:20:13.679779 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3f695-d43d-47f0-a6b9-5354515ff158 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:13.691047 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3f695-d43d-47f0-a6b9-5354515ff158 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:13.696449 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76036d2f-a91f-4eb2-a533-06f2718d7472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:13.697059 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76036d2f-a91f-4eb2-a533-06f2718d7472 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:13.697342 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76036d2f-a91f-4eb2-a533-06f2718d7472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:13.697614 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76036d2f-a91f-4eb2-a533-06f2718d7472 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:13.698265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76036d2f-a91f-4eb2-a533-06f2718d7472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:13.700120 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76036d2f-a91f-4eb2-a533-06f2718d7472 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:13.713874 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1190/2396] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:20:13.718100 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2cb8fe-84df-4bd7-bf56-95eb84239b42 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:13.729167 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2cb8fe-84df-4bd7-bf56-95eb84239b42 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:13.734911 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95142779-6dbc-42a5-bccb-52cb3c510076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:13.735560 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95142779-6dbc-42a5-bccb-52cb3c510076 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:13.735822 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95142779-6dbc-42a5-bccb-52cb3c510076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:13.736089 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95142779-6dbc-42a5-bccb-52cb3c510076 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:13.736817 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95142779-6dbc-42a5-bccb-52cb3c510076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:13.738982 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95142779-6dbc-42a5-bccb-52cb3c510076 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:13.750429 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1207/2397] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:20:13.755092 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76036d2f-a91f-4eb2-a533-06f2718d7472 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:13.766029 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76036d2f-a91f-4eb2-a533-06f2718d7472 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:13.770865 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463817f9-48e1-48a6-8f05-8b6921369442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:13.771526 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463817f9-48e1-48a6-8f05-8b6921369442 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:13.771801 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463817f9-48e1-48a6-8f05-8b6921369442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:13.772069 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463817f9-48e1-48a6-8f05-8b6921369442 admin admin] PATH_INFO: `/v3/projects/b26ca76405584d2a98ff125405a060a8/users/d85ba052df4445a2a3ac8b38c021cdc7/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:13.789453 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463817f9-48e1-48a6-8f05-8b6921369442 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b26ca76405584d2a98ff125405a060a8, user_id=d85ba052df4445a2a3ac8b38c021cdc7, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:13.792221 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463817f9-48e1-48a6-8f05-8b6921369442 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:13.808071 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1191/2398] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:20:13 2022] PUT /identity/v3/projects/b26ca76405584d2a98ff125405a060a8/users/d85ba052df4445a2a3ac8b38c021cdc7/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:20:13.819299 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c554893-a02f-4d41-b70e-e75222061864 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:13.819641 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c554893-a02f-4d41-b70e-e75222061864 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:13.819916 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c554893-a02f-4d41-b70e-e75222061864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:13.864099 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-8c554893-a02f-4d41-b70e-e75222061864 None None] MFA Rules not processed for user `d85ba052df4445a2a3ac8b38c021cdc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:20:13.865314 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8c554893-a02f-4d41-b70e-e75222061864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:13.931643 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1208/2399] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:20:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:20:13.936145 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463817f9-48e1-48a6-8f05-8b6921369442 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:14.006551 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463817f9-48e1-48a6-8f05-8b6921369442 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:14.011513 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe7ccd-4825-4086-bf07-520885cb1528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:14.012119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe7ccd-4825-4086-bf07-520885cb1528 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:14.012401 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe7ccd-4825-4086-bf07-520885cb1528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:14.012677 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe7ccd-4825-4086-bf07-520885cb1528 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:14.013324 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfe7ccd-4825-4086-bf07-520885cb1528 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:14.015518 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfe7ccd-4825-4086-bf07-520885cb1528 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:14.044724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1192/2400] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:20:13 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:20:14.049037 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c554893-a02f-4d41-b70e-e75222061864 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:14.060642 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c554893-a02f-4d41-b70e-e75222061864 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:14.106930 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:14.120655 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084743d-bc62-4d0b-bb3c-15e1d6e84eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:14.121268 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084743d-bc62-4d0b-bb3c-15e1d6e84eb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:14.121544 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084743d-bc62-4d0b-bb3c-15e1d6e84eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:14.121812 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084743d-bc62-4d0b-bb3c-15e1d6e84eb8 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:14.122484 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084743d-bc62-4d0b-bb3c-15e1d6e84eb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:14.124394 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084743d-bc62-4d0b-bb3c-15e1d6e84eb8 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:14.147474 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1209/2401] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:20:14 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:20:14.151544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe7ccd-4825-4086-bf07-520885cb1528 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:14.162886 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe7ccd-4825-4086-bf07-520885cb1528 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:14.167834 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfde1cb-4d21-4e46-8567-6028298e1fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:14.168527 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfde1cb-4d21-4e46-8567-6028298e1fbf admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:14.168812 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfde1cb-4d21-4e46-8567-6028298e1fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:14.169088 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfde1cb-4d21-4e46-8567-6028298e1fbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:14.169824 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfde1cb-4d21-4e46-8567-6028298e1fbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:14.171512 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfde1cb-4d21-4e46-8567-6028298e1fbf admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:14.182865 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1193/2402] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:20:14.187091 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084743d-bc62-4d0b-bb3c-15e1d6e84eb8 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:14.197053 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084743d-bc62-4d0b-bb3c-15e1d6e84eb8 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:14.201645 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881364ed-9db3-4ed6-a03f-d1aa1dea4926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:14.202292 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881364ed-9db3-4ed6-a03f-d1aa1dea4926 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:14.202601 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881364ed-9db3-4ed6-a03f-d1aa1dea4926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:14.202871 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881364ed-9db3-4ed6-a03f-d1aa1dea4926 admin admin] PATH_INFO: `/v3/projects/4ae825fe19d044589eb6d902137a1372/users/aea4fabb4ec64a23a1e326919edf8297/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:14.221913 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881364ed-9db3-4ed6-a03f-d1aa1dea4926 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ae825fe19d044589eb6d902137a1372, user_id=aea4fabb4ec64a23a1e326919edf8297, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:14.225127 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881364ed-9db3-4ed6-a03f-d1aa1dea4926 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:14.243909 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1210/2403] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:20:14 2022] PUT /identity/v3/projects/4ae825fe19d044589eb6d902137a1372/users/aea4fabb4ec64a23a1e326919edf8297/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:20:14.247761 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfde1cb-4d21-4e46-8567-6028298e1fbf admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:14.259755 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfde1cb-4d21-4e46-8567-6028298e1fbf admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:14.316469 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:14.333684 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc7ac0-1462-4113-803e-f6428bca52d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:14.335279 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc7ac0-1462-4113-803e-f6428bca52d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:14.335786 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc7ac0-1462-4113-803e-f6428bca52d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:14.336504 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc7ac0-1462-4113-803e-f6428bca52d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:14.337461 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc7ac0-1462-4113-803e-f6428bca52d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:14.339884 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc7ac0-1462-4113-803e-f6428bca52d5 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:14.359743 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1194/2404] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:20:14.376167 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881364ed-9db3-4ed6-a03f-d1aa1dea4926 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:14.390050 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881364ed-9db3-4ed6-a03f-d1aa1dea4926 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:14.395866 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad2070-3594-4860-8058-806f5419866b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:14.396900 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad2070-3594-4860-8058-806f5419866b admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:14.397189 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad2070-3594-4860-8058-806f5419866b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:14.397484 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad2070-3594-4860-8058-806f5419866b admin admin] PATH_INFO: `/v3/projects/4ae825fe19d044589eb6d902137a1372/users/aea4fabb4ec64a23a1e326919edf8297/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:14.399608 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad2070-3594-4860-8058-806f5419866b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ae825fe19d044589eb6d902137a1372, user_id=aea4fabb4ec64a23a1e326919edf8297, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:14.402332 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad2070-3594-4860-8058-806f5419866b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:14.416930 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1211/2405] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:20:14 2022] PUT /identity/v3/projects/4ae825fe19d044589eb6d902137a1372/users/aea4fabb4ec64a23a1e326919edf8297/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:20:14.486893 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233bde0-9a6f-4682-9133-cc77fcaddd75 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:14.487843 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233bde0-9a6f-4682-9133-cc77fcaddd75 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:14.488218 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233bde0-9a6f-4682-9133-cc77fcaddd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:14.518246 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-2233bde0-9a6f-4682-9133-cc77fcaddd75 None None] MFA Rules not processed for user `aea4fabb4ec64a23a1e326919edf8297`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:20:14.519440 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-2233bde0-9a6f-4682-9133-cc77fcaddd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:14.620573 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1195/2406] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:20:14 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:20:14.633199 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad2070-3594-4860-8058-806f5419866b admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:14.635042 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9dad2070-3594-4860-8058-806f5419866b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:14.729985 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad2070-3594-4860-8058-806f5419866b admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:14.734990 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0d6eb-53f4-4e1f-a3bf-2b8bf75a7167 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:14.735624 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0d6eb-53f4-4e1f-a3bf-2b8bf75a7167 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:14.735906 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0d6eb-53f4-4e1f-a3bf-2b8bf75a7167 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:14.736180 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0d6eb-53f4-4e1f-a3bf-2b8bf75a7167 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:14.812443 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0d6eb-53f4-4e1f-a3bf-2b8bf75a7167 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:14.813804 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0d6eb-53f4-4e1f-a3bf-2b8bf75a7167 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:14.841728 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1212/2407] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:20:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:20:16.462815 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233bde0-9a6f-4682-9133-cc77fcaddd75 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:16.464416 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-2233bde0-9a6f-4682-9133-cc77fcaddd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:16.477295 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233bde0-9a6f-4682-9133-cc77fcaddd75 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:16.481123 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46933917-e578-4003-8d1a-08a855a59dac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:16.481721 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46933917-e578-4003-8d1a-08a855a59dac service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:16.482112 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46933917-e578-4003-8d1a-08a855a59dac service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:16.482421 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46933917-e578-4003-8d1a-08a855a59dac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:16.567876 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46933917-e578-4003-8d1a-08a855a59dac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:16.569226 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46933917-e578-4003-8d1a-08a855a59dac service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:16.579030 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1196/2408] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:20:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:20:17.350719 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0d6eb-53f4-4e1f-a3bf-2b8bf75a7167 service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:17.360368 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0d6eb-53f4-4e1f-a3bf-2b8bf75a7167 service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:17.384943 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587afd6-5fcb-4f6b-86b5-23c326baf45d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:17.385551 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587afd6-5fcb-4f6b-86b5-23c326baf45d service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:17.385838 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587afd6-5fcb-4f6b-86b5-23c326baf45d service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:17.386107 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587afd6-5fcb-4f6b-86b5-23c326baf45d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:17.409202 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8587afd6-5fcb-4f6b-86b5-23c326baf45d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:17.411211 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8587afd6-5fcb-4f6b-86b5-23c326baf45d service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:17.466947 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1213/2409] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:20:17 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:20:21.666000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46933917-e578-4003-8d1a-08a855a59dac service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:21.738181 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46933917-e578-4003-8d1a-08a855a59dac service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:21.743271 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a091504e-53ce-4c84-822e-3980e4f90570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:21.744077 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091504e-53ce-4c84-822e-3980e4f90570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:21.745599 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091504e-53ce-4c84-822e-3980e4f90570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:21.745599 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091504e-53ce-4c84-822e-3980e4f90570 admin admin] PATH_INFO: `/v3/users/522c94f5d2a3441c91f0afcf8db74d28` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:21.746555 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a091504e-53ce-4c84-822e-3980e4f90570 admin admin] RBAC: Authorizing `identity:delete_user(user_id=522c94f5d2a3441c91f0afcf8db74d28)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:21.748633 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a091504e-53ce-4c84-822e-3980e4f90570 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:21.765250 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:21.806326 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a091504e-53ce-4c84-822e-3980e4f90570 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '522c94f5d2a3441c91f0afcf8db74d28'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:21.807244 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a091504e-53ce-4c84-822e-3980e4f90570 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '522c94f5d2a3441c91f0afcf8db74d28'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:21.825999 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a091504e-53ce-4c84-822e-3980e4f90570 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '522c94f5d2a3441c91f0afcf8db74d28'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:21.835018 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a091504e-53ce-4c84-822e-3980e4f90570 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '522c94f5d2a3441c91f0afcf8db74d28'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:21.845004 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a091504e-53ce-4c84-822e-3980e4f90570 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '522c94f5d2a3441c91f0afcf8db74d28'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:21.852914 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1197/2410] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:20:21 2022] DELETE /identity/v3/users/522c94f5d2a3441c91f0afcf8db74d28 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:20:21.857518 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23562f38-f107-4409-a397-51813dfdee8b None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:21.858060 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23562f38-f107-4409-a397-51813dfdee8b None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:21.858368 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23562f38-f107-4409-a397-51813dfdee8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:21.879738 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-23562f38-f107-4409-a397-51813dfdee8b None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:20:21.881044 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-23562f38-f107-4409-a397-51813dfdee8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:21.921395 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:21.947548 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1214/2411] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:20:21.957850 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a091504e-53ce-4c84-822e-3980e4f90570 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:21.959419 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-a091504e-53ce-4c84-822e-3980e4f90570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:22.020531 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a091504e-53ce-4c84-822e-3980e4f90570 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:22.024228 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742bd63-282b-4e41-97b6-c3dcbd896df7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:22.024850 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742bd63-282b-4e41-97b6-c3dcbd896df7 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:22.025118 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742bd63-282b-4e41-97b6-c3dcbd896df7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:22.025382 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742bd63-282b-4e41-97b6-c3dcbd896df7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:22.035377 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742bd63-282b-4e41-97b6-c3dcbd896df7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:22.036916 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742bd63-282b-4e41-97b6-c3dcbd896df7 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:22.047161 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1198/2412] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:20:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:20:22.415654 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23562f38-f107-4409-a397-51813dfdee8b None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:22.417129 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-23562f38-f107-4409-a397-51813dfdee8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:22.439940 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23562f38-f107-4409-a397-51813dfdee8b None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:22.447220 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32fea6a-af56-4237-b6c3-eafc66f0b00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:22.449563 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fea6a-af56-4237-b6c3-eafc66f0b00a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:22.450130 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fea6a-af56-4237-b6c3-eafc66f0b00a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:22.450664 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fea6a-af56-4237-b6c3-eafc66f0b00a admin admin] PATH_INFO: `/v3/projects/50f670c3ed074a20a0a8cbd8a79b7518` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:22.452970 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32fea6a-af56-4237-b6c3-eafc66f0b00a admin admin] RBAC: Authorizing `identity:delete_project(project_id=50f670c3ed074a20a0a8cbd8a79b7518)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:22.455309 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32fea6a-af56-4237-b6c3-eafc66f0b00a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:22.511585 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d32fea6a-af56-4237-b6c3-eafc66f0b00a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50f670c3ed074a20a0a8cbd8a79b7518', 'request_id': 'req-d32fea6a-af56-4237-b6c3-eafc66f0b00a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:22.517667 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d32fea6a-af56-4237-b6c3-eafc66f0b00a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50f670c3ed074a20a0a8cbd8a79b7518', 'request_id': 'req-d32fea6a-af56-4237-b6c3-eafc66f0b00a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:22.524456 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d32fea6a-af56-4237-b6c3-eafc66f0b00a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50f670c3ed074a20a0a8cbd8a79b7518', 'request_id': 'req-d32fea6a-af56-4237-b6c3-eafc66f0b00a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:22.546631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d32fea6a-af56-4237-b6c3-eafc66f0b00a admin admin] The token cache is being invalidate because project 50f670c3ed074a20a0a8cbd8a79b7518 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:20:22.546922 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d32fea6a-af56-4237-b6c3-eafc66f0b00a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:22.547704 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d32fea6a-af56-4237-b6c3-eafc66f0b00a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:22.549473 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1215/2413] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:20:22 2022] DELETE /identity/v3/projects/50f670c3ed074a20a0a8cbd8a79b7518 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:20:22.553580 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742bd63-282b-4e41-97b6-c3dcbd896df7 service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:22.563244 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742bd63-282b-4e41-97b6-c3dcbd896df7 service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:22.629092 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a1474-fb54-4e7e-adc0-3bf422abda17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:22.629732 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a1474-fb54-4e7e-adc0-3bf422abda17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:22.630016 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a1474-fb54-4e7e-adc0-3bf422abda17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:22.630292 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a1474-fb54-4e7e-adc0-3bf422abda17 admin admin] PATH_INFO: `/v3/users/d85ba052df4445a2a3ac8b38c021cdc7` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:22.631473 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a1474-fb54-4e7e-adc0-3bf422abda17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d85ba052df4445a2a3ac8b38c021cdc7)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:22.633613 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a1474-fb54-4e7e-adc0-3bf422abda17 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:22.682728 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:22.698394 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d94a1474-fb54-4e7e-adc0-3bf422abda17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd85ba052df4445a2a3ac8b38c021cdc7'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:22.699498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d94a1474-fb54-4e7e-adc0-3bf422abda17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd85ba052df4445a2a3ac8b38c021cdc7'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:22.713245 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d94a1474-fb54-4e7e-adc0-3bf422abda17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd85ba052df4445a2a3ac8b38c021cdc7'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:22.723752 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d94a1474-fb54-4e7e-adc0-3bf422abda17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd85ba052df4445a2a3ac8b38c021cdc7'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:22.734312 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d94a1474-fb54-4e7e-adc0-3bf422abda17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd85ba052df4445a2a3ac8b38c021cdc7'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:22.742043 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1199/2414] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:20:22 2022] DELETE /identity/v3/users/d85ba052df4445a2a3ac8b38c021cdc7 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:20:23.056922 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32fea6a-af56-4237-b6c3-eafc66f0b00a admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:23.058510 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d32fea6a-af56-4237-b6c3-eafc66f0b00a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:23.072280 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32fea6a-af56-4237-b6c3-eafc66f0b00a admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:23.134641 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a514a907-9f33-44c7-804e-3f2fb329089a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:23.135878 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514a907-9f33-44c7-804e-3f2fb329089a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:23.135878 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514a907-9f33-44c7-804e-3f2fb329089a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:23.135878 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514a907-9f33-44c7-804e-3f2fb329089a admin admin] PATH_INFO: `/v3/projects/b26ca76405584d2a98ff125405a060a8` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:23.137026 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a514a907-9f33-44c7-804e-3f2fb329089a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b26ca76405584d2a98ff125405a060a8)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:23.139070 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a514a907-9f33-44c7-804e-3f2fb329089a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:23.220565 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a514a907-9f33-44c7-804e-3f2fb329089a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b26ca76405584d2a98ff125405a060a8', 'request_id': 'req-a514a907-9f33-44c7-804e-3f2fb329089a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:23.227522 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a514a907-9f33-44c7-804e-3f2fb329089a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b26ca76405584d2a98ff125405a060a8', 'request_id': 'req-a514a907-9f33-44c7-804e-3f2fb329089a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:23.235119 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a514a907-9f33-44c7-804e-3f2fb329089a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b26ca76405584d2a98ff125405a060a8', 'request_id': 'req-a514a907-9f33-44c7-804e-3f2fb329089a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:23.241137 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:23.259819 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a514a907-9f33-44c7-804e-3f2fb329089a admin admin] The token cache is being invalidate because project b26ca76405584d2a98ff125405a060a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:20:23.260510 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a514a907-9f33-44c7-804e-3f2fb329089a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:23.261690 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a514a907-9f33-44c7-804e-3f2fb329089a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:23.263930 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1216/2415] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:20:23 2022] DELETE /identity/v3/projects/b26ca76405584d2a98ff125405a060a8 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:20:23.269903 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a1474-fb54-4e7e-adc0-3bf422abda17 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:23.271851 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d94a1474-fb54-4e7e-adc0-3bf422abda17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:23.292211 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a1474-fb54-4e7e-adc0-3bf422abda17 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:23.377302 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf678353-62ef-41f2-8bc8-2ff0c46eb860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:23.379221 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf678353-62ef-41f2-8bc8-2ff0c46eb860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:23.379510 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf678353-62ef-41f2-8bc8-2ff0c46eb860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:23.379784 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf678353-62ef-41f2-8bc8-2ff0c46eb860 admin admin] PATH_INFO: `/v3/users/aea4fabb4ec64a23a1e326919edf8297` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:23.382630 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf678353-62ef-41f2-8bc8-2ff0c46eb860 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aea4fabb4ec64a23a1e326919edf8297)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:23.384590 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf678353-62ef-41f2-8bc8-2ff0c46eb860 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:23.444409 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-bf678353-62ef-41f2-8bc8-2ff0c46eb860 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aea4fabb4ec64a23a1e326919edf8297'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:23.445445 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-bf678353-62ef-41f2-8bc8-2ff0c46eb860 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aea4fabb4ec64a23a1e326919edf8297'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:23.469569 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-bf678353-62ef-41f2-8bc8-2ff0c46eb860 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aea4fabb4ec64a23a1e326919edf8297'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:23.484171 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-bf678353-62ef-41f2-8bc8-2ff0c46eb860 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aea4fabb4ec64a23a1e326919edf8297'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:23.498570 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-bf678353-62ef-41f2-8bc8-2ff0c46eb860 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aea4fabb4ec64a23a1e326919edf8297'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:23.515697 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1200/2416] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:20:23 2022] DELETE /identity/v3/users/aea4fabb4ec64a23a1e326919edf8297 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:20:23.941036 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a514a907-9f33-44c7-804e-3f2fb329089a admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:23.943132 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a514a907-9f33-44c7-804e-3f2fb329089a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:23.958576 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a514a907-9f33-44c7-804e-3f2fb329089a admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:24.037168 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50dae1-cf63-488f-a578-44edf4614866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:24.037828 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50dae1-cf63-488f-a578-44edf4614866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:24.038105 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50dae1-cf63-488f-a578-44edf4614866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:24.038374 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50dae1-cf63-488f-a578-44edf4614866 admin admin] PATH_INFO: `/v3/projects/4ae825fe19d044589eb6d902137a1372` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:24.040097 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50dae1-cf63-488f-a578-44edf4614866 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ae825fe19d044589eb6d902137a1372)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:24.042108 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50dae1-cf63-488f-a578-44edf4614866 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:24.087989 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-fd50dae1-cf63-488f-a578-44edf4614866 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ae825fe19d044589eb6d902137a1372', 'request_id': 'req-fd50dae1-cf63-488f-a578-44edf4614866'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:24.093845 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-fd50dae1-cf63-488f-a578-44edf4614866 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ae825fe19d044589eb6d902137a1372', 'request_id': 'req-fd50dae1-cf63-488f-a578-44edf4614866'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:24.100760 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-fd50dae1-cf63-488f-a578-44edf4614866 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ae825fe19d044589eb6d902137a1372', 'request_id': 'req-fd50dae1-cf63-488f-a578-44edf4614866'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:24.115293 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-fd50dae1-cf63-488f-a578-44edf4614866 admin admin] The token cache is being invalidate because project 4ae825fe19d044589eb6d902137a1372 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:20:24.115582 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-fd50dae1-cf63-488f-a578-44edf4614866 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:24.116212 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-fd50dae1-cf63-488f-a578-44edf4614866 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:20:24.117760 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1217/2417] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:20:23 2022] DELETE /identity/v3/projects/4ae825fe19d044589eb6d902137a1372 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:20:24.122640 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dada14b-a3a5-4c53-ba9e-5c806c2f749d None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:24.123128 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dada14b-a3a5-4c53-ba9e-5c806c2f749d None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:24.123364 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dada14b-a3a5-4c53-ba9e-5c806c2f749d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:24.144608 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-2dada14b-a3a5-4c53-ba9e-5c806c2f749d None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:20:24.145865 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-2dada14b-a3a5-4c53-ba9e-5c806c2f749d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:24.171515 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:24.204982 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1201/2418] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:20:24.213213 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7efd5-813f-42c6-bba2-c612ccb99ffa None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:24.213496 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7efd5-813f-42c6-bba2-c612ccb99ffa None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:24.213770 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7efd5-813f-42c6-bba2-c612ccb99ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:24.234116 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-c0e7efd5-813f-42c6-bba2-c612ccb99ffa None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:20:24.235325 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c0e7efd5-813f-42c6-bba2-c612ccb99ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:24.243409 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1218/2419] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:20:24.247496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dada14b-a3a5-4c53-ba9e-5c806c2f749d None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:24.257492 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dada14b-a3a5-4c53-ba9e-5c806c2f749d None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:24.262256 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c290e-e2ec-4ca9-b418-2955963ec4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:24.262960 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c290e-e2ec-4ca9-b418-2955963ec4c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:24.263194 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c290e-e2ec-4ca9-b418-2955963ec4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:24.263468 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c290e-e2ec-4ca9-b418-2955963ec4c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:24.264165 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c290e-e2ec-4ca9-b418-2955963ec4c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:20:24.264469 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c290e-e2ec-4ca9-b418-2955963ec4c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:24.266159 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c290e-e2ec-4ca9-b418-2955963ec4c4 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:24.279015 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1202/2420] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:20:24.283172 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7efd5-813f-42c6-bba2-c612ccb99ffa None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:24.294888 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7efd5-813f-42c6-bba2-c612ccb99ffa None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:24.299631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392226ff-01dc-48cb-acd7-2aa2310fd0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:24.300230 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392226ff-01dc-48cb-acd7-2aa2310fd0a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:24.300505 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392226ff-01dc-48cb-acd7-2aa2310fd0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:24.300775 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392226ff-01dc-48cb-acd7-2aa2310fd0a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:24.301402 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392226ff-01dc-48cb-acd7-2aa2310fd0a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:24.303323 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392226ff-01dc-48cb-acd7-2aa2310fd0a9 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:24.333073 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1219/2421] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:20:24 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:20:24.337314 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c290e-e2ec-4ca9-b418-2955963ec4c4 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:24.348541 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c290e-e2ec-4ca9-b418-2955963ec4c4 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:24.409105 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c83d4b-9783-4006-b180-c4abb2a82267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:24.409726 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c83d4b-9783-4006-b180-c4abb2a82267 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:24.410007 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c83d4b-9783-4006-b180-c4abb2a82267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:24.410282 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c83d4b-9783-4006-b180-c4abb2a82267 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:24.410958 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c83d4b-9783-4006-b180-c4abb2a82267 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:24.412913 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c83d4b-9783-4006-b180-c4abb2a82267 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:24.439308 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1203/2422] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:20:24 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:20:24.441048 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392226ff-01dc-48cb-acd7-2aa2310fd0a9 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:24.451835 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392226ff-01dc-48cb-acd7-2aa2310fd0a9 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:24.457478 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a9985-20ae-414a-8b3a-56585bd10e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:24.458238 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a9985-20ae-414a-8b3a-56585bd10e0d admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:24.458551 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a9985-20ae-414a-8b3a-56585bd10e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:24.458826 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a9985-20ae-414a-8b3a-56585bd10e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:24.459703 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a9985-20ae-414a-8b3a-56585bd10e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:24.461080 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a9985-20ae-414a-8b3a-56585bd10e0d admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:24.475154 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1220/2423] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:20:24.476578 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c83d4b-9783-4006-b180-c4abb2a82267 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:24.487198 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c83d4b-9783-4006-b180-c4abb2a82267 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:24.497539 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb75cc4-de71-4913-a8bc-d0f6e05eacfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:24.498175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb75cc4-de71-4913-a8bc-d0f6e05eacfc admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:24.498488 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb75cc4-de71-4913-a8bc-d0f6e05eacfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:24.498759 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb75cc4-de71-4913-a8bc-d0f6e05eacfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:24.499413 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb75cc4-de71-4913-a8bc-d0f6e05eacfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:24.501042 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb75cc4-de71-4913-a8bc-d0f6e05eacfc admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:24.513411 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1204/2424] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:20:24.523069 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a9985-20ae-414a-8b3a-56585bd10e0d admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:24.533500 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a9985-20ae-414a-8b3a-56585bd10e0d admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:24.538918 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421c216-6cc5-4d4a-9515-a694b4d004df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:24.539586 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421c216-6cc5-4d4a-9515-a694b4d004df admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:24.539951 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421c216-6cc5-4d4a-9515-a694b4d004df admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:24.540153 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421c216-6cc5-4d4a-9515-a694b4d004df admin admin] PATH_INFO: `/v3/projects/ca1cf82f7462464ab8a1e48f1dd5cb79/users/5ad940c7dac94eb19868935052dc5939/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:24.555631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421c216-6cc5-4d4a-9515-a694b4d004df admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca1cf82f7462464ab8a1e48f1dd5cb79, user_id=5ad940c7dac94eb19868935052dc5939, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:24.558296 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421c216-6cc5-4d4a-9515-a694b4d004df admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:24.573990 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1221/2425] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:20:24 2022] PUT /identity/v3/projects/ca1cf82f7462464ab8a1e48f1dd5cb79/users/5ad940c7dac94eb19868935052dc5939/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:20:24.579011 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f43722-a5e5-489f-a787-b6a2915335f1 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:24.579404 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f43722-a5e5-489f-a787-b6a2915335f1 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:24.579785 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f43722-a5e5-489f-a787-b6a2915335f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:24.602529 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-a8f43722-a5e5-489f-a787-b6a2915335f1 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:20:24.603942 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-a8f43722-a5e5-489f-a787-b6a2915335f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:24.678691 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1205/2426] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:20:24.685574 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421c216-6cc5-4d4a-9515-a694b4d004df admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:24.688774 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4421c216-6cc5-4d4a-9515-a694b4d004df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:24.723772 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:24.769737 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421c216-6cc5-4d4a-9515-a694b4d004df admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:24.773424 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fb130-29b0-4749-b517-90fe0197d868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:24.774055 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fb130-29b0-4749-b517-90fe0197d868 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:24.774334 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fb130-29b0-4749-b517-90fe0197d868 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:24.774646 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fb130-29b0-4749-b517-90fe0197d868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:24.784888 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38fb130-29b0-4749-b517-90fe0197d868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:24.786396 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38fb130-29b0-4749-b517-90fe0197d868 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:24.796994 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1222/2427] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:20:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:20:25.578218 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625505db-a39b-4dea-9dfa-72a94964b341 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:25.579137 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625505db-a39b-4dea-9dfa-72a94964b341 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:25.579590 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625505db-a39b-4dea-9dfa-72a94964b341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:25.613849 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-625505db-a39b-4dea-9dfa-72a94964b341 None None] MFA Rules not processed for user `5ad940c7dac94eb19868935052dc5939`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:20:25.615155 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-625505db-a39b-4dea-9dfa-72a94964b341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:25.645238 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:25.693546 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1206/2428] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:20:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:20:25.704546 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fb130-29b0-4749-b517-90fe0197d868 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:25.706142 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d38fb130-29b0-4749-b517-90fe0197d868 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:25.766952 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fb130-29b0-4749-b517-90fe0197d868 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:25.771677 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef4f4b5-e47a-4ad4-a85f-54398d3bcec9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:25.772301 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4f4b5-e47a-4ad4-a85f-54398d3bcec9 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:25.772582 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4f4b5-e47a-4ad4-a85f-54398d3bcec9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:25.772898 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4f4b5-e47a-4ad4-a85f-54398d3bcec9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:25.784000 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef4f4b5-e47a-4ad4-a85f-54398d3bcec9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:25.785366 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef4f4b5-e47a-4ad4-a85f-54398d3bcec9 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:25.795324 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1223/2429] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:20:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:20:27.242159 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c07a76-b728-4600-8fcc-80e03aaa3210 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:27.242714 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c07a76-b728-4600-8fcc-80e03aaa3210 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:27.242714 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c07a76-b728-4600-8fcc-80e03aaa3210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:27.262194 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-69c07a76-b728-4600-8fcc-80e03aaa3210 None None] MFA Rules not processed for user `5ad940c7dac94eb19868935052dc5939`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:20:27.263433 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-69c07a76-b728-4600-8fcc-80e03aaa3210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:27.271303 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1207/2430] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:20:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:20:30.018214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb44788-1230-4f12-ae88-c7054122bd76 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:30.019482 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb44788-1230-4f12-ae88-c7054122bd76 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:30.019482 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb44788-1230-4f12-ae88-c7054122bd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:30.038053 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-5fb44788-1230-4f12-ae88-c7054122bd76 None None] MFA Rules not processed for user `d461f94acd3048ffad92bc382aacfc76`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:20:30.039259 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5fb44788-1230-4f12-ae88-c7054122bd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:30.093625 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1224/2431] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:20:30 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:20:37.256535 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=18 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:37.742529 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c07a76-b728-4600-8fcc-80e03aaa3210 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:37.744136 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-69c07a76-b728-4600-8fcc-80e03aaa3210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:37.757632 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c07a76-b728-4600-8fcc-80e03aaa3210 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:37.762375 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4262ab-b8cb-4d23-958e-210ce21179bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:37.763023 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4262ab-b8cb-4d23-958e-210ce21179bc service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:37.763333 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4262ab-b8cb-4d23-958e-210ce21179bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:37.763634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4262ab-b8cb-4d23-958e-210ce21179bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:37.766001 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-0d4262ab-b8cb-4d23-958e-210ce21179bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:37.833307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4262ab-b8cb-4d23-958e-210ce21179bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:37.834806 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4262ab-b8cb-4d23-958e-210ce21179bc service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:37.844122 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1208/2432] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:20:37 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:20:40.087230 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=67 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:46.672107 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb44788-1230-4f12-ae88-c7054122bd76 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:46.681627 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb44788-1230-4f12-ae88-c7054122bd76 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:46.685094 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0357a-5b1a-4554-b85a-4d769437e885 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:46.685679 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0357a-5b1a-4554-b85a-4d769437e885 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:46.685972 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0357a-5b1a-4554-b85a-4d769437e885 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:46.686238 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0357a-5b1a-4554-b85a-4d769437e885 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:46.687991 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7cc0357a-5b1a-4554-b85a-4d769437e885 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:46.750151 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc0357a-5b1a-4554-b85a-4d769437e885 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:46.751251 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc0357a-5b1a-4554-b85a-4d769437e885 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:46.761157 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1225/2433] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:20:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:20:47.839915 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=30 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:56.757046 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=30 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:58.610041 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4262ab-b8cb-4d23-958e-210ce21179bc service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:20:58.611851 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-0d4262ab-b8cb-4d23-958e-210ce21179bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:58.717278 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4262ab-b8cb-4d23-958e-210ce21179bc service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:20:58.726327 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe6716-8a1e-4290-a37d-49a7922c7bfc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece00ea631594381bf1c27cfc2ece6f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:20:58.727659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe6716-8a1e-4290-a37d-49a7922c7bfc service placement] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:20:58.727955 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe6716-8a1e-4290-a37d-49a7922c7bfc service placement] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:20:58.728621 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe6716-8a1e-4290-a37d-49a7922c7bfc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:20:58.730149 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1bbe6716-8a1e-4290-a37d-49a7922c7bfc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:20:58.757341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe6716-8a1e-4290-a37d-49a7922c7bfc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:20:58.759312 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe6716-8a1e-4290-a37d-49a7922c7bfc service placement] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:20:58.774139 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1209/2434] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:20:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:21:01.100695 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f87a41-36d2-4bff-a2d5-fa06464b17ab None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:01.101252 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f87a41-36d2-4bff-a2d5-fa06464b17ab None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:01.101252 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f87a41-36d2-4bff-a2d5-fa06464b17ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:01.121359 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-34f87a41-36d2-4bff-a2d5-fa06464b17ab None None] MFA Rules not processed for user `5ad940c7dac94eb19868935052dc5939`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:21:01.122484 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-34f87a41-36d2-4bff-a2d5-fa06464b17ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:01.129697 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1226/2435] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:21:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:21:08.769835 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=32 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:11.115781 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:22.188397 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b90a0-ae46-450d-accb-05b00a5509dd None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:22.189167 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b90a0-ae46-450d-accb-05b00a5509dd None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:22.189167 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b90a0-ae46-450d-accb-05b00a5509dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:22.209267 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-740b90a0-ae46-450d-accb-05b00a5509dd None None] MFA Rules not processed for user `3e070c93f47045ecb5bf0a1622395091`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:21:22.210624 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-740b90a0-ae46-450d-accb-05b00a5509dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:22.266614 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1210/2436] 10.222.0.79 () {58 vars in 1009 bytes} [Wed Aug 31 19:21:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:21:22.308454 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f87a41-36d2-4bff-a2d5-fa06464b17ab None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:21:22.310310 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-34f87a41-36d2-4bff-a2d5-fa06464b17ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:22.386962 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f87a41-36d2-4bff-a2d5-fa06464b17ab None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:21:22.392362 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ebe80-ed68-40b8-b455-789959f00d49 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b289a0bef53460ca5173ad946394d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:21:22.392979 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ebe80-ed68-40b8-b455-789959f00d49 service swift] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:22.393261 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ebe80-ed68-40b8-b455-789959f00d49 service swift] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:22.394091 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ebe80-ed68-40b8-b455-789959f00d49 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:22.403015 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ebe80-ed68-40b8-b455-789959f00d49 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:21:22.404621 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ebe80-ed68-40b8-b455-789959f00d49 service swift] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:21:22.413557 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1227/2437] 10.222.0.79 () {60 vars in 1384 bytes} [Wed Aug 31 19:21:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:21:32.260074 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=25 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:32.409801 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=32 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:43.431501 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2b193-681f-4da8-a3f1-27be953ff2a2 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:43.432035 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2b193-681f-4da8-a3f1-27be953ff2a2 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:43.432142 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2b193-681f-4da8-a3f1-27be953ff2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:43.451336 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-76a2b193-681f-4da8-a3f1-27be953ff2a2 None None] MFA Rules not processed for user `3e070c93f47045ecb5bf0a1622395091`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:21:43.452548 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-76a2b193-681f-4da8-a3f1-27be953ff2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:43.460287 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1211/2438] 10.222.0.79 () {58 vars in 967 bytes} [Wed Aug 31 19:21:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:21:43.472462 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ebe80-ed68-40b8-b455-789959f00d49 service swift] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:21:43.482946 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ebe80-ed68-40b8-b455-789959f00d49 service swift] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:21:43.487914 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714fa35f-c667-4666-a3a5-4250a47329fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b289a0bef53460ca5173ad946394d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:21:43.488497 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fa35f-c667-4666-a3a5-4250a47329fe service swift] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:43.488775 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fa35f-c667-4666-a3a5-4250a47329fe service swift] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:43.489073 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fa35f-c667-4666-a3a5-4250a47329fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:43.496910 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714fa35f-c667-4666-a3a5-4250a47329fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:21:43.498504 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714fa35f-c667-4666-a3a5-4250a47329fe service swift] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:21:43.506878 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1228/2439] 10.222.0.79 () {60 vars in 1384 bytes} [Wed Aug 31 19:21:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:21:45.451280 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2b193-681f-4da8-a3f1-27be953ff2a2 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:21:45.463302 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2b193-681f-4da8-a3f1-27be953ff2a2 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:21:45.468013 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae83a3-ee92-43cb-9d45-5c217b7a3036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:21:45.468989 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae83a3-ee92-43cb-9d45-5c217b7a3036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:45.469265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae83a3-ee92-43cb-9d45-5c217b7a3036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:45.469538 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae83a3-ee92-43cb-9d45-5c217b7a3036 admin admin] PATH_INFO: `/v3/users/5ad940c7dac94eb19868935052dc5939` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:45.470710 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cae83a3-ee92-43cb-9d45-5c217b7a3036 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ad940c7dac94eb19868935052dc5939)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:21:45.472638 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cae83a3-ee92-43cb-9d45-5c217b7a3036 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:21:45.525463 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-8cae83a3-ee92-43cb-9d45-5c217b7a3036 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ad940c7dac94eb19868935052dc5939'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:21:45.526666 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-8cae83a3-ee92-43cb-9d45-5c217b7a3036 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ad940c7dac94eb19868935052dc5939'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:21:45.544412 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-8cae83a3-ee92-43cb-9d45-5c217b7a3036 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ad940c7dac94eb19868935052dc5939'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:21:45.553319 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-8cae83a3-ee92-43cb-9d45-5c217b7a3036 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ad940c7dac94eb19868935052dc5939'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:21:45.565282 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-8cae83a3-ee92-43cb-9d45-5c217b7a3036 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ad940c7dac94eb19868935052dc5939'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:21:45.575455 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1212/2440] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:21:45 2022] DELETE /identity/v3/users/5ad940c7dac94eb19868935052dc5939 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:21:45.780198 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714fa35f-c667-4666-a3a5-4250a47329fe service swift] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:21:45.794393 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714fa35f-c667-4666-a3a5-4250a47329fe service swift] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:21:45.855693 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538583d-0e1e-4e65-bd07-612650700f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:21:45.856338 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538583d-0e1e-4e65-bd07-612650700f26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:45.856621 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538583d-0e1e-4e65-bd07-612650700f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:45.856896 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538583d-0e1e-4e65-bd07-612650700f26 admin admin] PATH_INFO: `/v3/projects/ca1cf82f7462464ab8a1e48f1dd5cb79` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:45.858072 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d538583d-0e1e-4e65-bd07-612650700f26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca1cf82f7462464ab8a1e48f1dd5cb79)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:21:45.860067 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d538583d-0e1e-4e65-bd07-612650700f26 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:21:45.907855 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d538583d-0e1e-4e65-bd07-612650700f26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca1cf82f7462464ab8a1e48f1dd5cb79', 'request_id': 'req-d538583d-0e1e-4e65-bd07-612650700f26'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:21:45.914010 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d538583d-0e1e-4e65-bd07-612650700f26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca1cf82f7462464ab8a1e48f1dd5cb79', 'request_id': 'req-d538583d-0e1e-4e65-bd07-612650700f26'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:21:45.920038 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d538583d-0e1e-4e65-bd07-612650700f26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca1cf82f7462464ab8a1e48f1dd5cb79', 'request_id': 'req-d538583d-0e1e-4e65-bd07-612650700f26'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:21:45.932320 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d538583d-0e1e-4e65-bd07-612650700f26 admin admin] The token cache is being invalidate because project ca1cf82f7462464ab8a1e48f1dd5cb79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:21:45.932609 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d538583d-0e1e-4e65-bd07-612650700f26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:21:45.933233 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d538583d-0e1e-4e65-bd07-612650700f26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:21:45.934805 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1229/2441] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:21:45 2022] DELETE /identity/v3/projects/ca1cf82f7462464ab8a1e48f1dd5cb79 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:21:45.940014 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bf07b-241e-4da7-a758-118f9a1297b1 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:45.940242 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bf07b-241e-4da7-a758-118f9a1297b1 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:45.940523 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bf07b-241e-4da7-a758-118f9a1297b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:45.960542 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-0e2bf07b-241e-4da7-a758-118f9a1297b1 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:21:45.961743 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-0e2bf07b-241e-4da7-a758-118f9a1297b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:46.021791 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1213/2442] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:21:46.029472 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4a358-c65d-428b-9498-3b38ff529279 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:46.029761 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4a358-c65d-428b-9498-3b38ff529279 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:46.030038 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4a358-c65d-428b-9498-3b38ff529279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:46.050154 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-43c4a358-c65d-428b-9498-3b38ff529279 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:21:46.051378 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-43c4a358-c65d-428b-9498-3b38ff529279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:46.059372 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1230/2443] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:21:46.063561 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2bf07b-241e-4da7-a758-118f9a1297b1 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:21:46.073070 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2bf07b-241e-4da7-a758-118f9a1297b1 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:21:46.077664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2895489-533c-43cd-9293-760fce3efee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:21:46.078257 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2895489-533c-43cd-9293-760fce3efee4 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:46.078566 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2895489-533c-43cd-9293-760fce3efee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:46.078837 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2895489-533c-43cd-9293-760fce3efee4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:46.079477 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2895489-533c-43cd-9293-760fce3efee4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:21:46.079774 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2895489-533c-43cd-9293-760fce3efee4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:21:46.081345 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2895489-533c-43cd-9293-760fce3efee4 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:21:46.093090 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1214/2444] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:21:46.097498 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4a358-c65d-428b-9498-3b38ff529279 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:21:46.107417 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4a358-c65d-428b-9498-3b38ff529279 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:21:46.112074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb98f6a-5a2c-4180-aa37-1e32c7a434aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:21:46.112674 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb98f6a-5a2c-4180-aa37-1e32c7a434aa admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:46.112954 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb98f6a-5a2c-4180-aa37-1e32c7a434aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:46.113229 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb98f6a-5a2c-4180-aa37-1e32c7a434aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:46.113886 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb98f6a-5a2c-4180-aa37-1e32c7a434aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:21:46.115840 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb98f6a-5a2c-4180-aa37-1e32c7a434aa admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:21:46.142406 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1231/2445] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:21:46 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:21:46.147061 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2895489-533c-43cd-9293-760fce3efee4 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:21:46.156801 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2895489-533c-43cd-9293-760fce3efee4 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:21:46.204048 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:46.216108 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f9520-8b6e-44a4-ab04-da250f44712a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:21:46.216715 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f9520-8b6e-44a4-ab04-da250f44712a admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:46.217000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f9520-8b6e-44a4-ab04-da250f44712a admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:46.217274 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f9520-8b6e-44a4-ab04-da250f44712a admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:46.217900 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f9520-8b6e-44a4-ab04-da250f44712a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:21:46.220111 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f9520-8b6e-44a4-ab04-da250f44712a admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:21:46.241884 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1215/2446] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:21:46 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:21:46.246126 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb98f6a-5a2c-4180-aa37-1e32c7a434aa admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:21:46.256351 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb98f6a-5a2c-4180-aa37-1e32c7a434aa admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:21:46.260935 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff5985-cdab-4de0-9969-6d024caa1c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:21:46.261545 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff5985-cdab-4de0-9969-6d024caa1c94 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:46.261808 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff5985-cdab-4de0-9969-6d024caa1c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:46.262081 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff5985-cdab-4de0-9969-6d024caa1c94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:46.262764 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff5985-cdab-4de0-9969-6d024caa1c94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:21:46.264404 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff5985-cdab-4de0-9969-6d024caa1c94 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:21:46.274689 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1232/2447] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:21:46.278560 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f9520-8b6e-44a4-ab04-da250f44712a admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:21:46.288740 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f9520-8b6e-44a4-ab04-da250f44712a admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:21:46.293409 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4e9c7-a283-40ef-880f-885c06e1de81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:21:46.293994 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4e9c7-a283-40ef-880f-885c06e1de81 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:46.294280 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4e9c7-a283-40ef-880f-885c06e1de81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:46.294589 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4e9c7-a283-40ef-880f-885c06e1de81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:46.295221 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4e9c7-a283-40ef-880f-885c06e1de81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:21:46.296791 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4e9c7-a283-40ef-880f-885c06e1de81 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:21:46.307075 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1216/2448] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:21:46.311005 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff5985-cdab-4de0-9969-6d024caa1c94 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:21:46.321509 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff5985-cdab-4de0-9969-6d024caa1c94 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:21:46.326159 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59ee53-4dd4-4297-823d-0c27bfa06412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:21:46.326828 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59ee53-4dd4-4297-823d-0c27bfa06412 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:46.327113 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59ee53-4dd4-4297-823d-0c27bfa06412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:46.327394 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59ee53-4dd4-4297-823d-0c27bfa06412 admin admin] PATH_INFO: `/v3/projects/ce9f545a846843aeb6d0a23144e20667/users/26e3050046154520b3d071679e8cabb1/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:46.342869 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac59ee53-4dd4-4297-823d-0c27bfa06412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce9f545a846843aeb6d0a23144e20667, user_id=26e3050046154520b3d071679e8cabb1, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:21:46.345761 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac59ee53-4dd4-4297-823d-0c27bfa06412 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:21:46.358810 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1233/2449] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:21:46 2022] PUT /identity/v3/projects/ce9f545a846843aeb6d0a23144e20667/users/26e3050046154520b3d071679e8cabb1/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:21:46.369869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ba7a1-3ac6-452a-9d93-7e8547e7916c None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:46.370157 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ba7a1-3ac6-452a-9d93-7e8547e7916c None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:46.370432 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ba7a1-3ac6-452a-9d93-7e8547e7916c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:46.398245 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-b37ba7a1-3ac6-452a-9d93-7e8547e7916c None None] MFA Rules not processed for user `26e3050046154520b3d071679e8cabb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:21:46.399476 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-b37ba7a1-3ac6-452a-9d93-7e8547e7916c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:46.462122 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1217/2450] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:21:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:21:46.473841 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59ee53-4dd4-4297-823d-0c27bfa06412 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:21:46.476174 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ac59ee53-4dd4-4297-823d-0c27bfa06412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:46.490884 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:46.536068 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59ee53-4dd4-4297-823d-0c27bfa06412 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:21:46.540397 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774fac27-0edf-4620-8914-e347015a41f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:21:46.541005 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774fac27-0edf-4620-8914-e347015a41f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:46.541288 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774fac27-0edf-4620-8914-e347015a41f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:46.541564 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774fac27-0edf-4620-8914-e347015a41f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:46.550120 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774fac27-0edf-4620-8914-e347015a41f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:21:46.551596 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774fac27-0edf-4620-8914-e347015a41f6 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:21:46.560874 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1234/2451] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:21:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:21:46.586242 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ba7a1-3ac6-452a-9d93-7e8547e7916c None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:21:46.648953 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ba7a1-3ac6-452a-9d93-7e8547e7916c None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:21:46.653454 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85bfa9-d4fc-4227-907d-3bb2e09ef8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:21:46.654074 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85bfa9-d4fc-4227-907d-3bb2e09ef8ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:46.654351 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85bfa9-d4fc-4227-907d-3bb2e09ef8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:46.654651 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85bfa9-d4fc-4227-907d-3bb2e09ef8ec admin admin] PATH_INFO: `/v3/users/26e3050046154520b3d071679e8cabb1` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:46.655763 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c85bfa9-d4fc-4227-907d-3bb2e09ef8ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=26e3050046154520b3d071679e8cabb1)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:21:46.657726 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c85bfa9-d4fc-4227-907d-3bb2e09ef8ec admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:21:46.704797 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6c85bfa9-d4fc-4227-907d-3bb2e09ef8ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26e3050046154520b3d071679e8cabb1'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:21:46.705457 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6c85bfa9-d4fc-4227-907d-3bb2e09ef8ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26e3050046154520b3d071679e8cabb1'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:21:46.716629 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:46.717826 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6c85bfa9-d4fc-4227-907d-3bb2e09ef8ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26e3050046154520b3d071679e8cabb1'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:21:46.726891 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6c85bfa9-d4fc-4227-907d-3bb2e09ef8ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26e3050046154520b3d071679e8cabb1'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:21:46.734731 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6c85bfa9-d4fc-4227-907d-3bb2e09ef8ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26e3050046154520b3d071679e8cabb1'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:21:46.741323 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1218/2452] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:21:46 2022] DELETE /identity/v3/users/26e3050046154520b3d071679e8cabb1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:21:46.745943 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949422c-afa6-4882-9675-d8cb5b813b45 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:46.746526 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949422c-afa6-4882-9675-d8cb5b813b45 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:46.746526 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949422c-afa6-4882-9675-d8cb5b813b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:46.766246 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-7949422c-afa6-4882-9675-d8cb5b813b45 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:21:46.767464 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7949422c-afa6-4882-9675-d8cb5b813b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:46.824861 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1235/2453] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:21:46.834811 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85bfa9-d4fc-4227-907d-3bb2e09ef8ec admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:21:46.836226 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-6c85bfa9-d4fc-4227-907d-3bb2e09ef8ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:46.894638 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85bfa9-d4fc-4227-907d-3bb2e09ef8ec admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:21:46.898430 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282fe59-26be-4a1f-bba8-a5ce4c9460c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:21:46.899095 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282fe59-26be-4a1f-bba8-a5ce4c9460c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:46.899341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282fe59-26be-4a1f-bba8-a5ce4c9460c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:46.899638 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282fe59-26be-4a1f-bba8-a5ce4c9460c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:46.909215 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4282fe59-26be-4a1f-bba8-a5ce4c9460c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:21:46.910669 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4282fe59-26be-4a1f-bba8-a5ce4c9460c2 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:21:46.920632 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1219/2454] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:21:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:21:47.190323 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7949422c-afa6-4882-9675-d8cb5b813b45 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:21:47.191860 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7949422c-afa6-4882-9675-d8cb5b813b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:21:47.209096 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7949422c-afa6-4882-9675-d8cb5b813b45 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:21:47.213786 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6302de-b092-4ff1-8d10-c3f61afe18a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:21:47.214436 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6302de-b092-4ff1-8d10-c3f61afe18a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:21:47.214741 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6302de-b092-4ff1-8d10-c3f61afe18a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:21:47.215001 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6302de-b092-4ff1-8d10-c3f61afe18a1 admin admin] PATH_INFO: `/v3/projects/ce9f545a846843aeb6d0a23144e20667` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:21:47.216661 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6302de-b092-4ff1-8d10-c3f61afe18a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce9f545a846843aeb6d0a23144e20667)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:21:47.219481 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6302de-b092-4ff1-8d10-c3f61afe18a1 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:21:47.268876 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3b6302de-b092-4ff1-8d10-c3f61afe18a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce9f545a846843aeb6d0a23144e20667', 'request_id': 'req-3b6302de-b092-4ff1-8d10-c3f61afe18a1'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:21:47.274575 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3b6302de-b092-4ff1-8d10-c3f61afe18a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce9f545a846843aeb6d0a23144e20667', 'request_id': 'req-3b6302de-b092-4ff1-8d10-c3f61afe18a1'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:21:47.280823 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3b6302de-b092-4ff1-8d10-c3f61afe18a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce9f545a846843aeb6d0a23144e20667', 'request_id': 'req-3b6302de-b092-4ff1-8d10-c3f61afe18a1'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:21:47.293350 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3b6302de-b092-4ff1-8d10-c3f61afe18a1 admin admin] The token cache is being invalidate because project ce9f545a846843aeb6d0a23144e20667 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:21:47.293350 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3b6302de-b092-4ff1-8d10-c3f61afe18a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:21:47.294019 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3b6302de-b092-4ff1-8d10-c3f61afe18a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:21:47.295536 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1236/2455] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:21:47 2022] DELETE /identity/v3/projects/ce9f545a846843aeb6d0a23144e20667 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:21:56.915860 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=33,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:57.289935 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=74,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:05.947146 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc29dee-812f-424c-bd1b-cfd4cfde35c5 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:05.947691 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc29dee-812f-424c-bd1b-cfd4cfde35c5 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:05.947691 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc29dee-812f-424c-bd1b-cfd4cfde35c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:05.969158 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-7bc29dee-812f-424c-bd1b-cfd4cfde35c5 None None] MFA Rules not processed for user `f8ae8fa948c34e75a7dec755f29d5c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:22:05.970379 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-7bc29dee-812f-424c-bd1b-cfd4cfde35c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:22:06.033504 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1220/2456] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:22:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:22:16.026566 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=25 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:43.691133 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d9941-c3ad-40f3-a387-7bbe40ee85cc None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:43.691685 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d9941-c3ad-40f3-a387-7bbe40ee85cc None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:43.691685 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d9941-c3ad-40f3-a387-7bbe40ee85cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:43.711328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-925d9941-c3ad-40f3-a387-7bbe40ee85cc None None] MFA Rules not processed for user `d461f94acd3048ffad92bc382aacfc76`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:22:43.712637 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-925d9941-c3ad-40f3-a387-7bbe40ee85cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:22:43.767659 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1237/2457] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:22:43 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:22:48.820635 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc29dee-812f-424c-bd1b-cfd4cfde35c5 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:22:48.822122 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-7bc29dee-812f-424c-bd1b-cfd4cfde35c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:22:48.878724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc29dee-812f-424c-bd1b-cfd4cfde35c5 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:22:48.882828 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542c424-f459-40d0-9f13-7bea9d639761 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:22:48.883431 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542c424-f459-40d0-9f13-7bea9d639761 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:48.883708 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542c424-f459-40d0-9f13-7bea9d639761 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:48.883979 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542c424-f459-40d0-9f13-7bea9d639761 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:48.885765 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-0542c424-f459-40d0-9f13-7bea9d639761 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:22:48.957037 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542c424-f459-40d0-9f13-7bea9d639761 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:22:48.958573 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542c424-f459-40d0-9f13-7bea9d639761 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:22:48.969680 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1221/2458] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:22:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:22:52.106803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d9941-c3ad-40f3-a387-7bbe40ee85cc None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:22:52.108196 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-925d9941-c3ad-40f3-a387-7bbe40ee85cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:22:52.120405 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d9941-c3ad-40f3-a387-7bbe40ee85cc None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:22:52.123942 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7cd28-6c8e-4ed9-8209-9b679809e32e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:22:52.124531 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7cd28-6c8e-4ed9-8209-9b679809e32e service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:22:52.124808 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7cd28-6c8e-4ed9-8209-9b679809e32e service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:22:52.125081 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7cd28-6c8e-4ed9-8209-9b679809e32e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:22:52.126762 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-29b7cd28-6c8e-4ed9-8209-9b679809e32e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:22:52.140270 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b7cd28-6c8e-4ed9-8209-9b679809e32e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:22:52.141689 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b7cd28-6c8e-4ed9-8209-9b679809e32e service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:22:52.152367 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1238/2459] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:22:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:22:58.964536 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=54 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:02.147666 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=31 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:16.996142 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542c424-f459-40d0-9f13-7bea9d639761 service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:23:16.997739 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-0542c424-f459-40d0-9f13-7bea9d639761 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:17.012536 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542c424-f459-40d0-9f13-7bea9d639761 service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:23:17.020056 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21fa0f-f15c-4e31-8284-ed8899e42de0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:23:17.021571 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21fa0f-f15c-4e31-8284-ed8899e42de0 service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:17.021933 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21fa0f-f15c-4e31-8284-ed8899e42de0 service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:17.022212 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21fa0f-f15c-4e31-8284-ed8899e42de0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:17.024085 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-fa21fa0f-f15c-4e31-8284-ed8899e42de0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:17.035316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa21fa0f-f15c-4e31-8284-ed8899e42de0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:23:17.036929 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa21fa0f-f15c-4e31-8284-ed8899e42de0 service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:23:17.047347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1222/2460] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:23:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:23:21.658105 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7cd28-6c8e-4ed9-8209-9b679809e32e service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:23:21.660516 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-29b7cd28-6c8e-4ed9-8209-9b679809e32e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:21.675690 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7cd28-6c8e-4ed9-8209-9b679809e32e service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:23:21.683328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38979318-5855-4216-8030-5cdeb0189c15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:23:21.684298 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38979318-5855-4216-8030-5cdeb0189c15 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:21.684782 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38979318-5855-4216-8030-5cdeb0189c15 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:21.685252 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38979318-5855-4216-8030-5cdeb0189c15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:21.688209 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-38979318-5855-4216-8030-5cdeb0189c15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:21.705376 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38979318-5855-4216-8030-5cdeb0189c15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:23:21.707255 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38979318-5855-4216-8030-5cdeb0189c15 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:23:21.724776 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1239/2461] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:23:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:23:21.907114 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21fa0f-f15c-4e31-8284-ed8899e42de0 service nova] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:23:21.921381 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21fa0f-f15c-4e31-8284-ed8899e42de0 service nova] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:23:21.926626 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfac843-db62-4714-8b00-50f4d4da7fd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:23:21.927521 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfac843-db62-4714-8b00-50f4d4da7fd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:21.928009 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfac843-db62-4714-8b00-50f4d4da7fd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:21.928455 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfac843-db62-4714-8b00-50f4d4da7fd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:21.930719 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-abfac843-db62-4714-8b00-50f4d4da7fd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:21.942263 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfac843-db62-4714-8b00-50f4d4da7fd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:23:21.944068 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfac843-db62-4714-8b00-50f4d4da7fd7 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:23:21.953796 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1223/2462] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:23:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:23:31.714565 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=6 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:31.949766 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=12 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:33.284368 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15ba8f-13ed-49f4-bc0d-6e70fdec9fd3 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:33.285042 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15ba8f-13ed-49f4-bc0d-6e70fdec9fd3 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:33.285042 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15ba8f-13ed-49f4-bc0d-6e70fdec9fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:33.304929 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-0d15ba8f-13ed-49f4-bc0d-6e70fdec9fd3 None None] MFA Rules not processed for user `3e070c93f47045ecb5bf0a1622395091`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:23:33.306114 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0d15ba8f-13ed-49f4-bc0d-6e70fdec9fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:33.364428 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1240/2463] 10.222.0.79 () {58 vars in 967 bytes} [Wed Aug 31 19:23:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:23:33.415400 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfac843-db62-4714-8b00-50f4d4da7fd7 service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:23:33.416809 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-abfac843-db62-4714-8b00-50f4d4da7fd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:33.493224 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfac843-db62-4714-8b00-50f4d4da7fd7 service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:23:33.498305 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab92ed1-2c4d-42a3-a49d-ed786d1fbd7e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b289a0bef53460ca5173ad946394d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:23:33.498942 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab92ed1-2c4d-42a3-a49d-ed786d1fbd7e service swift] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:33.499218 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab92ed1-2c4d-42a3-a49d-ed786d1fbd7e service swift] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:33.499483 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab92ed1-2c4d-42a3-a49d-ed786d1fbd7e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:33.508538 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab92ed1-2c4d-42a3-a49d-ed786d1fbd7e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:23:33.510134 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab92ed1-2c4d-42a3-a49d-ed786d1fbd7e service swift] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:23:33.518186 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1224/2464] 10.222.0.79 () {60 vars in 1384 bytes} [Wed Aug 31 19:23:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:23:33.707119 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedaf7e-06be-40ec-9b82-f68d35a9ca6f None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:33.707895 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedaf7e-06be-40ec-9b82-f68d35a9ca6f None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:33.708165 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedaf7e-06be-40ec-9b82-f68d35a9ca6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:33.729097 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-1cedaf7e-06be-40ec-9b82-f68d35a9ca6f None None] MFA Rules not processed for user `f8ae8fa948c34e75a7dec755f29d5c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:23:33.730307 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1cedaf7e-06be-40ec-9b82-f68d35a9ca6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:33.737555 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1241/2465] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:23:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:23:34.060566 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab92ed1-2c4d-42a3-a49d-ed786d1fbd7e service swift] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:23:34.070743 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab92ed1-2c4d-42a3-a49d-ed786d1fbd7e service swift] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:23:34.074868 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c16a1-bda7-4850-af05-7b5ddb6fda75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:23:34.075473 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c16a1-bda7-4850-af05-7b5ddb6fda75 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:34.075880 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c16a1-bda7-4850-af05-7b5ddb6fda75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:34.076160 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c16a1-bda7-4850-af05-7b5ddb6fda75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:34.077955 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-b35c16a1-bda7-4850-af05-7b5ddb6fda75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:34.088339 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c16a1-bda7-4850-af05-7b5ddb6fda75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:23:34.089783 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c16a1-bda7-4850-af05-7b5ddb6fda75 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:23:34.099675 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1225/2466] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:23:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:23:34.427926 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cedaf7e-06be-40ec-9b82-f68d35a9ca6f None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:23:34.429680 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1cedaf7e-06be-40ec-9b82-f68d35a9ca6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:34.507159 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cedaf7e-06be-40ec-9b82-f68d35a9ca6f None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:23:34.512274 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7fe481-5db7-4435-885f-95e47928e732 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece00ea631594381bf1c27cfc2ece6f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:23:34.512907 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fe481-5db7-4435-885f-95e47928e732 service placement] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:34.513194 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fe481-5db7-4435-885f-95e47928e732 service placement] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:34.513466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fe481-5db7-4435-885f-95e47928e732 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:34.515227 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8a7fe481-5db7-4435-885f-95e47928e732 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:34.527205 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7fe481-5db7-4435-885f-95e47928e732 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:23:34.528814 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7fe481-5db7-4435-885f-95e47928e732 service placement] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:23:34.540746 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1242/2467] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:23:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:23:37.430257 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c16a1-bda7-4850-af05-7b5ddb6fda75 service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:23:37.432345 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-b35c16a1-bda7-4850-af05-7b5ddb6fda75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:37.454384 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c16a1-bda7-4850-af05-7b5ddb6fda75 service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:23:37.463490 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f95255-25a8-4064-aa3f-0bee684c97f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece00ea631594381bf1c27cfc2ece6f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:23:37.464895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f95255-25a8-4064-aa3f-0bee684c97f1 service placement] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:37.465175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f95255-25a8-4064-aa3f-0bee684c97f1 service placement] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:37.465504 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f95255-25a8-4064-aa3f-0bee684c97f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:37.467987 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-01f95255-25a8-4064-aa3f-0bee684c97f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:37.491341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f95255-25a8-4064-aa3f-0bee684c97f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:23:37.493501 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f95255-25a8-4064-aa3f-0bee684c97f1 service placement] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:23:37.507152 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1226/2468] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:23:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:23:41.103014 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7fe481-5db7-4435-885f-95e47928e732 service placement] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:23:41.104546 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8a7fe481-5db7-4435-885f-95e47928e732 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:41.182751 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7fe481-5db7-4435-885f-95e47928e732 service placement] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:23:41.187659 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b88476-9f54-4cd0-b71f-6aba9605e231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:23:41.188418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b88476-9f54-4cd0-b71f-6aba9605e231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:41.188820 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b88476-9f54-4cd0-b71f-6aba9605e231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:41.189719 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b88476-9f54-4cd0-b71f-6aba9605e231 admin admin] PATH_INFO: `/v3/users/25dc9e2a730f4d63828ddb059d15d5d3` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:41.191015 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b88476-9f54-4cd0-b71f-6aba9605e231 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25dc9e2a730f4d63828ddb059d15d5d3)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:23:41.193041 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b88476-9f54-4cd0-b71f-6aba9605e231 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:23:41.237403 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:41.255096 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-77b88476-9f54-4cd0-b71f-6aba9605e231 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25dc9e2a730f4d63828ddb059d15d5d3'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:23:41.264193 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-77b88476-9f54-4cd0-b71f-6aba9605e231 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25dc9e2a730f4d63828ddb059d15d5d3'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:23:41.274678 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-77b88476-9f54-4cd0-b71f-6aba9605e231 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25dc9e2a730f4d63828ddb059d15d5d3'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:23:41.291275 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-77b88476-9f54-4cd0-b71f-6aba9605e231 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25dc9e2a730f4d63828ddb059d15d5d3'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:23:41.291989 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-77b88476-9f54-4cd0-b71f-6aba9605e231 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25dc9e2a730f4d63828ddb059d15d5d3'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:23:41.297859 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1243/2469] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:23:41 2022] DELETE /identity/v3/users/25dc9e2a730f4d63828ddb059d15d5d3 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:23:41.469499 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f95255-25a8-4064-aa3f-0bee684c97f1 service placement] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:23:41.486563 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f95255-25a8-4064-aa3f-0bee684c97f1 service placement] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:23:41.552577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69687cff-3099-4cdd-ac0f-78cb6c2f2d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:23:41.553234 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69687cff-3099-4cdd-ac0f-78cb6c2f2d4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:41.553511 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69687cff-3099-4cdd-ac0f-78cb6c2f2d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:41.553778 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69687cff-3099-4cdd-ac0f-78cb6c2f2d4b admin admin] PATH_INFO: `/v3/projects/ad54277b8e5047fcac19393ac656f119` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:41.555321 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69687cff-3099-4cdd-ac0f-78cb6c2f2d4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad54277b8e5047fcac19393ac656f119)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:23:41.557243 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69687cff-3099-4cdd-ac0f-78cb6c2f2d4b admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:23:41.606448 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-69687cff-3099-4cdd-ac0f-78cb6c2f2d4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad54277b8e5047fcac19393ac656f119', 'request_id': 'req-69687cff-3099-4cdd-ac0f-78cb6c2f2d4b'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:23:41.612250 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-69687cff-3099-4cdd-ac0f-78cb6c2f2d4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad54277b8e5047fcac19393ac656f119', 'request_id': 'req-69687cff-3099-4cdd-ac0f-78cb6c2f2d4b'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:23:41.618886 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-69687cff-3099-4cdd-ac0f-78cb6c2f2d4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad54277b8e5047fcac19393ac656f119', 'request_id': 'req-69687cff-3099-4cdd-ac0f-78cb6c2f2d4b'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:23:41.621807 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:41.633784 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-69687cff-3099-4cdd-ac0f-78cb6c2f2d4b admin admin] The token cache is being invalidate because project ad54277b8e5047fcac19393ac656f119 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:23:41.634328 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-69687cff-3099-4cdd-ac0f-78cb6c2f2d4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:23:41.635060 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-69687cff-3099-4cdd-ac0f-78cb6c2f2d4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:23:41.636692 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1227/2470] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:23:41 2022] DELETE /identity/v3/projects/ad54277b8e5047fcac19393ac656f119 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:23:41.640654 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b88476-9f54-4cd0-b71f-6aba9605e231 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:23:41.642178 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-77b88476-9f54-4cd0-b71f-6aba9605e231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:41.657129 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b88476-9f54-4cd0-b71f-6aba9605e231 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:23:41.726154 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03fa13-06b9-4095-af0b-04655aeac8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:23:41.726912 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03fa13-06b9-4095-af0b-04655aeac8f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:41.727358 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03fa13-06b9-4095-af0b-04655aeac8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:41.727635 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03fa13-06b9-4095-af0b-04655aeac8f0 admin admin] PATH_INFO: `/v3/users/19b0c8708dfe44b6a51d62a0b19a8728` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:41.728806 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03fa13-06b9-4095-af0b-04655aeac8f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19b0c8708dfe44b6a51d62a0b19a8728)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:23:41.730773 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03fa13-06b9-4095-af0b-04655aeac8f0 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:23:41.780643 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6b03fa13-06b9-4095-af0b-04655aeac8f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19b0c8708dfe44b6a51d62a0b19a8728'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:23:41.790057 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6b03fa13-06b9-4095-af0b-04655aeac8f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19b0c8708dfe44b6a51d62a0b19a8728'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:23:41.797721 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6b03fa13-06b9-4095-af0b-04655aeac8f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19b0c8708dfe44b6a51d62a0b19a8728'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:23:41.810974 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6b03fa13-06b9-4095-af0b-04655aeac8f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19b0c8708dfe44b6a51d62a0b19a8728'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:23:41.811669 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6b03fa13-06b9-4095-af0b-04655aeac8f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19b0c8708dfe44b6a51d62a0b19a8728'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:23:41.818134 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1244/2471] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:23:41 2022] DELETE /identity/v3/users/19b0c8708dfe44b6a51d62a0b19a8728 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:23:42.076467 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69687cff-3099-4cdd-ac0f-78cb6c2f2d4b admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:23:42.078065 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-69687cff-3099-4cdd-ac0f-78cb6c2f2d4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:42.098065 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69687cff-3099-4cdd-ac0f-78cb6c2f2d4b admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:23:42.156873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b2144-fd2f-4cab-bc50-dcfc8f359033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:23:42.157570 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b2144-fd2f-4cab-bc50-dcfc8f359033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:42.157877 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b2144-fd2f-4cab-bc50-dcfc8f359033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:42.158173 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b2144-fd2f-4cab-bc50-dcfc8f359033 admin admin] PATH_INFO: `/v3/projects/850e40e823c242388ae3ac053458bf28` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:42.159410 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b2144-fd2f-4cab-bc50-dcfc8f359033 admin admin] RBAC: Authorizing `identity:delete_project(project_id=850e40e823c242388ae3ac053458bf28)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:23:42.162532 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b2144-fd2f-4cab-bc50-dcfc8f359033 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:23:42.212572 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-790b2144-fd2f-4cab-bc50-dcfc8f359033 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '850e40e823c242388ae3ac053458bf28', 'request_id': 'req-790b2144-fd2f-4cab-bc50-dcfc8f359033'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:23:42.218892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-790b2144-fd2f-4cab-bc50-dcfc8f359033 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '850e40e823c242388ae3ac053458bf28', 'request_id': 'req-790b2144-fd2f-4cab-bc50-dcfc8f359033'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:23:42.226126 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-790b2144-fd2f-4cab-bc50-dcfc8f359033 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '850e40e823c242388ae3ac053458bf28', 'request_id': 'req-790b2144-fd2f-4cab-bc50-dcfc8f359033'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:23:42.238218 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-790b2144-fd2f-4cab-bc50-dcfc8f359033 admin admin] The token cache is being invalidate because project 850e40e823c242388ae3ac053458bf28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:23:42.238533 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-790b2144-fd2f-4cab-bc50-dcfc8f359033 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:23:42.239151 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-790b2144-fd2f-4cab-bc50-dcfc8f359033 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:23:42.240621 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1228/2472] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:23:42 2022] DELETE /identity/v3/projects/850e40e823c242388ae3ac053458bf28 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:23:43.639147 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03fa13-06b9-4095-af0b-04655aeac8f0 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:23:43.640688 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6b03fa13-06b9-4095-af0b-04655aeac8f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:43.676069 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:43.728355 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03fa13-06b9-4095-af0b-04655aeac8f0 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:23:43.798166 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8132902f-b45a-43a8-9bd2-76ec9944b31e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:23:43.798809 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132902f-b45a-43a8-9bd2-76ec9944b31e service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:43.799132 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132902f-b45a-43a8-9bd2-76ec9944b31e service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:43.799358 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132902f-b45a-43a8-9bd2-76ec9944b31e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:43.801665 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8132902f-b45a-43a8-9bd2-76ec9944b31e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:43.813637 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8132902f-b45a-43a8-9bd2-76ec9944b31e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:23:43.815269 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8132902f-b45a-43a8-9bd2-76ec9944b31e service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:23:43.827252 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1245/2473] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:23:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:23:44.322582 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b2144-fd2f-4cab-bc50-dcfc8f359033 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:23:44.324798 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-790b2144-fd2f-4cab-bc50-dcfc8f359033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:44.390153 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b2144-fd2f-4cab-bc50-dcfc8f359033 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:23:44.394622 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5dff9-fc02-4b14-b705-679e63f32e95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:23:44.396168 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5dff9-fc02-4b14-b705-679e63f32e95 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:44.396168 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5dff9-fc02-4b14-b705-679e63f32e95 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:44.396168 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5dff9-fc02-4b14-b705-679e63f32e95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:44.398618 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-c7b5dff9-fc02-4b14-b705-679e63f32e95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:44.415096 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150bd43-3115-48b4-b212-324bfb48ba65 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:44.415390 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150bd43-3115-48b4-b212-324bfb48ba65 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:44.415665 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150bd43-3115-48b4-b212-324bfb48ba65 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:44.417383 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1246/2474] 10.222.0.79 () {54 vars in 921 bytes} [Wed Aug 31 19:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 19:23:44.424084 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94c934-4d84-454a-b36a-7bb0b8760c5f None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:44.424369 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94c934-4d84-454a-b36a-7bb0b8760c5f None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:44.424645 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94c934-4d84-454a-b36a-7bb0b8760c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:44.446065 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-bb94c934-4d84-454a-b36a-7bb0b8760c5f None None] MFA Rules not processed for user `a91998a2818444a595adc06f1f481fe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:23:44.447341 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-bb94c934-4d84-454a-b36a-7bb0b8760c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:44.458155 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:44.495699 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b5dff9-fc02-4b14-b705-679e63f32e95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:23:44.498840 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b5dff9-fc02-4b14-b705-679e63f32e95 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:23:44.512444 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1229/2475] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:23:44 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:23:44.530107 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1247/2476] 10.222.0.79 () {58 vars in 1018 bytes} [Wed Aug 31 19:23:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:23:44.552919 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5dff9-fc02-4b14-b705-679e63f32e95 service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:23:44.554502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-c7b5dff9-fc02-4b14-b705-679e63f32e95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:44.566202 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5dff9-fc02-4b14-b705-679e63f32e95 service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:23:44.570903 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4969939-d9f3-41b4-8c75-9d302713f654 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:23:44.571213 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4969939-d9f3-41b4-8c75-9d302713f654 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:44.571489 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4969939-d9f3-41b4-8c75-9d302713f654 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:44.571754 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4969939-d9f3-41b4-8c75-9d302713f654 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:44.585063 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4969939-d9f3-41b4-8c75-9d302713f654 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:23:44.586543 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4969939-d9f3-41b4-8c75-9d302713f654 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:23:44.595014 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1230/2477] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:23:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:23:44.694996 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229179f-dc21-4917-a024-b8edb6838835 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:44.695522 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229179f-dc21-4917-a024-b8edb6838835 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:44.695730 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229179f-dc21-4917-a024-b8edb6838835 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:44.697132 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1248/2478] 10.222.0.79 () {54 vars in 921 bytes} [Wed Aug 31 19:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:23:44.702523 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a9360-7428-47cc-816a-f59ab6371e68 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:44.702810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a9360-7428-47cc-816a-f59ab6371e68 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:44.703076 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a9360-7428-47cc-816a-f59ab6371e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:44.724060 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-fe0a9360-7428-47cc-816a-f59ab6371e68 None None] MFA Rules not processed for user `1fd6d45d1bc3479da72cb1a1990a6137`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:23:44.725245 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-fe0a9360-7428-47cc-816a-f59ab6371e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:44.735134 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1231/2479] 10.222.0.79 () {58 vars in 1018 bytes} [Wed Aug 31 19:23:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:23:44.746195 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229179f-dc21-4917-a024-b8edb6838835 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:23:44.747948 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5229179f-dc21-4917-a024-b8edb6838835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:44.763306 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229179f-dc21-4917-a024-b8edb6838835 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:23:44.766818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ebc338-0e72-4cb3-9067-66a78d25f824 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:23:44.767420 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebc338-0e72-4cb3-9067-66a78d25f824 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:44.767698 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebc338-0e72-4cb3-9067-66a78d25f824 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:44.767971 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebc338-0e72-4cb3-9067-66a78d25f824 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:44.778961 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ebc338-0e72-4cb3-9067-66a78d25f824 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:23:44.780415 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ebc338-0e72-4cb3-9067-66a78d25f824 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:23:44.792435 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1249/2480] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:23:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:23:49.231610 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a9360-7428-47cc-816a-f59ab6371e68 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:23:49.233379 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-fe0a9360-7428-47cc-816a-f59ab6371e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:49.248098 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a9360-7428-47cc-816a-f59ab6371e68 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:23:49.254772 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd0c82-43a6-461b-9636-c8a9b6614a8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:23:49.255463 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd0c82-43a6-461b-9636-c8a9b6614a8c service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:23:49.255803 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd0c82-43a6-461b-9636-c8a9b6614a8c service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:23:49.256141 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd0c82-43a6-461b-9636-c8a9b6614a8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:23:49.258148 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-50bd0c82-43a6-461b-9636-c8a9b6614a8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:23:49.272755 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd0c82-43a6-461b-9636-c8a9b6614a8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:23:49.274370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd0c82-43a6-461b-9636-c8a9b6614a8c service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:23:49.286223 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1232/2481] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:23:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:23:54.786841 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=79 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:59.281556 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=25 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:07.924029 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a3e37-fa1a-45e0-b6a6-742130551978 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:07.924528 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a3e37-fa1a-45e0-b6a6-742130551978 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:07.924642 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a3e37-fa1a-45e0-b6a6-742130551978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:07.944177 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-367a3e37-fa1a-45e0-b6a6-742130551978 None None] MFA Rules not processed for user `4e329b952aed44d581a4a29c6070b4dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:24:07.945368 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-367a3e37-fa1a-45e0-b6a6-742130551978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:07.999237 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1250/2482] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:24:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:24:08.308490 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd0c82-43a6-461b-9636-c8a9b6614a8c service nova] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:24:08.317913 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd0c82-43a6-461b-9636-c8a9b6614a8c service nova] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:24:08.321572 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff085198-d8dd-4a52-ad39-990866ec8d49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:24:08.322167 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff085198-d8dd-4a52-ad39-990866ec8d49 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:08.322446 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff085198-d8dd-4a52-ad39-990866ec8d49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:08.322820 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff085198-d8dd-4a52-ad39-990866ec8d49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:08.324547 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-ff085198-d8dd-4a52-ad39-990866ec8d49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:08.334397 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff085198-d8dd-4a52-ad39-990866ec8d49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:24:08.335837 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff085198-d8dd-4a52-ad39-990866ec8d49 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:24:08.343833 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1233/2483] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:24:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:24:10.813051 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a3e37-fa1a-45e0-b6a6-742130551978 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:24:10.826342 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a3e37-fa1a-45e0-b6a6-742130551978 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:24:10.831963 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c41f0-e50c-433d-8633-474b5e270dcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:24:10.832763 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c41f0-e50c-433d-8633-474b5e270dcc service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:10.833046 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c41f0-e50c-433d-8633-474b5e270dcc service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:10.833318 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c41f0-e50c-433d-8633-474b5e270dcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:10.835692 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b14c41f0-e50c-433d-8633-474b5e270dcc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:10.847286 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c41f0-e50c-433d-8633-474b5e270dcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:24:10.848866 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c41f0-e50c-433d-8633-474b5e270dcc service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:24:10.860727 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1251/2484] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:24:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:24:12.831724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff085198-d8dd-4a52-ad39-990866ec8d49 service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:24:12.840749 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff085198-d8dd-4a52-ad39-990866ec8d49 service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:24:12.844429 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a51686-9b79-4fd8-8332-47da0d10184a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:24:12.845045 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a51686-9b79-4fd8-8332-47da0d10184a service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:12.845310 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a51686-9b79-4fd8-8332-47da0d10184a service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:12.845584 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a51686-9b79-4fd8-8332-47da0d10184a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:12.847319 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-86a51686-9b79-4fd8-8332-47da0d10184a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:12.913294 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a51686-9b79-4fd8-8332-47da0d10184a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:24:12.914761 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a51686-9b79-4fd8-8332-47da0d10184a service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:24:12.924682 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1234/2485] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:24:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:24:16.380912 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c41f0-e50c-433d-8633-474b5e270dcc service nova] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:24:16.382943 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b14c41f0-e50c-433d-8633-474b5e270dcc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:16.400462 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c41f0-e50c-433d-8633-474b5e270dcc service nova] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:24:16.405090 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0fc86d-faac-4b6b-bcdf-a49a5248cd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:24:16.405717 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fc86d-faac-4b6b-bcdf-a49a5248cd72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:16.405995 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fc86d-faac-4b6b-bcdf-a49a5248cd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:16.406266 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fc86d-faac-4b6b-bcdf-a49a5248cd72 admin admin] PATH_INFO: `/v3/users/d461f94acd3048ffad92bc382aacfc76` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:16.407408 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0fc86d-faac-4b6b-bcdf-a49a5248cd72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d461f94acd3048ffad92bc382aacfc76)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:24:16.409336 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0fc86d-faac-4b6b-bcdf-a49a5248cd72 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:24:16.456488 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ee0fc86d-faac-4b6b-bcdf-a49a5248cd72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd461f94acd3048ffad92bc382aacfc76'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:24:16.464565 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ee0fc86d-faac-4b6b-bcdf-a49a5248cd72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd461f94acd3048ffad92bc382aacfc76'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:24:16.471945 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ee0fc86d-faac-4b6b-bcdf-a49a5248cd72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd461f94acd3048ffad92bc382aacfc76'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:24:16.483574 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ee0fc86d-faac-4b6b-bcdf-a49a5248cd72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd461f94acd3048ffad92bc382aacfc76'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:24:16.484213 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ee0fc86d-faac-4b6b-bcdf-a49a5248cd72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd461f94acd3048ffad92bc382aacfc76'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:24:16.490056 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1252/2486] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:24:16 2022] DELETE /identity/v3/users/d461f94acd3048ffad92bc382aacfc76 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:24:16.666810 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a51686-9b79-4fd8-8332-47da0d10184a service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:24:16.682123 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a51686-9b79-4fd8-8332-47da0d10184a service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:24:16.741647 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586c94f-533b-4f31-bec6-86b3f98bf2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:24:16.742305 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586c94f-533b-4f31-bec6-86b3f98bf2e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:16.742619 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586c94f-533b-4f31-bec6-86b3f98bf2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:16.742889 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586c94f-533b-4f31-bec6-86b3f98bf2e3 admin admin] PATH_INFO: `/v3/projects/863b7e38591440f5a677bf2671182221` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:16.744030 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586c94f-533b-4f31-bec6-86b3f98bf2e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=863b7e38591440f5a677bf2671182221)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:24:16.745923 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586c94f-533b-4f31-bec6-86b3f98bf2e3 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:24:16.790646 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-4586c94f-533b-4f31-bec6-86b3f98bf2e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '863b7e38591440f5a677bf2671182221', 'request_id': 'req-4586c94f-533b-4f31-bec6-86b3f98bf2e3'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:24:16.796075 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-4586c94f-533b-4f31-bec6-86b3f98bf2e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '863b7e38591440f5a677bf2671182221', 'request_id': 'req-4586c94f-533b-4f31-bec6-86b3f98bf2e3'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:24:16.802106 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-4586c94f-533b-4f31-bec6-86b3f98bf2e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '863b7e38591440f5a677bf2671182221', 'request_id': 'req-4586c94f-533b-4f31-bec6-86b3f98bf2e3'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:24:16.814690 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-4586c94f-533b-4f31-bec6-86b3f98bf2e3 admin admin] The token cache is being invalidate because project 863b7e38591440f5a677bf2671182221 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:24:16.815684 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-4586c94f-533b-4f31-bec6-86b3f98bf2e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:24:16.816412 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-4586c94f-533b-4f31-bec6-86b3f98bf2e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:24:16.817915 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1235/2487] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:24:16 2022] DELETE /identity/v3/projects/863b7e38591440f5a677bf2671182221 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:24:16.823588 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481a448-0d2c-4fa8-8fc0-0d0ee54ce481 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:16.823887 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481a448-0d2c-4fa8-8fc0-0d0ee54ce481 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:16.824164 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481a448-0d2c-4fa8-8fc0-0d0ee54ce481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:16.843882 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-b481a448-0d2c-4fa8-8fc0-0d0ee54ce481 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:24:16.845124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b481a448-0d2c-4fa8-8fc0-0d0ee54ce481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:16.903432 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1253/2488] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:24:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:24:16.910956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e024b-3c1e-4267-895c-a2817bef5d56 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:16.911242 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e024b-3c1e-4267-895c-a2817bef5d56 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:16.911509 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e024b-3c1e-4267-895c-a2817bef5d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:16.933278 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-078e024b-3c1e-4267-895c-a2817bef5d56 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:24:16.934526 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-078e024b-3c1e-4267-895c-a2817bef5d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:16.942497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1236/2489] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:24:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:24:16.946853 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481a448-0d2c-4fa8-8fc0-0d0ee54ce481 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:24:16.952896 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:16.956623 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481a448-0d2c-4fa8-8fc0-0d0ee54ce481 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:24:16.962328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2f209-9459-4c6d-8c8c-400c74292ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:24:16.962961 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2f209-9459-4c6d-8c8c-400c74292ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:16.963440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2f209-9459-4c6d-8c8c-400c74292ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:16.963886 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2f209-9459-4c6d-8c8c-400c74292ca5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:16.964578 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2f209-9459-4c6d-8c8c-400c74292ca5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:24:16.965024 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2f209-9459-4c6d-8c8c-400c74292ca5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:24:16.966913 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2f209-9459-4c6d-8c8c-400c74292ca5 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:24:16.978986 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1254/2490] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:24:16.983275 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e024b-3c1e-4267-895c-a2817bef5d56 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:24:16.988781 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:16.993325 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e024b-3c1e-4267-895c-a2817bef5d56 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:24:17.000361 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9041146-ac62-4598-a86d-688a2f41499c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:24:17.001046 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9041146-ac62-4598-a86d-688a2f41499c admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:17.001470 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9041146-ac62-4598-a86d-688a2f41499c admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:17.001923 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9041146-ac62-4598-a86d-688a2f41499c admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:17.002796 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9041146-ac62-4598-a86d-688a2f41499c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:24:17.004902 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9041146-ac62-4598-a86d-688a2f41499c admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:24:17.031282 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1237/2491] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:24:16 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:24:17.035501 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2f209-9459-4c6d-8c8c-400c74292ca5 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:24:17.045959 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2f209-9459-4c6d-8c8c-400c74292ca5 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:24:17.103345 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f457c-96ad-4613-ae0f-d323679ddcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:24:17.103859 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f457c-96ad-4613-ae0f-d323679ddcc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:17.104142 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f457c-96ad-4613-ae0f-d323679ddcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:17.104449 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f457c-96ad-4613-ae0f-d323679ddcc5 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:17.105089 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f457c-96ad-4613-ae0f-d323679ddcc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:24:17.107041 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f457c-96ad-4613-ae0f-d323679ddcc5 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:24:17.129075 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1255/2492] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:24:17 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:24:17.133965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9041146-ac62-4598-a86d-688a2f41499c admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:24:17.144523 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9041146-ac62-4598-a86d-688a2f41499c admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:24:17.149330 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a098035-6f09-4bc2-af9b-45bfdd4e87ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:24:17.149941 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a098035-6f09-4bc2-af9b-45bfdd4e87ed admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:17.150223 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a098035-6f09-4bc2-af9b-45bfdd4e87ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:17.150522 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a098035-6f09-4bc2-af9b-45bfdd4e87ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:17.151172 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a098035-6f09-4bc2-af9b-45bfdd4e87ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:24:17.152789 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a098035-6f09-4bc2-af9b-45bfdd4e87ed admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:24:17.164453 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1238/2493] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:24:17.168576 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f457c-96ad-4613-ae0f-d323679ddcc5 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:24:17.178579 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f457c-96ad-4613-ae0f-d323679ddcc5 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:24:17.184995 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545ac35-5288-4e34-9bc7-d310132c2204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:24:17.185555 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545ac35-5288-4e34-9bc7-d310132c2204 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:17.185835 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545ac35-5288-4e34-9bc7-d310132c2204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:17.186110 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545ac35-5288-4e34-9bc7-d310132c2204 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:17.186794 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6545ac35-5288-4e34-9bc7-d310132c2204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:24:17.188479 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6545ac35-5288-4e34-9bc7-d310132c2204 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:24:17.202284 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1256/2494] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:24:17.207809 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a098035-6f09-4bc2-af9b-45bfdd4e87ed admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:24:17.228551 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a098035-6f09-4bc2-af9b-45bfdd4e87ed admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:24:17.233751 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4e855-6471-4733-b8b0-2f7744480812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:24:17.234833 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4e855-6471-4733-b8b0-2f7744480812 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:17.235394 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4e855-6471-4733-b8b0-2f7744480812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:17.235942 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4e855-6471-4733-b8b0-2f7744480812 admin admin] PATH_INFO: `/v3/projects/d3a26f4a19614684b02f8484836330b7/users/c23c732f628c487d89d79f4ed8088b0b/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:17.258295 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4e855-6471-4733-b8b0-2f7744480812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3a26f4a19614684b02f8484836330b7, user_id=c23c732f628c487d89d79f4ed8088b0b, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:24:17.261055 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4e855-6471-4733-b8b0-2f7744480812 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:24:17.277613 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1239/2495] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:24:17 2022] PUT /identity/v3/projects/d3a26f4a19614684b02f8484836330b7/users/c23c732f628c487d89d79f4ed8088b0b/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:24:17.282344 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f846b-bb78-4823-a2e1-3f7beab87d2a None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:17.282662 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f846b-bb78-4823-a2e1-3f7beab87d2a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:17.282938 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f846b-bb78-4823-a2e1-3f7beab87d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:17.303972 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-d39f846b-bb78-4823-a2e1-3f7beab87d2a None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:24:17.305298 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d39f846b-bb78-4823-a2e1-3f7beab87d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:17.365668 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1257/2496] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:24:17.375645 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4e855-6471-4733-b8b0-2f7744480812 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:24:17.377741 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-e1b4e855-6471-4733-b8b0-2f7744480812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:17.434486 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4e855-6471-4733-b8b0-2f7744480812 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:24:17.438055 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25807df-988c-4f4a-adc9-1fbf9602e6e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:24:17.438696 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25807df-988c-4f4a-adc9-1fbf9602e6e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:17.438978 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25807df-988c-4f4a-adc9-1fbf9602e6e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:17.439246 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25807df-988c-4f4a-adc9-1fbf9602e6e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:17.448547 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25807df-988c-4f4a-adc9-1fbf9602e6e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:24:17.449964 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25807df-988c-4f4a-adc9-1fbf9602e6e6 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:24:17.459345 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1240/2497] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:24:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:24:21.720662 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f89520-a3bd-4d47-95dc-a1dd772751f8 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:21.721604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f89520-a3bd-4d47-95dc-a1dd772751f8 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:21.722097 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f89520-a3bd-4d47-95dc-a1dd772751f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:21.766796 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-07f89520-a3bd-4d47-95dc-a1dd772751f8 None None] MFA Rules not processed for user `c23c732f628c487d89d79f4ed8088b0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:24:21.768122 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-07f89520-a3bd-4d47-95dc-a1dd772751f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:21.858350 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:21.867262 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1258/2498] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:24:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:24:21.872556 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25807df-988c-4f4a-adc9-1fbf9602e6e6 service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:24:21.874025 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-b25807df-988c-4f4a-adc9-1fbf9602e6e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:22.002001 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25807df-988c-4f4a-adc9-1fbf9602e6e6 service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:24:22.009687 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9f27d-feea-40df-b54a-9309a61011b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:24:22.010613 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9f27d-feea-40df-b54a-9309a61011b9 service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:22.010958 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9f27d-feea-40df-b54a-9309a61011b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:22.011312 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9f27d-feea-40df-b54a-9309a61011b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:22.020485 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a9f27d-feea-40df-b54a-9309a61011b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:24:22.022634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a9f27d-feea-40df-b54a-9309a61011b9 service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:24:22.032980 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1241/2499] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:24:21 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:24:23.494780 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914218c-b68d-45ff-9e3e-6f771e759e84 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:24:23.495270 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914218c-b68d-45ff-9e3e-6f771e759e84 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:24:23.495368 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914218c-b68d-45ff-9e3e-6f771e759e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:24:23.514099 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-5914218c-b68d-45ff-9e3e-6f771e759e84 None None] MFA Rules not processed for user `c23c732f628c487d89d79f4ed8088b0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:24:23.515315 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5914218c-b68d-45ff-9e3e-6f771e759e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:24:23.523170 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1259/2500] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:24:23 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:24:32.028486 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=82,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:33.508948 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:01.103985 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9f27d-feea-40df-b54a-9309a61011b9 service nova] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:01.106198 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d1a9f27d-feea-40df-b54a-9309a61011b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:01.119442 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9f27d-feea-40df-b54a-9309a61011b9 service nova] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:01.123023 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae606c6a-5e45-4859-824f-8adbcf8596ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:01.123619 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae606c6a-5e45-4859-824f-8adbcf8596ef service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:01.123899 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae606c6a-5e45-4859-824f-8adbcf8596ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:01.124171 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae606c6a-5e45-4859-824f-8adbcf8596ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:01.125996 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-ae606c6a-5e45-4859-824f-8adbcf8596ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:01.138011 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae606c6a-5e45-4859-824f-8adbcf8596ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:01.139470 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae606c6a-5e45-4859-824f-8adbcf8596ef service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:01.149236 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1242/2501] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:25:04.046429 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914218c-b68d-45ff-9e3e-6f771e759e84 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:04.047906 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5914218c-b68d-45ff-9e3e-6f771e759e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:04.119474 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae606c6a-5e45-4859-824f-8adbcf8596ef service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:04.122221 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-ae606c6a-5e45-4859-824f-8adbcf8596ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:04.145020 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae606c6a-5e45-4859-824f-8adbcf8596ef service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:04.154278 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3dc8c5-f05b-46bb-b333-23432a744c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:04.154988 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3dc8c5-f05b-46bb-b333-23432a744c46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:04.155291 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3dc8c5-f05b-46bb-b333-23432a744c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:04.155592 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3dc8c5-f05b-46bb-b333-23432a744c46 admin admin] PATH_INFO: `/v3/users/f8ae8fa948c34e75a7dec755f29d5c0a` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:04.158959 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914218c-b68d-45ff-9e3e-6f771e759e84 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:04.163713 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3dc8c5-f05b-46bb-b333-23432a744c46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8ae8fa948c34e75a7dec755f29d5c0a)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:04.165397 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d1636-b473-4ae4-a9e5-da6a31a28e51 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece00ea631594381bf1c27cfc2ece6f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:04.166072 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d1636-b473-4ae4-a9e5-da6a31a28e51 service placement] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:04.166359 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d1636-b473-4ae4-a9e5-da6a31a28e51 service placement] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:04.166673 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d1636-b473-4ae4-a9e5-da6a31a28e51 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:04.166795 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3dc8c5-f05b-46bb-b333-23432a744c46 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:04.168609 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4f2d1636-b473-4ae4-a9e5-da6a31a28e51 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:04.181074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d1636-b473-4ae4-a9e5-da6a31a28e51 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:04.182721 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d1636-b473-4ae4-a9e5-da6a31a28e51 service placement] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:04.193520 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1260/2502] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:25:04.231005 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-7c3dc8c5-f05b-46bb-b333-23432a744c46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8ae8fa948c34e75a7dec755f29d5c0a'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:04.232269 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-7c3dc8c5-f05b-46bb-b333-23432a744c46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8ae8fa948c34e75a7dec755f29d5c0a'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:04.245286 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-7c3dc8c5-f05b-46bb-b333-23432a744c46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8ae8fa948c34e75a7dec755f29d5c0a'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:04.252291 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-7c3dc8c5-f05b-46bb-b333-23432a744c46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8ae8fa948c34e75a7dec755f29d5c0a'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:04.260175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-7c3dc8c5-f05b-46bb-b333-23432a744c46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8ae8fa948c34e75a7dec755f29d5c0a'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:04.266474 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1243/2503] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:25:04 2022] DELETE /identity/v3/users/f8ae8fa948c34e75a7dec755f29d5c0a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:04.441937 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d1636-b473-4ae4-a9e5-da6a31a28e51 service placement] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:04.459504 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d1636-b473-4ae4-a9e5-da6a31a28e51 service placement] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:04.517880 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d20ddd-4fa8-42e4-9f2c-bf611a22eaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:04.518542 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d20ddd-4fa8-42e4-9f2c-bf611a22eaee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:04.518823 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d20ddd-4fa8-42e4-9f2c-bf611a22eaee admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:04.519091 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d20ddd-4fa8-42e4-9f2c-bf611a22eaee admin admin] PATH_INFO: `/v3/projects/e5201974d5644455b4f11d38d5a97198` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:04.520189 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d20ddd-4fa8-42e4-9f2c-bf611a22eaee admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5201974d5644455b4f11d38d5a97198)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:04.522105 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d20ddd-4fa8-42e4-9f2c-bf611a22eaee admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:04.569697 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e9d20ddd-4fa8-42e4-9f2c-bf611a22eaee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5201974d5644455b4f11d38d5a97198', 'request_id': 'req-e9d20ddd-4fa8-42e4-9f2c-bf611a22eaee'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:04.575934 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e9d20ddd-4fa8-42e4-9f2c-bf611a22eaee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5201974d5644455b4f11d38d5a97198', 'request_id': 'req-e9d20ddd-4fa8-42e4-9f2c-bf611a22eaee'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:04.582071 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e9d20ddd-4fa8-42e4-9f2c-bf611a22eaee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5201974d5644455b4f11d38d5a97198', 'request_id': 'req-e9d20ddd-4fa8-42e4-9f2c-bf611a22eaee'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:04.596508 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e9d20ddd-4fa8-42e4-9f2c-bf611a22eaee admin admin] The token cache is being invalidate because project e5201974d5644455b4f11d38d5a97198 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:25:04.596800 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e9d20ddd-4fa8-42e4-9f2c-bf611a22eaee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:04.597413 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e9d20ddd-4fa8-42e4-9f2c-bf611a22eaee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:04.599466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1261/2504] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:25:04 2022] DELETE /identity/v3/projects/e5201974d5644455b4f11d38d5a97198 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:04.604443 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e0374-8f78-42f5-a008-efcd1f061866 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:04.604754 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e0374-8f78-42f5-a008-efcd1f061866 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:04.605030 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e0374-8f78-42f5-a008-efcd1f061866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:04.625519 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-b23e0374-8f78-42f5-a008-efcd1f061866 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:04.626669 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-b23e0374-8f78-42f5-a008-efcd1f061866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:04.687979 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1244/2505] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:04.697185 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24518b-df4e-4e0a-9822-6cb6930d423f None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:04.697466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24518b-df4e-4e0a-9822-6cb6930d423f None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:04.697738 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24518b-df4e-4e0a-9822-6cb6930d423f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:04.717469 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-7a24518b-df4e-4e0a-9822-6cb6930d423f None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:04.718699 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7a24518b-df4e-4e0a-9822-6cb6930d423f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:04.726842 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1262/2506] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:04.731289 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e0374-8f78-42f5-a008-efcd1f061866 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:04.742198 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e0374-8f78-42f5-a008-efcd1f061866 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:04.747707 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2188c-fdca-418e-af83-6635f9c4a1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:04.748500 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2188c-fdca-418e-af83-6635f9c4a1d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:04.748880 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2188c-fdca-418e-af83-6635f9c4a1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:04.749233 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2188c-fdca-418e-af83-6635f9c4a1d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:04.750009 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2188c-fdca-418e-af83-6635f9c4a1d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:25:04.750360 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2188c-fdca-418e-af83-6635f9c4a1d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:04.752070 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2188c-fdca-418e-af83-6635f9c4a1d4 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:04.764972 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1245/2507] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:25:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:25:04.769694 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24518b-df4e-4e0a-9822-6cb6930d423f None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:04.779276 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24518b-df4e-4e0a-9822-6cb6930d423f None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:04.783965 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf347257-8155-4fda-9297-4869e64fffd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:04.784566 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf347257-8155-4fda-9297-4869e64fffd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:04.784845 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf347257-8155-4fda-9297-4869e64fffd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:04.785209 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf347257-8155-4fda-9297-4869e64fffd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:04.785885 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf347257-8155-4fda-9297-4869e64fffd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:04.787826 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf347257-8155-4fda-9297-4869e64fffd5 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:04.799320 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:04.816863 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1263/2508] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:25:04 2022] POST /identity/v3/projects => generated 355 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:25:04.820949 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2188c-fdca-418e-af83-6635f9c4a1d4 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:04.830862 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2188c-fdca-418e-af83-6635f9c4a1d4 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:04.874401 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:04.889627 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1cefd-0e0d-4445-91b1-e1b09f5568b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:04.890149 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1cefd-0e0d-4445-91b1-e1b09f5568b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:04.890479 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1cefd-0e0d-4445-91b1-e1b09f5568b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:04.890753 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1cefd-0e0d-4445-91b1-e1b09f5568b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:04.891389 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1cefd-0e0d-4445-91b1-e1b09f5568b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:04.893299 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1cefd-0e0d-4445-91b1-e1b09f5568b8 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:04.914170 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1246/2509] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:25:04 2022] POST /identity/v3/users => generated 278 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:25:04.918651 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf347257-8155-4fda-9297-4869e64fffd5 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:04.929172 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf347257-8155-4fda-9297-4869e64fffd5 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:04.934615 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512047c-2f27-4ceb-b814-b11073bf48f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:04.935206 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512047c-2f27-4ceb-b814-b11073bf48f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:04.935484 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512047c-2f27-4ceb-b814-b11073bf48f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:04.935777 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512047c-2f27-4ceb-b814-b11073bf48f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:04.936420 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c512047c-2f27-4ceb-b814-b11073bf48f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:04.938005 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c512047c-2f27-4ceb-b814-b11073bf48f4 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:04.948360 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1264/2510] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:25:04.952142 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1cefd-0e0d-4445-91b1-e1b09f5568b8 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:04.962099 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1cefd-0e0d-4445-91b1-e1b09f5568b8 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:04.967016 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b1f60-3a8c-44e5-90ea-75e0eb2dfba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:04.967611 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b1f60-3a8c-44e5-90ea-75e0eb2dfba6 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:04.967896 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b1f60-3a8c-44e5-90ea-75e0eb2dfba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:04.968171 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b1f60-3a8c-44e5-90ea-75e0eb2dfba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:04.968837 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b1f60-3a8c-44e5-90ea-75e0eb2dfba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:04.970429 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b1f60-3a8c-44e5-90ea-75e0eb2dfba6 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:04.982137 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1247/2511] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:25:04.986300 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512047c-2f27-4ceb-b814-b11073bf48f4 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:04.997249 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512047c-2f27-4ceb-b814-b11073bf48f4 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:05.002036 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781313c-139f-4069-8430-1c4a81ac049e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:05.002757 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781313c-139f-4069-8430-1c4a81ac049e admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:05.003064 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781313c-139f-4069-8430-1c4a81ac049e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:05.003344 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781313c-139f-4069-8430-1c4a81ac049e admin admin] PATH_INFO: `/v3/projects/6a27c372a7464d48890fd0d6739cf9f2/users/8b7b9e53a5fd4f54b3bc3bf0414db14c/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:05.018282 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781313c-139f-4069-8430-1c4a81ac049e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a27c372a7464d48890fd0d6739cf9f2, user_id=8b7b9e53a5fd4f54b3bc3bf0414db14c, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:05.020981 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781313c-139f-4069-8430-1c4a81ac049e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:05.034000 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1265/2512] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:25:04 2022] PUT /identity/v3/projects/6a27c372a7464d48890fd0d6739cf9f2/users/8b7b9e53a5fd4f54b3bc3bf0414db14c/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:05.044893 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df937b-255e-4de3-aa1b-88c72a944e98 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:05.045179 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df937b-255e-4de3-aa1b-88c72a944e98 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:05.045479 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df937b-255e-4de3-aa1b-88c72a944e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:05.073569 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-69df937b-255e-4de3-aa1b-88c72a944e98 None None] MFA Rules not processed for user `8b7b9e53a5fd4f54b3bc3bf0414db14c`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:05.074817 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-69df937b-255e-4de3-aa1b-88c72a944e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:05.138038 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1248/2513] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:05 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:05.142567 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781313c-139f-4069-8430-1c4a81ac049e admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:05.204095 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781313c-139f-4069-8430-1c4a81ac049e admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:05.209332 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea63f81-61a3-4ae8-adcf-44cfc9337b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:05.209946 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea63f81-61a3-4ae8-adcf-44cfc9337b4e admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:05.210237 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea63f81-61a3-4ae8-adcf-44cfc9337b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:05.210532 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea63f81-61a3-4ae8-adcf-44cfc9337b4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:05.211849 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea63f81-61a3-4ae8-adcf-44cfc9337b4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:05.213570 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea63f81-61a3-4ae8-adcf-44cfc9337b4e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:05.246946 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1266/2514] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:25:05 2022] POST /identity/v3/projects => generated 353 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:25:05.248043 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df937b-255e-4de3-aa1b-88c72a944e98 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:05.259111 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df937b-255e-4de3-aa1b-88c72a944e98 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:05.324530 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8b29b-4a9b-45ca-be3f-86d232ccdb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:05.325149 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8b29b-4a9b-45ca-be3f-86d232ccdb31 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:05.325433 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8b29b-4a9b-45ca-be3f-86d232ccdb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:05.325708 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8b29b-4a9b-45ca-be3f-86d232ccdb31 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:05.326348 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c8b29b-4a9b-45ca-be3f-86d232ccdb31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:05.328320 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c8b29b-4a9b-45ca-be3f-86d232ccdb31 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:05.351080 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1249/2515] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:25:05 2022] POST /identity/v3/users => generated 283 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:25:05.355788 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea63f81-61a3-4ae8-adcf-44cfc9337b4e admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:05.366379 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea63f81-61a3-4ae8-adcf-44cfc9337b4e admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:05.371081 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2b7d5-f1a4-4b1d-9116-a9e1bc845291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:05.371682 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2b7d5-f1a4-4b1d-9116-a9e1bc845291 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:05.371957 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2b7d5-f1a4-4b1d-9116-a9e1bc845291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:05.372232 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2b7d5-f1a4-4b1d-9116-a9e1bc845291 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:05.372873 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f2b7d5-f1a4-4b1d-9116-a9e1bc845291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:05.375889 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f2b7d5-f1a4-4b1d-9116-a9e1bc845291 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:05.388995 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1267/2516] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:25:05.393405 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8b29b-4a9b-45ca-be3f-86d232ccdb31 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:05.403801 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8b29b-4a9b-45ca-be3f-86d232ccdb31 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:05.408392 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66fde5e-cf0f-403a-b258-374d87be81c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:05.409038 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66fde5e-cf0f-403a-b258-374d87be81c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:05.409317 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66fde5e-cf0f-403a-b258-374d87be81c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:05.409590 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66fde5e-cf0f-403a-b258-374d87be81c7 admin admin] PATH_INFO: `/v3/projects/7cf468b3642d4b349d8ad77f011af6b9/users/ec584b9bea264178ae08c66a7594b589/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:05.424601 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66fde5e-cf0f-403a-b258-374d87be81c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cf468b3642d4b349d8ad77f011af6b9, user_id=ec584b9bea264178ae08c66a7594b589, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:05.427289 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66fde5e-cf0f-403a-b258-374d87be81c7 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:05.440086 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1250/2517] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:25:05 2022] PUT /identity/v3/projects/7cf468b3642d4b349d8ad77f011af6b9/users/ec584b9bea264178ae08c66a7594b589/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:05.444300 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2b7d5-f1a4-4b1d-9116-a9e1bc845291 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:05.454685 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2b7d5-f1a4-4b1d-9116-a9e1bc845291 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:05.510594 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e8840-c1ae-45ee-8360-adf271491d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:05.511188 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e8840-c1ae-45ee-8360-adf271491d7d admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:05.511465 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e8840-c1ae-45ee-8360-adf271491d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:05.511739 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e8840-c1ae-45ee-8360-adf271491d7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:05.512365 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e8840-c1ae-45ee-8360-adf271491d7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:05.513944 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e8840-c1ae-45ee-8360-adf271491d7d admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:05.523451 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1268/2518] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:25:05.528217 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66fde5e-cf0f-403a-b258-374d87be81c7 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:05.539130 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66fde5e-cf0f-403a-b258-374d87be81c7 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:05.544435 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e89dad-d722-4b26-8c7d-ea93603f7d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:05.545098 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e89dad-d722-4b26-8c7d-ea93603f7d2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:05.545387 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e89dad-d722-4b26-8c7d-ea93603f7d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:05.545686 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e89dad-d722-4b26-8c7d-ea93603f7d2b admin admin] PATH_INFO: `/v3/projects/7cf468b3642d4b349d8ad77f011af6b9/users/ec584b9bea264178ae08c66a7594b589/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:05.547640 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e89dad-d722-4b26-8c7d-ea93603f7d2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cf468b3642d4b349d8ad77f011af6b9, user_id=ec584b9bea264178ae08c66a7594b589, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:05.550291 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e89dad-d722-4b26-8c7d-ea93603f7d2b admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:05.560739 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1251/2519] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:25:05 2022] PUT /identity/v3/projects/7cf468b3642d4b349d8ad77f011af6b9/users/ec584b9bea264178ae08c66a7594b589/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:05.573581 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11daee-1c25-4227-b476-b97951eeb1bc None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:05.573867 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11daee-1c25-4227-b476-b97951eeb1bc None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:05.574138 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11daee-1c25-4227-b476-b97951eeb1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:05.602993 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-0d11daee-1c25-4227-b476-b97951eeb1bc None None] MFA Rules not processed for user `ec584b9bea264178ae08c66a7594b589`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:05.604178 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0d11daee-1c25-4227-b476-b97951eeb1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:05.616300 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:05.672126 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1269/2520] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:05 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:05.683646 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e89dad-d722-4b26-8c7d-ea93603f7d2b admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:05.685488 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-45e89dad-d722-4b26-8c7d-ea93603f7d2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:05.695550 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:05.745893 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e89dad-d722-4b26-8c7d-ea93603f7d2b admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:05.749635 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9991a44-a49b-4690-b30b-9e269cacfc23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:05.750212 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9991a44-a49b-4690-b30b-9e269cacfc23 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:05.750520 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9991a44-a49b-4690-b30b-9e269cacfc23 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:05.750798 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9991a44-a49b-4690-b30b-9e269cacfc23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:05.760265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9991a44-a49b-4690-b30b-9e269cacfc23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:05.761690 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9991a44-a49b-4690-b30b-9e269cacfc23 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:05.770971 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1252/2521] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:05 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:25:05.865674 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11daee-1c25-4227-b476-b97951eeb1bc None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:05.881449 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11daee-1c25-4227-b476-b97951eeb1bc None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:05.886001 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a137dd2-d6c2-476a-ad73-656d402ccdbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:05.886708 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a137dd2-d6c2-476a-ad73-656d402ccdbc service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:05.887105 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a137dd2-d6c2-476a-ad73-656d402ccdbc service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:05.887380 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a137dd2-d6c2-476a-ad73-656d402ccdbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:05.944627 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a137dd2-d6c2-476a-ad73-656d402ccdbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:05.946706 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a137dd2-d6c2-476a-ad73-656d402ccdbc service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:05.955957 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1270/2522] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:05 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:25:15.766927 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=23 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:15.951700 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=50 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:20.855803 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9991a44-a49b-4690-b30b-9e269cacfc23 service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:20.916623 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9991a44-a49b-4690-b30b-9e269cacfc23 service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:20.921190 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5db445-ffa0-4083-9f07-93ae692b0c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:20.921814 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5db445-ffa0-4083-9f07-93ae692b0c7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:20.922098 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5db445-ffa0-4083-9f07-93ae692b0c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:20.922365 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5db445-ffa0-4083-9f07-93ae692b0c7c admin admin] PATH_INFO: `/v3/users/8b7b9e53a5fd4f54b3bc3bf0414db14c` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:20.923548 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5db445-ffa0-4083-9f07-93ae692b0c7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b7b9e53a5fd4f54b3bc3bf0414db14c)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:20.925449 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5db445-ffa0-4083-9f07-93ae692b0c7c admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:20.972687 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-fd5db445-ffa0-4083-9f07-93ae692b0c7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b7b9e53a5fd4f54b3bc3bf0414db14c'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:20.973348 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-fd5db445-ffa0-4083-9f07-93ae692b0c7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b7b9e53a5fd4f54b3bc3bf0414db14c'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:20.985926 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-fd5db445-ffa0-4083-9f07-93ae692b0c7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b7b9e53a5fd4f54b3bc3bf0414db14c'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:20.996049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-fd5db445-ffa0-4083-9f07-93ae692b0c7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b7b9e53a5fd4f54b3bc3bf0414db14c'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:21.005751 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-fd5db445-ffa0-4083-9f07-93ae692b0c7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b7b9e53a5fd4f54b3bc3bf0414db14c'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:21.014430 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1253/2523] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:25:20 2022] DELETE /identity/v3/users/8b7b9e53a5fd4f54b3bc3bf0414db14c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:21.018955 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51526d8-c1d5-4e88-9dd1-32f5e2365385 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:21.019565 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51526d8-c1d5-4e88-9dd1-32f5e2365385 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:21.019736 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51526d8-c1d5-4e88-9dd1-32f5e2365385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:21.041229 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-d51526d8-c1d5-4e88-9dd1-32f5e2365385 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:21.042627 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d51526d8-c1d5-4e88-9dd1-32f5e2365385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:21.110813 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1271/2524] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:25:21.121689 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5db445-ffa0-4083-9f07-93ae692b0c7c admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:21.123199 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-fd5db445-ffa0-4083-9f07-93ae692b0c7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:21.196501 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5db445-ffa0-4083-9f07-93ae692b0c7c admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:21.201244 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2a5fc-9bdd-49d9-b80c-775618962aea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:21.201956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2a5fc-9bdd-49d9-b80c-775618962aea service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:21.202321 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2a5fc-9bdd-49d9-b80c-775618962aea service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:21.202712 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2a5fc-9bdd-49d9-b80c-775618962aea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:21.212566 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f2a5fc-9bdd-49d9-b80c-775618962aea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:21.215738 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f2a5fc-9bdd-49d9-b80c-775618962aea service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:21.227998 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1254/2525] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:25:21.565433 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51526d8-c1d5-4e88-9dd1-32f5e2365385 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:21.567415 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d51526d8-c1d5-4e88-9dd1-32f5e2365385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:21.587178 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51526d8-c1d5-4e88-9dd1-32f5e2365385 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:21.593855 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c949a-33cf-4555-9361-c27c9bb2d1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:21.595435 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c949a-33cf-4555-9361-c27c9bb2d1e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:21.595720 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c949a-33cf-4555-9361-c27c9bb2d1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:21.596374 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c949a-33cf-4555-9361-c27c9bb2d1e7 admin admin] PATH_INFO: `/v3/projects/6a27c372a7464d48890fd0d6739cf9f2` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:21.597611 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c949a-33cf-4555-9361-c27c9bb2d1e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a27c372a7464d48890fd0d6739cf9f2)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:21.600778 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c949a-33cf-4555-9361-c27c9bb2d1e7 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:21.652169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0b9c949a-33cf-4555-9361-c27c9bb2d1e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a27c372a7464d48890fd0d6739cf9f2', 'request_id': 'req-0b9c949a-33cf-4555-9361-c27c9bb2d1e7'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:21.658746 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0b9c949a-33cf-4555-9361-c27c9bb2d1e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a27c372a7464d48890fd0d6739cf9f2', 'request_id': 'req-0b9c949a-33cf-4555-9361-c27c9bb2d1e7'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:21.665963 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0b9c949a-33cf-4555-9361-c27c9bb2d1e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a27c372a7464d48890fd0d6739cf9f2', 'request_id': 'req-0b9c949a-33cf-4555-9361-c27c9bb2d1e7'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:21.679087 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0b9c949a-33cf-4555-9361-c27c9bb2d1e7 admin admin] The token cache is being invalidate because project 6a27c372a7464d48890fd0d6739cf9f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:25:21.679387 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0b9c949a-33cf-4555-9361-c27c9bb2d1e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:21.680575 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0b9c949a-33cf-4555-9361-c27c9bb2d1e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:21.682080 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1272/2526] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:25:21 2022] DELETE /identity/v3/projects/6a27c372a7464d48890fd0d6739cf9f2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:25:21.686616 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2a5fc-9bdd-49d9-b80c-775618962aea service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:21.696209 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2a5fc-9bdd-49d9-b80c-775618962aea service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:21.715996 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:21.757251 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039a996-181e-468d-9628-3ff42849795e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:21.757881 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039a996-181e-468d-9628-3ff42849795e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:21.758160 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039a996-181e-468d-9628-3ff42849795e admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:21.758428 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039a996-181e-468d-9628-3ff42849795e admin admin] PATH_INFO: `/v3/users/ec584b9bea264178ae08c66a7594b589` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:21.759588 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4039a996-181e-468d-9628-3ff42849795e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec584b9bea264178ae08c66a7594b589)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:21.761499 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4039a996-181e-468d-9628-3ff42849795e admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:21.808703 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-4039a996-181e-468d-9628-3ff42849795e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec584b9bea264178ae08c66a7594b589'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:21.809338 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-4039a996-181e-468d-9628-3ff42849795e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec584b9bea264178ae08c66a7594b589'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:21.821708 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-4039a996-181e-468d-9628-3ff42849795e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec584b9bea264178ae08c66a7594b589'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:21.828505 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-4039a996-181e-468d-9628-3ff42849795e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec584b9bea264178ae08c66a7594b589'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:21.837801 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-4039a996-181e-468d-9628-3ff42849795e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec584b9bea264178ae08c66a7594b589'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:21.844398 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1255/2527] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:25:21 2022] DELETE /identity/v3/users/ec584b9bea264178ae08c66a7594b589 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:22.128820 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c949a-33cf-4555-9361-c27c9bb2d1e7 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:22.131088 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0b9c949a-33cf-4555-9361-c27c9bb2d1e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:22.145842 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c949a-33cf-4555-9361-c27c9bb2d1e7 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:22.205410 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882658b2-bbda-4893-868c-86e0e1aa70d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:22.206050 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882658b2-bbda-4893-868c-86e0e1aa70d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:22.206324 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882658b2-bbda-4893-868c-86e0e1aa70d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:22.206643 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882658b2-bbda-4893-868c-86e0e1aa70d4 admin admin] PATH_INFO: `/v3/projects/7cf468b3642d4b349d8ad77f011af6b9` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:22.207752 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882658b2-bbda-4893-868c-86e0e1aa70d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cf468b3642d4b349d8ad77f011af6b9)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:22.209669 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882658b2-bbda-4893-868c-86e0e1aa70d4 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:22.240028 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:22.259428 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-882658b2-bbda-4893-868c-86e0e1aa70d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cf468b3642d4b349d8ad77f011af6b9', 'request_id': 'req-882658b2-bbda-4893-868c-86e0e1aa70d4'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:22.265615 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-882658b2-bbda-4893-868c-86e0e1aa70d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cf468b3642d4b349d8ad77f011af6b9', 'request_id': 'req-882658b2-bbda-4893-868c-86e0e1aa70d4'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:22.272054 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-882658b2-bbda-4893-868c-86e0e1aa70d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cf468b3642d4b349d8ad77f011af6b9', 'request_id': 'req-882658b2-bbda-4893-868c-86e0e1aa70d4'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:22.285712 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-882658b2-bbda-4893-868c-86e0e1aa70d4 admin admin] The token cache is being invalidate because project 7cf468b3642d4b349d8ad77f011af6b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:25:22.285984 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-882658b2-bbda-4893-868c-86e0e1aa70d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:22.286689 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-882658b2-bbda-4893-868c-86e0e1aa70d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:22.288142 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1273/2528] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:25:22 2022] DELETE /identity/v3/projects/7cf468b3642d4b349d8ad77f011af6b9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:22.293038 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb91db7-be7e-4040-8aac-85680cef0c76 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:22.293507 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb91db7-be7e-4040-8aac-85680cef0c76 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:22.293627 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb91db7-be7e-4040-8aac-85680cef0c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:22.313454 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-eeb91db7-be7e-4040-8aac-85680cef0c76 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:22.314701 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-eeb91db7-be7e-4040-8aac-85680cef0c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:22.374879 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1256/2529] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:25:22.383280 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295b9c2-1e54-46a0-b230-07ba723c77d3 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:22.383564 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295b9c2-1e54-46a0-b230-07ba723c77d3 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:22.383844 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295b9c2-1e54-46a0-b230-07ba723c77d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:22.404396 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-b295b9c2-1e54-46a0-b230-07ba723c77d3 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:22.405598 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b295b9c2-1e54-46a0-b230-07ba723c77d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:22.413633 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1274/2530] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:22.417974 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb91db7-be7e-4040-8aac-85680cef0c76 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:22.427699 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb91db7-be7e-4040-8aac-85680cef0c76 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:22.432759 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474bd83a-547d-410e-9f32-3fe02b254c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:22.433351 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474bd83a-547d-410e-9f32-3fe02b254c3b admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:22.433628 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474bd83a-547d-410e-9f32-3fe02b254c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:22.433898 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474bd83a-547d-410e-9f32-3fe02b254c3b admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:22.434580 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474bd83a-547d-410e-9f32-3fe02b254c3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:25:22.434877 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474bd83a-547d-410e-9f32-3fe02b254c3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:22.436463 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474bd83a-547d-410e-9f32-3fe02b254c3b admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:22.450452 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1257/2531] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:25:22.455105 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b295b9c2-1e54-46a0-b230-07ba723c77d3 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:22.464799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b295b9c2-1e54-46a0-b230-07ba723c77d3 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:22.469627 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe801d5e-b231-48cb-9c4f-829a537e1a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:22.470248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe801d5e-b231-48cb-9c4f-829a537e1a40 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:22.470619 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe801d5e-b231-48cb-9c4f-829a537e1a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:22.470887 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe801d5e-b231-48cb-9c4f-829a537e1a40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:22.471523 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe801d5e-b231-48cb-9c4f-829a537e1a40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:22.473417 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe801d5e-b231-48cb-9c4f-829a537e1a40 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:22.501463 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1275/2532] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:25:22 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:25:22.507518 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474bd83a-547d-410e-9f32-3fe02b254c3b admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:22.518655 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474bd83a-547d-410e-9f32-3fe02b254c3b admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:22.551191 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:22.587230 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67435f5-f99e-4a66-b58e-be7702522429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:22.587886 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67435f5-f99e-4a66-b58e-be7702522429 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:22.588163 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67435f5-f99e-4a66-b58e-be7702522429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:22.589098 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67435f5-f99e-4a66-b58e-be7702522429 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:22.589327 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67435f5-f99e-4a66-b58e-be7702522429 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:22.591294 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67435f5-f99e-4a66-b58e-be7702522429 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:22.613965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1258/2533] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:25:22 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:25:22.618937 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe801d5e-b231-48cb-9c4f-829a537e1a40 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:22.629845 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe801d5e-b231-48cb-9c4f-829a537e1a40 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:22.635470 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf43f1c-7afb-400c-8b29-f25dd1fd11c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:22.635977 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf43f1c-7afb-400c-8b29-f25dd1fd11c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:22.636252 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf43f1c-7afb-400c-8b29-f25dd1fd11c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:22.636561 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf43f1c-7afb-400c-8b29-f25dd1fd11c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:22.637172 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf43f1c-7afb-400c-8b29-f25dd1fd11c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:22.638822 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf43f1c-7afb-400c-8b29-f25dd1fd11c5 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:22.650528 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1276/2534] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:25:22.654036 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67435f5-f99e-4a66-b58e-be7702522429 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:22.673693 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67435f5-f99e-4a66-b58e-be7702522429 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:22.678826 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba0863-1ebe-4e49-a361-acb1a2366cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:22.679989 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba0863-1ebe-4e49-a361-acb1a2366cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:22.680268 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba0863-1ebe-4e49-a361-acb1a2366cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:22.680539 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba0863-1ebe-4e49-a361-acb1a2366cc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:22.681214 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba0863-1ebe-4e49-a361-acb1a2366cc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:22.682885 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba0863-1ebe-4e49-a361-acb1a2366cc2 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:22.698697 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1259/2535] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:25:22.703043 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf43f1c-7afb-400c-8b29-f25dd1fd11c5 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:22.714816 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf43f1c-7afb-400c-8b29-f25dd1fd11c5 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:22.721353 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706785c-dfc7-4e83-bbcd-d8e11bb18f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:22.722072 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706785c-dfc7-4e83-bbcd-d8e11bb18f6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:22.722536 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706785c-dfc7-4e83-bbcd-d8e11bb18f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:22.722778 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706785c-dfc7-4e83-bbcd-d8e11bb18f6b admin admin] PATH_INFO: `/v3/projects/874d6f0c18c449dba8af22eeb0411381/users/d58412e3edb04d1299cbed2f0ffaca82/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:22.739594 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9706785c-dfc7-4e83-bbcd-d8e11bb18f6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=874d6f0c18c449dba8af22eeb0411381, user_id=d58412e3edb04d1299cbed2f0ffaca82, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:22.742879 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9706785c-dfc7-4e83-bbcd-d8e11bb18f6b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:22.758590 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1277/2536] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:25:22 2022] PUT /identity/v3/projects/874d6f0c18c449dba8af22eeb0411381/users/d58412e3edb04d1299cbed2f0ffaca82/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:22.769496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f52e59-b91e-47ca-b3a1-5a9d39b9c6fe None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:22.769915 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f52e59-b91e-47ca-b3a1-5a9d39b9c6fe None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:22.770022 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f52e59-b91e-47ca-b3a1-5a9d39b9c6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:22.802358 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-f0f52e59-b91e-47ca-b3a1-5a9d39b9c6fe None None] MFA Rules not processed for user `d58412e3edb04d1299cbed2f0ffaca82`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:22.803779 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f0f52e59-b91e-47ca-b3a1-5a9d39b9c6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:22.883518 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1260/2537] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:22.888648 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706785c-dfc7-4e83-bbcd-d8e11bb18f6b admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:22.966048 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706785c-dfc7-4e83-bbcd-d8e11bb18f6b admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:22.975198 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec5641-b8b3-43e3-810f-6130a7401f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:22.976048 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec5641-b8b3-43e3-810f-6130a7401f29 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:22.976991 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec5641-b8b3-43e3-810f-6130a7401f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:22.977280 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec5641-b8b3-43e3-810f-6130a7401f29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:22.977923 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec5641-b8b3-43e3-810f-6130a7401f29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:22.979877 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec5641-b8b3-43e3-810f-6130a7401f29 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:23.012220 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1278/2538] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:25:22 2022] POST /identity/v3/projects => generated 381 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:25:23.013962 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f52e59-b91e-47ca-b3a1-5a9d39b9c6fe None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:23.026485 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f52e59-b91e-47ca-b3a1-5a9d39b9c6fe None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:23.091381 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a9998-0e3e-4194-a73e-81a9394d49a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:23.091967 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a9998-0e3e-4194-a73e-81a9394d49a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:23.092236 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a9998-0e3e-4194-a73e-81a9394d49a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:23.092507 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a9998-0e3e-4194-a73e-81a9394d49a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:23.093186 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a9998-0e3e-4194-a73e-81a9394d49a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:23.095170 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a9998-0e3e-4194-a73e-81a9394d49a6 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:23.120718 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1261/2539] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:25:23 2022] POST /identity/v3/users => generated 297 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:25:23.125513 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec5641-b8b3-43e3-810f-6130a7401f29 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:23.138692 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec5641-b8b3-43e3-810f-6130a7401f29 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:23.144821 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bebac6-6d51-4759-b8d3-ccf1084d76b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:23.145725 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bebac6-6d51-4759-b8d3-ccf1084d76b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:23.146261 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bebac6-6d51-4759-b8d3-ccf1084d76b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:23.146585 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bebac6-6d51-4759-b8d3-ccf1084d76b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:23.147233 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bebac6-6d51-4759-b8d3-ccf1084d76b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:23.149043 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bebac6-6d51-4759-b8d3-ccf1084d76b5 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:23.163437 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1279/2540] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:25:23.169444 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a9998-0e3e-4194-a73e-81a9394d49a6 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:23.180364 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a9998-0e3e-4194-a73e-81a9394d49a6 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:23.186327 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d116b-217f-40a1-a2f3-4f4c1c79d3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:23.187106 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d116b-217f-40a1-a2f3-4f4c1c79d3c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:23.187422 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d116b-217f-40a1-a2f3-4f4c1c79d3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:23.187722 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d116b-217f-40a1-a2f3-4f4c1c79d3c5 admin admin] PATH_INFO: `/v3/projects/c06ec68cbec143cf80f60232050c7faf/users/ae0017aeab034773816321d127fdcdba/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:23.207214 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d116b-217f-40a1-a2f3-4f4c1c79d3c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c06ec68cbec143cf80f60232050c7faf, user_id=ae0017aeab034773816321d127fdcdba, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:23.210337 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d116b-217f-40a1-a2f3-4f4c1c79d3c5 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:23.232310 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1262/2541] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:25:23 2022] PUT /identity/v3/projects/c06ec68cbec143cf80f60232050c7faf/users/ae0017aeab034773816321d127fdcdba/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:23.237659 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bebac6-6d51-4759-b8d3-ccf1084d76b5 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:23.248253 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bebac6-6d51-4759-b8d3-ccf1084d76b5 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:23.279840 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:23.335431 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d822f19-b3a1-442a-8c72-5ee3bc44a693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:23.336557 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d822f19-b3a1-442a-8c72-5ee3bc44a693 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:23.336899 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d822f19-b3a1-442a-8c72-5ee3bc44a693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:23.337250 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d822f19-b3a1-442a-8c72-5ee3bc44a693 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:23.337973 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d822f19-b3a1-442a-8c72-5ee3bc44a693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:23.340080 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d822f19-b3a1-442a-8c72-5ee3bc44a693 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:23.353450 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1280/2542] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:25:23.357655 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d116b-217f-40a1-a2f3-4f4c1c79d3c5 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:23.364441 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:23.371440 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d116b-217f-40a1-a2f3-4f4c1c79d3c5 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:23.377553 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe6be6-39b3-4093-aeab-f10b21e800bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:23.378283 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe6be6-39b3-4093-aeab-f10b21e800bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:23.378578 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe6be6-39b3-4093-aeab-f10b21e800bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:23.378852 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe6be6-39b3-4093-aeab-f10b21e800bc admin admin] PATH_INFO: `/v3/projects/c06ec68cbec143cf80f60232050c7faf/users/ae0017aeab034773816321d127fdcdba/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:23.381281 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe6be6-39b3-4093-aeab-f10b21e800bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c06ec68cbec143cf80f60232050c7faf, user_id=ae0017aeab034773816321d127fdcdba, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:23.384180 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe6be6-39b3-4093-aeab-f10b21e800bc admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:23.396991 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1263/2543] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:25:23 2022] PUT /identity/v3/projects/c06ec68cbec143cf80f60232050c7faf/users/ae0017aeab034773816321d127fdcdba/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:25:23.408858 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186936f-ccb5-4643-a53a-c0d3777e206c None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:23.409360 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186936f-ccb5-4643-a53a-c0d3777e206c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:23.409655 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186936f-ccb5-4643-a53a-c0d3777e206c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:23.455207 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-f186936f-ccb5-4643-a53a-c0d3777e206c None None] MFA Rules not processed for user `ae0017aeab034773816321d127fdcdba`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:23.458157 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f186936f-ccb5-4643-a53a-c0d3777e206c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:23.549540 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1281/2544] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:23 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:23.562483 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe6be6-39b3-4093-aeab-f10b21e800bc admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:23.564215 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-7bfe6be6-39b3-4093-aeab-f10b21e800bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:23.639553 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe6be6-39b3-4093-aeab-f10b21e800bc admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:23.643139 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a2e98-d51f-4cd7-a32f-e9ca62c160f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:23.643743 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a2e98-d51f-4cd7-a32f-e9ca62c160f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:23.644018 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a2e98-d51f-4cd7-a32f-e9ca62c160f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:23.644288 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a2e98-d51f-4cd7-a32f-e9ca62c160f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:23.653848 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06a2e98-d51f-4cd7-a32f-e9ca62c160f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:23.655290 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06a2e98-d51f-4cd7-a32f-e9ca62c160f1 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:23.664958 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1264/2545] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:23 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:25:23.999632 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186936f-ccb5-4643-a53a-c0d3777e206c None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:24.010411 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186936f-ccb5-4643-a53a-c0d3777e206c None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:24.015960 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13419f84-72aa-4c86-b018-76547acfbf11 tempest-VolumeQuotaClassesTest-1425030676 tempest-VolumeQuotaClassesTest-1425030676-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0017aeab034773816321d127fdcdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c06ec68cbec143cf80f60232050c7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:24.016577 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13419f84-72aa-4c86-b018-76547acfbf11 tempest-VolumeQuotaClassesTest-1425030676 tempest-VolumeQuotaClassesTest-1425030676-project-admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:24.016858 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13419f84-72aa-4c86-b018-76547acfbf11 tempest-VolumeQuotaClassesTest-1425030676 tempest-VolumeQuotaClassesTest-1425030676-project-admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:24.017128 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13419f84-72aa-4c86-b018-76547acfbf11 tempest-VolumeQuotaClassesTest-1425030676 tempest-VolumeQuotaClassesTest-1425030676-project-admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:24.017784 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13419f84-72aa-4c86-b018-76547acfbf11 tempest-VolumeQuotaClassesTest-1425030676 tempest-VolumeQuotaClassesTest-1425030676-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:25:24.018089 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13419f84-72aa-4c86-b018-76547acfbf11 tempest-VolumeQuotaClassesTest-1425030676 tempest-VolumeQuotaClassesTest-1425030676-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:24.019732 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13419f84-72aa-4c86-b018-76547acfbf11 tempest-VolumeQuotaClassesTest-1425030676 tempest-VolumeQuotaClassesTest-1425030676-project-admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:24.031984 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1282/2546] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:25:24.036138 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a2e98-d51f-4cd7-a32f-e9ca62c160f1 service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:24.045156 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a2e98-d51f-4cd7-a32f-e9ca62c160f1 service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:24.051021 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc95a81-5783-4fcd-a6d0-293d1e4261c6 tempest-VolumeQuotaClassesTest-1425030676 tempest-VolumeQuotaClassesTest-1425030676-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0017aeab034773816321d127fdcdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c06ec68cbec143cf80f60232050c7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:24.051021 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc95a81-5783-4fcd-a6d0-293d1e4261c6 tempest-VolumeQuotaClassesTest-1425030676 tempest-VolumeQuotaClassesTest-1425030676-project-admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:24.051021 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc95a81-5783-4fcd-a6d0-293d1e4261c6 tempest-VolumeQuotaClassesTest-1425030676 tempest-VolumeQuotaClassesTest-1425030676-project-admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:24.051590 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc95a81-5783-4fcd-a6d0-293d1e4261c6 tempest-VolumeQuotaClassesTest-1425030676 tempest-VolumeQuotaClassesTest-1425030676-project-admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:24.051800 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc95a81-5783-4fcd-a6d0-293d1e4261c6 tempest-VolumeQuotaClassesTest-1425030676 tempest-VolumeQuotaClassesTest-1425030676-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:24.053691 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc95a81-5783-4fcd-a6d0-293d1e4261c6 tempest-VolumeQuotaClassesTest-1425030676 tempest-VolumeQuotaClassesTest-1425030676-project-admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:24.082290 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1265/2547] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:25:24 2022] POST /identity/v3/projects => generated 353 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:25:24.090847 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13419f84-72aa-4c86-b018-76547acfbf11 tempest-VolumeQuotaClassesTest-1425030676 tempest-VolumeQuotaClassesTest-1425030676-project-admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:24.101792 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13419f84-72aa-4c86-b018-76547acfbf11 tempest-VolumeQuotaClassesTest-1425030676 tempest-VolumeQuotaClassesTest-1425030676-project-admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:24.158393 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c67d715-8093-4476-9945-a64ae21885d5 tempest-VolumeQuotaClassesTest-1425030676 tempest-VolumeQuotaClassesTest-1425030676-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0017aeab034773816321d127fdcdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c06ec68cbec143cf80f60232050c7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:24.159138 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67d715-8093-4476-9945-a64ae21885d5 tempest-VolumeQuotaClassesTest-1425030676 tempest-VolumeQuotaClassesTest-1425030676-project-admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:24.159305 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67d715-8093-4476-9945-a64ae21885d5 tempest-VolumeQuotaClassesTest-1425030676 tempest-VolumeQuotaClassesTest-1425030676-project-admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:24.159584 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67d715-8093-4476-9945-a64ae21885d5 tempest-VolumeQuotaClassesTest-1425030676 tempest-VolumeQuotaClassesTest-1425030676-project-admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:24.160263 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c67d715-8093-4476-9945-a64ae21885d5 tempest-VolumeQuotaClassesTest-1425030676 tempest-VolumeQuotaClassesTest-1425030676-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:25:24.160565 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c67d715-8093-4476-9945-a64ae21885d5 tempest-VolumeQuotaClassesTest-1425030676 tempest-VolumeQuotaClassesTest-1425030676-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:24.162190 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c67d715-8093-4476-9945-a64ae21885d5 tempest-VolumeQuotaClassesTest-1425030676 tempest-VolumeQuotaClassesTest-1425030676-project-admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:24.174069 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1283/2548] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:25:24.214169 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc95a81-5783-4fcd-a6d0-293d1e4261c6 tempest-VolumeQuotaClassesTest-1425030676 tempest-VolumeQuotaClassesTest-1425030676-project-admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:24.224502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc95a81-5783-4fcd-a6d0-293d1e4261c6 tempest-VolumeQuotaClassesTest-1425030676 tempest-VolumeQuotaClassesTest-1425030676-project-admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:24.229195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fddc23-2206-4e63-9fd8-f446b9c87587 tempest-VolumeQuotaClassesTest-1425030676 tempest-VolumeQuotaClassesTest-1425030676-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0017aeab034773816321d127fdcdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c06ec68cbec143cf80f60232050c7faf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:24.229817 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fddc23-2206-4e63-9fd8-f446b9c87587 tempest-VolumeQuotaClassesTest-1425030676 tempest-VolumeQuotaClassesTest-1425030676-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:24.230100 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fddc23-2206-4e63-9fd8-f446b9c87587 tempest-VolumeQuotaClassesTest-1425030676 tempest-VolumeQuotaClassesTest-1425030676-project-admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:24.230404 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fddc23-2206-4e63-9fd8-f446b9c87587 tempest-VolumeQuotaClassesTest-1425030676 tempest-VolumeQuotaClassesTest-1425030676-project-admin] PATH_INFO: `/v3/projects/b7ae40192e1a44478410e225e9dda273` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:24.231587 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fddc23-2206-4e63-9fd8-f446b9c87587 tempest-VolumeQuotaClassesTest-1425030676 tempest-VolumeQuotaClassesTest-1425030676-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b7ae40192e1a44478410e225e9dda273)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:24.233482 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fddc23-2206-4e63-9fd8-f446b9c87587 tempest-VolumeQuotaClassesTest-1425030676 tempest-VolumeQuotaClassesTest-1425030676-project-admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:24.281905 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a3fddc23-2206-4e63-9fd8-f446b9c87587 tempest-VolumeQuotaClassesTest-1425030676 tempest-VolumeQuotaClassesTest-1425030676-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7ae40192e1a44478410e225e9dda273', 'request_id': 'req-a3fddc23-2206-4e63-9fd8-f446b9c87587'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:24.287456 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a3fddc23-2206-4e63-9fd8-f446b9c87587 tempest-VolumeQuotaClassesTest-1425030676 tempest-VolumeQuotaClassesTest-1425030676-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7ae40192e1a44478410e225e9dda273', 'request_id': 'req-a3fddc23-2206-4e63-9fd8-f446b9c87587'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:24.294537 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a3fddc23-2206-4e63-9fd8-f446b9c87587 tempest-VolumeQuotaClassesTest-1425030676 tempest-VolumeQuotaClassesTest-1425030676-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7ae40192e1a44478410e225e9dda273', 'request_id': 'req-a3fddc23-2206-4e63-9fd8-f446b9c87587'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:24.306911 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a3fddc23-2206-4e63-9fd8-f446b9c87587 tempest-VolumeQuotaClassesTest-1425030676 tempest-VolumeQuotaClassesTest-1425030676-project-admin] The token cache is being invalidate because project b7ae40192e1a44478410e225e9dda273 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:25:24.307226 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a3fddc23-2206-4e63-9fd8-f446b9c87587 tempest-VolumeQuotaClassesTest-1425030676 tempest-VolumeQuotaClassesTest-1425030676-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:24.307855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a3fddc23-2206-4e63-9fd8-f446b9c87587 tempest-VolumeQuotaClassesTest-1425030676 tempest-VolumeQuotaClassesTest-1425030676-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:24.309348 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1266/2549] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:25:24 2022] DELETE /identity/v3/projects/b7ae40192e1a44478410e225e9dda273 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:25:24.509625 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c67d715-8093-4476-9945-a64ae21885d5 tempest-VolumeQuotaClassesTest-1425030676 tempest-VolumeQuotaClassesTest-1425030676-project-admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:24.511812 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5c67d715-8093-4476-9945-a64ae21885d5 tempest-VolumeQuotaClassesTest-1425030676 tempest-VolumeQuotaClassesTest-1425030676-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:24.559153 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:24.588288 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c67d715-8093-4476-9945-a64ae21885d5 tempest-VolumeQuotaClassesTest-1425030676 tempest-VolumeQuotaClassesTest-1425030676-project-admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:24.655352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427a84f-c601-4d2d-b7f4-f16efc4eb9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:24.656022 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427a84f-c601-4d2d-b7f4-f16efc4eb9b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:24.656302 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427a84f-c601-4d2d-b7f4-f16efc4eb9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:24.656576 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427a84f-c601-4d2d-b7f4-f16efc4eb9b6 admin admin] PATH_INFO: `/v3/users/d58412e3edb04d1299cbed2f0ffaca82` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:24.657761 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2427a84f-c601-4d2d-b7f4-f16efc4eb9b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d58412e3edb04d1299cbed2f0ffaca82)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:24.659728 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2427a84f-c601-4d2d-b7f4-f16efc4eb9b6 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:24.708914 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-2427a84f-c601-4d2d-b7f4-f16efc4eb9b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd58412e3edb04d1299cbed2f0ffaca82'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:24.717883 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-2427a84f-c601-4d2d-b7f4-f16efc4eb9b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd58412e3edb04d1299cbed2f0ffaca82'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:24.725115 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-2427a84f-c601-4d2d-b7f4-f16efc4eb9b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd58412e3edb04d1299cbed2f0ffaca82'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:24.737911 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-2427a84f-c601-4d2d-b7f4-f16efc4eb9b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd58412e3edb04d1299cbed2f0ffaca82'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:24.738602 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-2427a84f-c601-4d2d-b7f4-f16efc4eb9b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd58412e3edb04d1299cbed2f0ffaca82'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:24.744547 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1284/2550] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:25:24 2022] DELETE /identity/v3/users/d58412e3edb04d1299cbed2f0ffaca82 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:24.749254 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f8505-3a40-4a47-bbdf-28bd5512c3df None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:24.749746 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f8505-3a40-4a47-bbdf-28bd5512c3df None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:24.749854 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f8505-3a40-4a47-bbdf-28bd5512c3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:24.769084 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-317f8505-3a40-4a47-bbdf-28bd5512c3df None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:24.770279 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-317f8505-3a40-4a47-bbdf-28bd5512c3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:24.832238 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:24.847766 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1267/2551] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:24.858161 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427a84f-c601-4d2d-b7f4-f16efc4eb9b6 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:24.859669 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2427a84f-c601-4d2d-b7f4-f16efc4eb9b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:24.917618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427a84f-c601-4d2d-b7f4-f16efc4eb9b6 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:24.921333 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7cf2bc-d9e3-417e-a9e5-78ef9c13c7dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:24.921932 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7cf2bc-d9e3-417e-a9e5-78ef9c13c7dc service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:24.922209 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7cf2bc-d9e3-417e-a9e5-78ef9c13c7dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:24.922509 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7cf2bc-d9e3-417e-a9e5-78ef9c13c7dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:24.929644 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:24.932574 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7cf2bc-d9e3-417e-a9e5-78ef9c13c7dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:24.936125 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7cf2bc-d9e3-417e-a9e5-78ef9c13c7dc service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:24.954032 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1285/2552] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:25:25.245343 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f8505-3a40-4a47-bbdf-28bd5512c3df None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:25.246840 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-317f8505-3a40-4a47-bbdf-28bd5512c3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:25.259556 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f8505-3a40-4a47-bbdf-28bd5512c3df None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:25.264245 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb29eab-6208-4d54-a419-483b134fc8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:25.264881 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb29eab-6208-4d54-a419-483b134fc8fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:25.265166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb29eab-6208-4d54-a419-483b134fc8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:25.265441 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb29eab-6208-4d54-a419-483b134fc8fc admin admin] PATH_INFO: `/v3/projects/874d6f0c18c449dba8af22eeb0411381` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:25.266621 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb29eab-6208-4d54-a419-483b134fc8fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=874d6f0c18c449dba8af22eeb0411381)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:25.268545 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb29eab-6208-4d54-a419-483b134fc8fc admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:25.319040 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6bb29eab-6208-4d54-a419-483b134fc8fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '874d6f0c18c449dba8af22eeb0411381', 'request_id': 'req-6bb29eab-6208-4d54-a419-483b134fc8fc'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:25.325945 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6bb29eab-6208-4d54-a419-483b134fc8fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '874d6f0c18c449dba8af22eeb0411381', 'request_id': 'req-6bb29eab-6208-4d54-a419-483b134fc8fc'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:25.332446 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6bb29eab-6208-4d54-a419-483b134fc8fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '874d6f0c18c449dba8af22eeb0411381', 'request_id': 'req-6bb29eab-6208-4d54-a419-483b134fc8fc'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:25.345949 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6bb29eab-6208-4d54-a419-483b134fc8fc admin admin] The token cache is being invalidate because project 874d6f0c18c449dba8af22eeb0411381 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:25:25.346260 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6bb29eab-6208-4d54-a419-483b134fc8fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:25.346915 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6bb29eab-6208-4d54-a419-483b134fc8fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:25.348415 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1268/2553] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:25:25 2022] DELETE /identity/v3/projects/874d6f0c18c449dba8af22eeb0411381 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:25:25.352703 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7cf2bc-d9e3-417e-a9e5-78ef9c13c7dc service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:25.363587 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7cf2bc-d9e3-417e-a9e5-78ef9c13c7dc service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:25.432048 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0acbc-5e87-420e-8599-92ecd5d68f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:25.432742 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0acbc-5e87-420e-8599-92ecd5d68f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:25.433130 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0acbc-5e87-420e-8599-92ecd5d68f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:25.433470 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0acbc-5e87-420e-8599-92ecd5d68f74 admin admin] PATH_INFO: `/v3/users/ae0017aeab034773816321d127fdcdba` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:25.435208 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb0acbc-5e87-420e-8599-92ecd5d68f74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae0017aeab034773816321d127fdcdba)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:25.437765 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb0acbc-5e87-420e-8599-92ecd5d68f74 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:25.490160 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7cb0acbc-5e87-420e-8599-92ecd5d68f74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae0017aeab034773816321d127fdcdba'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:25.502174 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7cb0acbc-5e87-420e-8599-92ecd5d68f74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae0017aeab034773816321d127fdcdba'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:25.511240 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7cb0acbc-5e87-420e-8599-92ecd5d68f74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae0017aeab034773816321d127fdcdba'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:25.533704 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7cb0acbc-5e87-420e-8599-92ecd5d68f74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae0017aeab034773816321d127fdcdba'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:25.534592 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7cb0acbc-5e87-420e-8599-92ecd5d68f74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae0017aeab034773816321d127fdcdba'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:25.545103 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1286/2554] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:25:25 2022] DELETE /identity/v3/users/ae0017aeab034773816321d127fdcdba => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:25.864663 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb29eab-6208-4d54-a419-483b134fc8fc admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:25.866554 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-6bb29eab-6208-4d54-a419-483b134fc8fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:25.881670 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb29eab-6208-4d54-a419-483b134fc8fc admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:25.949282 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04aea8-4043-4edd-9c3c-9e5665ea71a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:25.949922 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04aea8-4043-4edd-9c3c-9e5665ea71a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:25.950206 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04aea8-4043-4edd-9c3c-9e5665ea71a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:25.950503 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04aea8-4043-4edd-9c3c-9e5665ea71a7 admin admin] PATH_INFO: `/v3/projects/c06ec68cbec143cf80f60232050c7faf` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:25.951646 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f04aea8-4043-4edd-9c3c-9e5665ea71a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c06ec68cbec143cf80f60232050c7faf)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:25.953563 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f04aea8-4043-4edd-9c3c-9e5665ea71a7 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:26.000734 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3f04aea8-4043-4edd-9c3c-9e5665ea71a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c06ec68cbec143cf80f60232050c7faf', 'request_id': 'req-3f04aea8-4043-4edd-9c3c-9e5665ea71a7'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:26.006338 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3f04aea8-4043-4edd-9c3c-9e5665ea71a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c06ec68cbec143cf80f60232050c7faf', 'request_id': 'req-3f04aea8-4043-4edd-9c3c-9e5665ea71a7'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:26.012801 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3f04aea8-4043-4edd-9c3c-9e5665ea71a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c06ec68cbec143cf80f60232050c7faf', 'request_id': 'req-3f04aea8-4043-4edd-9c3c-9e5665ea71a7'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:26.025493 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3f04aea8-4043-4edd-9c3c-9e5665ea71a7 admin admin] The token cache is being invalidate because project c06ec68cbec143cf80f60232050c7faf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:25:26.025783 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3f04aea8-4043-4edd-9c3c-9e5665ea71a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:26.026515 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3f04aea8-4043-4edd-9c3c-9e5665ea71a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:26.028044 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1269/2555] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:25:25 2022] DELETE /identity/v3/projects/c06ec68cbec143cf80f60232050c7faf => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:26.033283 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e3742-8b3e-4ce0-9902-46d19b9ecf4d None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:26.033563 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e3742-8b3e-4ce0-9902-46d19b9ecf4d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:26.033837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e3742-8b3e-4ce0-9902-46d19b9ecf4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:26.056987 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-3c3e3742-8b3e-4ce0-9902-46d19b9ecf4d None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:26.058186 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3c3e3742-8b3e-4ce0-9902-46d19b9ecf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:26.115516 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1287/2556] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:26.124011 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d3490-d8ce-436e-8eb6-673fe78e5c40 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:26.124297 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d3490-d8ce-436e-8eb6-673fe78e5c40 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:26.124607 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d3490-d8ce-436e-8eb6-673fe78e5c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:26.139374 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:26.145741 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-e64d3490-d8ce-436e-8eb6-673fe78e5c40 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:26.147562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-e64d3490-d8ce-436e-8eb6-673fe78e5c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:26.157644 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1270/2557] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:26.161831 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e3742-8b3e-4ce0-9902-46d19b9ecf4d None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:26.171975 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e3742-8b3e-4ce0-9902-46d19b9ecf4d None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:26.176651 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced55d67-cebd-4448-be55-4e7f10e148e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:26.177242 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced55d67-cebd-4448-be55-4e7f10e148e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:26.177517 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced55d67-cebd-4448-be55-4e7f10e148e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:26.177786 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced55d67-cebd-4448-be55-4e7f10e148e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:26.178426 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced55d67-cebd-4448-be55-4e7f10e148e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:25:26.178780 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced55d67-cebd-4448-be55-4e7f10e148e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:26.180909 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced55d67-cebd-4448-be55-4e7f10e148e7 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:26.192531 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1288/2558] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:25:26.197142 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d3490-d8ce-436e-8eb6-673fe78e5c40 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:26.206476 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d3490-d8ce-436e-8eb6-673fe78e5c40 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:26.211745 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e98f50-1897-489c-8987-bbec2a53418d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:26.212341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e98f50-1897-489c-8987-bbec2a53418d admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:26.212622 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e98f50-1897-489c-8987-bbec2a53418d admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:26.212896 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e98f50-1897-489c-8987-bbec2a53418d admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:26.213604 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e98f50-1897-489c-8987-bbec2a53418d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:26.215797 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e98f50-1897-489c-8987-bbec2a53418d admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:26.243397 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1271/2559] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:25:26 2022] POST /identity/v3/projects => generated 391 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:25:26.247792 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced55d67-cebd-4448-be55-4e7f10e148e7 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:26.252932 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:26.259465 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced55d67-cebd-4448-be55-4e7f10e148e7 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:26.319604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ecf50-47c9-4305-a943-cdfa44d23819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:26.320195 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ecf50-47c9-4305-a943-cdfa44d23819 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:26.320580 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ecf50-47c9-4305-a943-cdfa44d23819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:26.320836 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ecf50-47c9-4305-a943-cdfa44d23819 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:26.321475 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ecf50-47c9-4305-a943-cdfa44d23819 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:26.323330 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ecf50-47c9-4305-a943-cdfa44d23819 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:26.346056 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1289/2560] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:25:26 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:25:26.350419 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e98f50-1897-489c-8987-bbec2a53418d admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:26.361173 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e98f50-1897-489c-8987-bbec2a53418d admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:26.365981 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc47b47-0a4f-4fd6-ac20-28014e12bfec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:26.366528 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc47b47-0a4f-4fd6-ac20-28014e12bfec admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:26.366806 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc47b47-0a4f-4fd6-ac20-28014e12bfec admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:26.367076 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc47b47-0a4f-4fd6-ac20-28014e12bfec admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:26.367828 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc47b47-0a4f-4fd6-ac20-28014e12bfec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:26.369405 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc47b47-0a4f-4fd6-ac20-28014e12bfec admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:26.379305 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1272/2561] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:25:26.383959 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ecf50-47c9-4305-a943-cdfa44d23819 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:26.394254 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ecf50-47c9-4305-a943-cdfa44d23819 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:26.399422 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0854a9-4525-4a21-a530-f034007d45c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:26.400015 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0854a9-4525-4a21-a530-f034007d45c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:26.400291 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0854a9-4525-4a21-a530-f034007d45c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:26.400586 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0854a9-4525-4a21-a530-f034007d45c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:26.401234 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0854a9-4525-4a21-a530-f034007d45c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:26.402869 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0854a9-4525-4a21-a530-f034007d45c8 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:26.414702 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1290/2562] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:25:26.420441 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc47b47-0a4f-4fd6-ac20-28014e12bfec admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:26.432276 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc47b47-0a4f-4fd6-ac20-28014e12bfec admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:26.436938 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9118abc-20ce-4800-a5e4-5f7c93325153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:26.437587 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9118abc-20ce-4800-a5e4-5f7c93325153 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:26.437872 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9118abc-20ce-4800-a5e4-5f7c93325153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:26.438156 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9118abc-20ce-4800-a5e4-5f7c93325153 admin admin] PATH_INFO: `/v3/projects/1074e6c04bbc4187be4f895caebdc01f/users/5b39fb802ef64fbf8f75b01632a90876/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:26.453450 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9118abc-20ce-4800-a5e4-5f7c93325153 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1074e6c04bbc4187be4f895caebdc01f, user_id=5b39fb802ef64fbf8f75b01632a90876, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:26.456151 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9118abc-20ce-4800-a5e4-5f7c93325153 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:26.470125 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1273/2563] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:25:26 2022] PUT /identity/v3/projects/1074e6c04bbc4187be4f895caebdc01f/users/5b39fb802ef64fbf8f75b01632a90876/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:26.484262 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7963ef-2080-4fe3-ad02-d79f3898fd8e None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:26.484692 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7963ef-2080-4fe3-ad02-d79f3898fd8e None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:26.485101 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7963ef-2080-4fe3-ad02-d79f3898fd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:26.513015 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-0a7963ef-2080-4fe3-ad02-d79f3898fd8e None None] MFA Rules not processed for user `5b39fb802ef64fbf8f75b01632a90876`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:26.514230 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0a7963ef-2080-4fe3-ad02-d79f3898fd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:26.580168 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1291/2564] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:26 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:26.584991 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9118abc-20ce-4800-a5e4-5f7c93325153 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:26.646432 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9118abc-20ce-4800-a5e4-5f7c93325153 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:26.651590 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ceb58-272a-4752-86e2-c4b7f240a7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:26.652186 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ceb58-272a-4752-86e2-c4b7f240a7af admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:26.652460 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ceb58-272a-4752-86e2-c4b7f240a7af admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:26.652726 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ceb58-272a-4752-86e2-c4b7f240a7af admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:26.653356 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7ceb58-272a-4752-86e2-c4b7f240a7af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:26.655267 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7ceb58-272a-4752-86e2-c4b7f240a7af admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:26.681758 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1274/2565] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:25:26 2022] POST /identity/v3/projects => generated 393 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:25:26.685987 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7963ef-2080-4fe3-ad02-d79f3898fd8e None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:26.697761 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7963ef-2080-4fe3-ad02-d79f3898fd8e None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:26.760168 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112cd75-d0ca-4d8a-9c80-24b62774cd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:26.760782 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112cd75-d0ca-4d8a-9c80-24b62774cd44 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:26.761061 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112cd75-d0ca-4d8a-9c80-24b62774cd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:26.761334 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112cd75-d0ca-4d8a-9c80-24b62774cd44 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:26.761977 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112cd75-d0ca-4d8a-9c80-24b62774cd44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:26.763932 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112cd75-d0ca-4d8a-9c80-24b62774cd44 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:26.781739 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:26.788642 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1292/2566] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:25:26 2022] POST /identity/v3/users => generated 303 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:25:26.791280 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ceb58-272a-4752-86e2-c4b7f240a7af admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:26.803729 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ceb58-272a-4752-86e2-c4b7f240a7af admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:26.808685 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f76199-c228-4949-b89f-34e1d70e3772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:26.809442 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f76199-c228-4949-b89f-34e1d70e3772 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:26.809727 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f76199-c228-4949-b89f-34e1d70e3772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:26.809995 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f76199-c228-4949-b89f-34e1d70e3772 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:26.810946 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f76199-c228-4949-b89f-34e1d70e3772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:26.812282 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f76199-c228-4949-b89f-34e1d70e3772 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:26.825727 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1275/2567] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:25:26.829513 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112cd75-d0ca-4d8a-9c80-24b62774cd44 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:26.840567 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112cd75-d0ca-4d8a-9c80-24b62774cd44 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:26.845489 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c67546-bf00-4e9b-9613-ffab3349e47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:26.846175 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c67546-bf00-4e9b-9613-ffab3349e47a admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:26.846491 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c67546-bf00-4e9b-9613-ffab3349e47a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:26.846768 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c67546-bf00-4e9b-9613-ffab3349e47a admin admin] PATH_INFO: `/v3/projects/3dbe87e4cf6547bab757008729078a91/users/468b556a72164c528e87a81504df5c22/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:26.867991 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c67546-bf00-4e9b-9613-ffab3349e47a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dbe87e4cf6547bab757008729078a91, user_id=468b556a72164c528e87a81504df5c22, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:26.871006 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c67546-bf00-4e9b-9613-ffab3349e47a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:26.889117 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1293/2568] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:25:26 2022] PUT /identity/v3/projects/3dbe87e4cf6547bab757008729078a91/users/468b556a72164c528e87a81504df5c22/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:26.894701 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f76199-c228-4949-b89f-34e1d70e3772 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:26.906088 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f76199-c228-4949-b89f-34e1d70e3772 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:26.965153 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae8027a-0564-4a61-ab47-90a062edcb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:26.965709 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8027a-0564-4a61-ab47-90a062edcb0f admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:26.965991 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8027a-0564-4a61-ab47-90a062edcb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:26.966401 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8027a-0564-4a61-ab47-90a062edcb0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:26.967104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae8027a-0564-4a61-ab47-90a062edcb0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:26.968687 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae8027a-0564-4a61-ab47-90a062edcb0f admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:26.979308 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1276/2569] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:25:26.983523 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c67546-bf00-4e9b-9613-ffab3349e47a admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:26.994776 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c67546-bf00-4e9b-9613-ffab3349e47a admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:26.999553 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3889f57-0689-4e58-b39c-86ecbafcc0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:27.000213 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3889f57-0689-4e58-b39c-86ecbafcc0bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:27.000491 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3889f57-0689-4e58-b39c-86ecbafcc0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:27.000764 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3889f57-0689-4e58-b39c-86ecbafcc0bd admin admin] PATH_INFO: `/v3/projects/3dbe87e4cf6547bab757008729078a91/users/468b556a72164c528e87a81504df5c22/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:27.002737 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3889f57-0689-4e58-b39c-86ecbafcc0bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dbe87e4cf6547bab757008729078a91, user_id=468b556a72164c528e87a81504df5c22, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:27.005466 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3889f57-0689-4e58-b39c-86ecbafcc0bd admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:27.017678 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1294/2570] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:25:26 2022] PUT /identity/v3/projects/3dbe87e4cf6547bab757008729078a91/users/468b556a72164c528e87a81504df5c22/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:27.027977 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0135c-9738-4903-ae25-a0b795bdd784 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:27.028272 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0135c-9738-4903-ae25-a0b795bdd784 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:27.028544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0135c-9738-4903-ae25-a0b795bdd784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:27.056855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:27.060486 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-05f0135c-9738-4903-ae25-a0b795bdd784 None None] MFA Rules not processed for user `468b556a72164c528e87a81504df5c22`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:27.062676 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-05f0135c-9738-4903-ae25-a0b795bdd784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:27.147072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1277/2571] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:27 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:25:27.158269 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3889f57-0689-4e58-b39c-86ecbafcc0bd admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:27.160096 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b3889f57-0689-4e58-b39c-86ecbafcc0bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:27.227570 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3889f57-0689-4e58-b39c-86ecbafcc0bd admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:27.231177 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7a0e0-69f1-45cd-86ab-d619b1a5f2c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:27.231883 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7a0e0-69f1-45cd-86ab-d619b1a5f2c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:27.232165 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7a0e0-69f1-45cd-86ab-d619b1a5f2c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:27.232482 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7a0e0-69f1-45cd-86ab-d619b1a5f2c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:27.242404 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7a0e0-69f1-45cd-86ab-d619b1a5f2c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:27.243860 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7a0e0-69f1-45cd-86ab-d619b1a5f2c7 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:27.253398 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1295/2572] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:27 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:25:27.303215 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0135c-9738-4903-ae25-a0b795bdd784 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:27.305205 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-05f0135c-9738-4903-ae25-a0b795bdd784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:27.317280 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0135c-9738-4903-ae25-a0b795bdd784 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:27.321150 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c4b6c-ad2f-4a2d-837d-01d62dd4f5b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:27.321784 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c4b6c-ad2f-4a2d-837d-01d62dd4f5b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:27.322066 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c4b6c-ad2f-4a2d-837d-01d62dd4f5b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:27.322340 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c4b6c-ad2f-4a2d-837d-01d62dd4f5b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:27.383622 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c4b6c-ad2f-4a2d-837d-01d62dd4f5b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:27.385061 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c4b6c-ad2f-4a2d-837d-01d62dd4f5b7 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:27.394324 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1278/2573] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:27 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:25:30.836019 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7a0e0-69f1-45cd-86ab-d619b1a5f2c7 service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:30.900718 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7a0e0-69f1-45cd-86ab-d619b1a5f2c7 service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:30.905746 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa90c2-3a62-42fc-9a91-591ed41e380d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:30.906520 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa90c2-3a62-42fc-9a91-591ed41e380d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:30.906964 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa90c2-3a62-42fc-9a91-591ed41e380d admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:30.907283 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa90c2-3a62-42fc-9a91-591ed41e380d admin admin] PATH_INFO: `/v3/users/5b39fb802ef64fbf8f75b01632a90876` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:30.908498 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa90c2-3a62-42fc-9a91-591ed41e380d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b39fb802ef64fbf8f75b01632a90876)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:30.910442 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa90c2-3a62-42fc-9a91-591ed41e380d admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:30.966860 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-14aa90c2-3a62-42fc-9a91-591ed41e380d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b39fb802ef64fbf8f75b01632a90876'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:30.974848 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-14aa90c2-3a62-42fc-9a91-591ed41e380d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b39fb802ef64fbf8f75b01632a90876'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:30.982703 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-14aa90c2-3a62-42fc-9a91-591ed41e380d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b39fb802ef64fbf8f75b01632a90876'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:30.987571 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:30.999653 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-14aa90c2-3a62-42fc-9a91-591ed41e380d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b39fb802ef64fbf8f75b01632a90876'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:31.001555 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-14aa90c2-3a62-42fc-9a91-591ed41e380d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b39fb802ef64fbf8f75b01632a90876'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:31.011684 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1296/2574] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:25:30 2022] DELETE /identity/v3/users/5b39fb802ef64fbf8f75b01632a90876 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:31.016360 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097ec87-5c90-4a14-a4d1-750f34122fb7 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:31.016933 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097ec87-5c90-4a14-a4d1-750f34122fb7 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:31.016933 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097ec87-5c90-4a14-a4d1-750f34122fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:31.036512 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-0097ec87-5c90-4a14-a4d1-750f34122fb7 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:31.037729 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-0097ec87-5c90-4a14-a4d1-750f34122fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:31.103465 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1279/2575] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:25:31.115448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa90c2-3a62-42fc-9a91-591ed41e380d admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:31.117010 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-14aa90c2-3a62-42fc-9a91-591ed41e380d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:31.190901 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa90c2-3a62-42fc-9a91-591ed41e380d admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:31.195614 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc2a89-91f2-492a-a98a-cdb754707726 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:31.196231 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc2a89-91f2-492a-a98a-cdb754707726 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:31.196545 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc2a89-91f2-492a-a98a-cdb754707726 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:31.196806 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc2a89-91f2-492a-a98a-cdb754707726 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:31.206578 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc2a89-91f2-492a-a98a-cdb754707726 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:31.208106 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc2a89-91f2-492a-a98a-cdb754707726 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:31.219762 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1297/2576] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:25:31.555276 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097ec87-5c90-4a14-a4d1-750f34122fb7 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:31.556797 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-0097ec87-5c90-4a14-a4d1-750f34122fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:31.572435 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097ec87-5c90-4a14-a4d1-750f34122fb7 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:31.578585 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcbebc-126f-4b8f-8f53-38dc8a7cc49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:31.579229 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcbebc-126f-4b8f-8f53-38dc8a7cc49f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:31.579518 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcbebc-126f-4b8f-8f53-38dc8a7cc49f admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:31.579799 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcbebc-126f-4b8f-8f53-38dc8a7cc49f admin admin] PATH_INFO: `/v3/projects/1074e6c04bbc4187be4f895caebdc01f` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:31.580974 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dcbebc-126f-4b8f-8f53-38dc8a7cc49f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1074e6c04bbc4187be4f895caebdc01f)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:31.583011 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dcbebc-126f-4b8f-8f53-38dc8a7cc49f admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:31.631394 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:31.654126 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-e3dcbebc-126f-4b8f-8f53-38dc8a7cc49f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1074e6c04bbc4187be4f895caebdc01f', 'request_id': 'req-e3dcbebc-126f-4b8f-8f53-38dc8a7cc49f'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:31.666709 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-e3dcbebc-126f-4b8f-8f53-38dc8a7cc49f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1074e6c04bbc4187be4f895caebdc01f', 'request_id': 'req-e3dcbebc-126f-4b8f-8f53-38dc8a7cc49f'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:31.673341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-e3dcbebc-126f-4b8f-8f53-38dc8a7cc49f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1074e6c04bbc4187be4f895caebdc01f', 'request_id': 'req-e3dcbebc-126f-4b8f-8f53-38dc8a7cc49f'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:31.688577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-e3dcbebc-126f-4b8f-8f53-38dc8a7cc49f admin admin] The token cache is being invalidate because project 1074e6c04bbc4187be4f895caebdc01f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:25:31.688992 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-e3dcbebc-126f-4b8f-8f53-38dc8a7cc49f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:31.689684 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-e3dcbebc-126f-4b8f-8f53-38dc8a7cc49f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:31.692015 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1280/2577] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:25:31 2022] DELETE /identity/v3/projects/1074e6c04bbc4187be4f895caebdc01f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:31.696879 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc2a89-91f2-492a-a98a-cdb754707726 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:31.712890 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc2a89-91f2-492a-a98a-cdb754707726 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:31.773484 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194ae50-dfdd-43ef-b0bc-1e84f7bd6968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:31.774308 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194ae50-dfdd-43ef-b0bc-1e84f7bd6968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:31.774627 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194ae50-dfdd-43ef-b0bc-1e84f7bd6968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:31.774955 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194ae50-dfdd-43ef-b0bc-1e84f7bd6968 admin admin] PATH_INFO: `/v3/users/468b556a72164c528e87a81504df5c22` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:31.776219 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d194ae50-dfdd-43ef-b0bc-1e84f7bd6968 admin admin] RBAC: Authorizing `identity:delete_user(user_id=468b556a72164c528e87a81504df5c22)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:31.778268 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d194ae50-dfdd-43ef-b0bc-1e84f7bd6968 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:31.841605 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d194ae50-dfdd-43ef-b0bc-1e84f7bd6968 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '468b556a72164c528e87a81504df5c22'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:31.849443 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d194ae50-dfdd-43ef-b0bc-1e84f7bd6968 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '468b556a72164c528e87a81504df5c22'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:31.858427 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d194ae50-dfdd-43ef-b0bc-1e84f7bd6968 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '468b556a72164c528e87a81504df5c22'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:31.872690 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d194ae50-dfdd-43ef-b0bc-1e84f7bd6968 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '468b556a72164c528e87a81504df5c22'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:31.873429 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d194ae50-dfdd-43ef-b0bc-1e84f7bd6968 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '468b556a72164c528e87a81504df5c22'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:31.880105 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1298/2578] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:25:31 2022] DELETE /identity/v3/users/468b556a72164c528e87a81504df5c22 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:32.195424 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcbebc-126f-4b8f-8f53-38dc8a7cc49f admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:32.197041 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-e3dcbebc-126f-4b8f-8f53-38dc8a7cc49f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:32.218400 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcbebc-126f-4b8f-8f53-38dc8a7cc49f admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:32.285092 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19aeb9-7718-4f0a-823a-da82481d1c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:32.285747 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19aeb9-7718-4f0a-823a-da82481d1c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:32.286027 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19aeb9-7718-4f0a-823a-da82481d1c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:32.286297 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19aeb9-7718-4f0a-823a-da82481d1c4f admin admin] PATH_INFO: `/v3/projects/3dbe87e4cf6547bab757008729078a91` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:32.287479 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19aeb9-7718-4f0a-823a-da82481d1c4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dbe87e4cf6547bab757008729078a91)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:32.290689 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19aeb9-7718-4f0a-823a-da82481d1c4f admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:32.349218 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-de19aeb9-7718-4f0a-823a-da82481d1c4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dbe87e4cf6547bab757008729078a91', 'request_id': 'req-de19aeb9-7718-4f0a-823a-da82481d1c4f'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:32.356905 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-de19aeb9-7718-4f0a-823a-da82481d1c4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dbe87e4cf6547bab757008729078a91', 'request_id': 'req-de19aeb9-7718-4f0a-823a-da82481d1c4f'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:32.364066 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-de19aeb9-7718-4f0a-823a-da82481d1c4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dbe87e4cf6547bab757008729078a91', 'request_id': 'req-de19aeb9-7718-4f0a-823a-da82481d1c4f'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:32.383846 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-de19aeb9-7718-4f0a-823a-da82481d1c4f admin admin] The token cache is being invalidate because project 3dbe87e4cf6547bab757008729078a91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:25:32.384240 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-de19aeb9-7718-4f0a-823a-da82481d1c4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:32.384967 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-de19aeb9-7718-4f0a-823a-da82481d1c4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:32.386665 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1281/2579] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:25:32 2022] DELETE /identity/v3/projects/3dbe87e4cf6547bab757008729078a91 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:32.391761 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ecbb9-cbf7-4273-b5a4-9e8b56b0b4db None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:32.392054 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ecbb9-cbf7-4273-b5a4-9e8b56b0b4db None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:32.392331 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ecbb9-cbf7-4273-b5a4-9e8b56b0b4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:32.407619 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:32.426610 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-3d4ecbb9-cbf7-4273-b5a4-9e8b56b0b4db None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:32.426610 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3d4ecbb9-cbf7-4273-b5a4-9e8b56b0b4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:32.488522 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1299/2580] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:32.489345 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f03a13-92e0-4f4c-b1e2-4e40e8688f73 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:32.489637 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f03a13-92e0-4f4c-b1e2-4e40e8688f73 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:32.489917 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f03a13-92e0-4f4c-b1e2-4e40e8688f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:32.512495 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-81f03a13-92e0-4f4c-b1e2-4e40e8688f73 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:32.513642 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-81f03a13-92e0-4f4c-b1e2-4e40e8688f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:32.522518 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1282/2581] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:32.526807 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ecbb9-cbf7-4273-b5a4-9e8b56b0b4db None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:32.550870 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ecbb9-cbf7-4273-b5a4-9e8b56b0b4db None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:32.559461 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c126a8-d906-48e9-bd5a-59eecf84f864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:32.560431 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c126a8-d906-48e9-bd5a-59eecf84f864 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:32.560799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c126a8-d906-48e9-bd5a-59eecf84f864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:32.561440 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c126a8-d906-48e9-bd5a-59eecf84f864 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:32.562117 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c126a8-d906-48e9-bd5a-59eecf84f864 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:25:32.563311 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c126a8-d906-48e9-bd5a-59eecf84f864 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:32.565359 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c126a8-d906-48e9-bd5a-59eecf84f864 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:32.586541 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1300/2582] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:25:32.592670 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f03a13-92e0-4f4c-b1e2-4e40e8688f73 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:32.611023 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f03a13-92e0-4f4c-b1e2-4e40e8688f73 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:32.618112 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3694c-872b-49e7-8fa7-9ed32797b9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:32.618951 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3694c-872b-49e7-8fa7-9ed32797b9f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:32.619332 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3694c-872b-49e7-8fa7-9ed32797b9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:32.619783 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3694c-872b-49e7-8fa7-9ed32797b9f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:32.620964 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b3694c-872b-49e7-8fa7-9ed32797b9f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:32.623522 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b3694c-872b-49e7-8fa7-9ed32797b9f1 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:32.681015 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c126a8-d906-48e9-bd5a-59eecf84f864 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:32.681986 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1283/2583] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:25:32 2022] POST /identity/v3/projects => generated 379 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:25:32.704531 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c126a8-d906-48e9-bd5a-59eecf84f864 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:32.792988 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b19f4-4173-48cc-9a33-b44c4eeebdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:32.794312 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b19f4-4173-48cc-9a33-b44c4eeebdbf admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:32.794745 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b19f4-4173-48cc-9a33-b44c4eeebdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:32.795856 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b19f4-4173-48cc-9a33-b44c4eeebdbf admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:32.796693 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b19f4-4173-48cc-9a33-b44c4eeebdbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:32.798863 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b19f4-4173-48cc-9a33-b44c4eeebdbf admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:32.845738 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1301/2584] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:25:32 2022] POST /identity/v3/users => generated 290 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:25:32.852766 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3694c-872b-49e7-8fa7-9ed32797b9f1 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:32.873040 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3694c-872b-49e7-8fa7-9ed32797b9f1 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:32.886347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fbcc1-2fdc-4ac9-a7fb-0fe7840c9cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:32.887297 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fbcc1-2fdc-4ac9-a7fb-0fe7840c9cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:32.887720 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fbcc1-2fdc-4ac9-a7fb-0fe7840c9cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:32.888117 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fbcc1-2fdc-4ac9-a7fb-0fe7840c9cc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:32.889936 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446fbcc1-2fdc-4ac9-a7fb-0fe7840c9cc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:32.894972 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446fbcc1-2fdc-4ac9-a7fb-0fe7840c9cc6 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:32.912374 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1284/2585] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:25:32.919094 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b19f4-4173-48cc-9a33-b44c4eeebdbf admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:32.936913 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b19f4-4173-48cc-9a33-b44c4eeebdbf admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:32.942182 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b66df2-3481-4005-a23a-5e1144512731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:32.942915 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b66df2-3481-4005-a23a-5e1144512731 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:32.943268 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b66df2-3481-4005-a23a-5e1144512731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:32.943550 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b66df2-3481-4005-a23a-5e1144512731 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:32.944202 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b66df2-3481-4005-a23a-5e1144512731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:32.945886 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b66df2-3481-4005-a23a-5e1144512731 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:32.957932 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1302/2586] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:25:32.963802 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fbcc1-2fdc-4ac9-a7fb-0fe7840c9cc6 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:32.974435 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fbcc1-2fdc-4ac9-a7fb-0fe7840c9cc6 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:32.979786 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627be2cc-2c56-4c7b-ace1-42f371f53f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:32.980460 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627be2cc-2c56-4c7b-ace1-42f371f53f0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:32.980744 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627be2cc-2c56-4c7b-ace1-42f371f53f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:32.981017 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627be2cc-2c56-4c7b-ace1-42f371f53f0a admin admin] PATH_INFO: `/v3/projects/95693956869f482b80a332e9cd9204ac/users/a681030f4df04ed282f589e8226377ba/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:32.990297 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:32.998164 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627be2cc-2c56-4c7b-ace1-42f371f53f0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=95693956869f482b80a332e9cd9204ac, user_id=a681030f4df04ed282f589e8226377ba, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:33.001883 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627be2cc-2c56-4c7b-ace1-42f371f53f0a admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:33.026573 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1285/2587] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:25:32 2022] PUT /identity/v3/projects/95693956869f482b80a332e9cd9204ac/users/a681030f4df04ed282f589e8226377ba/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:33.032036 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c8df9-7876-401a-a4c7-301c14b79d29 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:33.032327 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c8df9-7876-401a-a4c7-301c14b79d29 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:33.032605 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c8df9-7876-401a-a4c7-301c14b79d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:33.063052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-8e0c8df9-7876-401a-a4c7-301c14b79d29 None None] MFA Rules not processed for user `a681030f4df04ed282f589e8226377ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:33.065758 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8e0c8df9-7876-401a-a4c7-301c14b79d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:33.141136 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1303/2588] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:33.145795 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627be2cc-2c56-4c7b-ace1-42f371f53f0a admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:33.218544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627be2cc-2c56-4c7b-ace1-42f371f53f0a admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:33.238436 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32df76-46dd-4c0f-ae0d-f360280eba4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:33.239225 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32df76-46dd-4c0f-ae0d-f360280eba4b admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:33.239910 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32df76-46dd-4c0f-ae0d-f360280eba4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:33.239910 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32df76-46dd-4c0f-ae0d-f360280eba4b admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:33.240485 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32df76-46dd-4c0f-ae0d-f360280eba4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:33.242507 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32df76-46dd-4c0f-ae0d-f360280eba4b admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:33.274135 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1286/2589] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:25:33 2022] POST /identity/v3/projects => generated 377 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:25:33.279100 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c8df9-7876-401a-a4c7-301c14b79d29 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:33.287733 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:33.298337 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c8df9-7876-401a-a4c7-301c14b79d29 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:33.370550 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff86e4f-a0af-4162-9cc0-9fd1bf402afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:33.371565 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff86e4f-a0af-4162-9cc0-9fd1bf402afe admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:33.372050 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff86e4f-a0af-4162-9cc0-9fd1bf402afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:33.372529 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff86e4f-a0af-4162-9cc0-9fd1bf402afe admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:33.373677 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff86e4f-a0af-4162-9cc0-9fd1bf402afe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:33.376321 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff86e4f-a0af-4162-9cc0-9fd1bf402afe admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:33.401005 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1304/2590] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:25:33 2022] POST /identity/v3/users => generated 289 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:25:33.405305 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32df76-46dd-4c0f-ae0d-f360280eba4b admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:33.420134 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32df76-46dd-4c0f-ae0d-f360280eba4b admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:33.425857 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299185b-4bcb-46a4-807b-944445507f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:33.426580 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299185b-4bcb-46a4-807b-944445507f4a admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:33.426859 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299185b-4bcb-46a4-807b-944445507f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:33.427131 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299185b-4bcb-46a4-807b-944445507f4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:33.427820 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a299185b-4bcb-46a4-807b-944445507f4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:33.430172 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a299185b-4bcb-46a4-807b-944445507f4a admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:33.442925 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1287/2591] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:25:33.447541 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff86e4f-a0af-4162-9cc0-9fd1bf402afe admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:33.460537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff86e4f-a0af-4162-9cc0-9fd1bf402afe admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:33.472070 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac5e22-20a4-49ed-b836-16894b65cbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:33.472932 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac5e22-20a4-49ed-b836-16894b65cbb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:33.473292 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac5e22-20a4-49ed-b836-16894b65cbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:33.473630 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac5e22-20a4-49ed-b836-16894b65cbb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:33.474653 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac5e22-20a4-49ed-b836-16894b65cbb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:33.477215 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac5e22-20a4-49ed-b836-16894b65cbb1 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:33.493370 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1305/2592] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:25:33.495281 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299185b-4bcb-46a4-807b-944445507f4a admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:33.507227 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299185b-4bcb-46a4-807b-944445507f4a admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:33.512850 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579bf3a9-110e-4af4-a177-e9d17b79e13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:33.513922 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579bf3a9-110e-4af4-a177-e9d17b79e13a admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:33.513922 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579bf3a9-110e-4af4-a177-e9d17b79e13a admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:33.514286 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579bf3a9-110e-4af4-a177-e9d17b79e13a admin admin] PATH_INFO: `/v3/projects/2c40c320d8ae4cfc8f05609181d1471a/users/5d088fada49d46ee9a4028f63872be38/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:33.532040 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579bf3a9-110e-4af4-a177-e9d17b79e13a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c40c320d8ae4cfc8f05609181d1471a, user_id=5d088fada49d46ee9a4028f63872be38, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:33.534857 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579bf3a9-110e-4af4-a177-e9d17b79e13a admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:33.551162 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1288/2593] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:25:33 2022] PUT /identity/v3/projects/2c40c320d8ae4cfc8f05609181d1471a/users/5d088fada49d46ee9a4028f63872be38/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:33.561294 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ca928-e0f9-4f46-8201-7c32c2750cce None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:33.561631 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ca928-e0f9-4f46-8201-7c32c2750cce None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:33.561887 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ca928-e0f9-4f46-8201-7c32c2750cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:33.604254 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-e14ca928-e0f9-4f46-8201-7c32c2750cce None None] MFA Rules not processed for user `5d088fada49d46ee9a4028f63872be38`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:33.605830 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e14ca928-e0f9-4f46-8201-7c32c2750cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:33.700484 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1306/2594] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:33.705263 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579bf3a9-110e-4af4-a177-e9d17b79e13a admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:33.792511 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579bf3a9-110e-4af4-a177-e9d17b79e13a admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:33.797606 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c09832-553c-4dc2-bb3b-e3f6b5a29aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:33.798233 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c09832-553c-4dc2-bb3b-e3f6b5a29aed admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:33.798610 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c09832-553c-4dc2-bb3b-e3f6b5a29aed admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:33.798888 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c09832-553c-4dc2-bb3b-e3f6b5a29aed admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:33.800067 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c09832-553c-4dc2-bb3b-e3f6b5a29aed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:33.801944 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c09832-553c-4dc2-bb3b-e3f6b5a29aed admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:33.838718 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1289/2595] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:25:33 2022] POST /identity/v3/projects => generated 377 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:25:33.843066 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ca928-e0f9-4f46-8201-7c32c2750cce None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:33.858084 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ca928-e0f9-4f46-8201-7c32c2750cce None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:33.924953 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4161892a-aab2-459f-b91c-54528aee9b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:33.925673 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161892a-aab2-459f-b91c-54528aee9b73 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:33.926027 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161892a-aab2-459f-b91c-54528aee9b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:33.926301 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161892a-aab2-459f-b91c-54528aee9b73 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:33.926973 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4161892a-aab2-459f-b91c-54528aee9b73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:33.928956 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4161892a-aab2-459f-b91c-54528aee9b73 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:33.946866 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:33.955408 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1307/2596] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:25:33 2022] POST /identity/v3/users => generated 295 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:25:33.956622 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c09832-553c-4dc2-bb3b-e3f6b5a29aed admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:33.972059 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c09832-553c-4dc2-bb3b-e3f6b5a29aed admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:33.977450 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104dd57-2d43-4105-847b-027219022a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:33.978060 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104dd57-2d43-4105-847b-027219022a79 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:33.978341 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104dd57-2d43-4105-847b-027219022a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:33.978653 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104dd57-2d43-4105-847b-027219022a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:33.979322 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d104dd57-2d43-4105-847b-027219022a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:33.981593 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d104dd57-2d43-4105-847b-027219022a79 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:33.997676 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1290/2597] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:25:33.998669 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4161892a-aab2-459f-b91c-54528aee9b73 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:34.010513 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4161892a-aab2-459f-b91c-54528aee9b73 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:34.015577 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8508b-3079-4e17-9b24-3f6ff6c739b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:34.016254 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8508b-3079-4e17-9b24-3f6ff6c739b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:34.016537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8508b-3079-4e17-9b24-3f6ff6c739b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:34.016816 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8508b-3079-4e17-9b24-3f6ff6c739b0 admin admin] PATH_INFO: `/v3/projects/d6d9e83bd28d42698a7f2dc04cf346ab/users/f3e7c9156f6545b9bf0423eefcd8df76/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:34.035590 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea8508b-3079-4e17-9b24-3f6ff6c739b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6d9e83bd28d42698a7f2dc04cf346ab, user_id=f3e7c9156f6545b9bf0423eefcd8df76, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:34.038986 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea8508b-3079-4e17-9b24-3f6ff6c739b0 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:34.055689 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1308/2598] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:25:33 2022] PUT /identity/v3/projects/d6d9e83bd28d42698a7f2dc04cf346ab/users/f3e7c9156f6545b9bf0423eefcd8df76/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:25:34.060104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104dd57-2d43-4105-847b-027219022a79 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:34.071421 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104dd57-2d43-4105-847b-027219022a79 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:34.080241 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:34.140088 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437f394-6b35-4f20-9694-238f88e56e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:34.140760 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437f394-6b35-4f20-9694-238f88e56e82 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:34.141031 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437f394-6b35-4f20-9694-238f88e56e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:34.141297 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437f394-6b35-4f20-9694-238f88e56e82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:34.141963 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437f394-6b35-4f20-9694-238f88e56e82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:34.143886 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437f394-6b35-4f20-9694-238f88e56e82 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:34.154949 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1291/2599] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:25:34.159234 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8508b-3079-4e17-9b24-3f6ff6c739b0 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:34.169802 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8508b-3079-4e17-9b24-3f6ff6c739b0 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:34.175127 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234cd76-6a69-4b2c-a436-76aa48841f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:34.175300 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234cd76-6a69-4b2c-a436-76aa48841f35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:34.175498 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234cd76-6a69-4b2c-a436-76aa48841f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:34.175814 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234cd76-6a69-4b2c-a436-76aa48841f35 admin admin] PATH_INFO: `/v3/projects/d6d9e83bd28d42698a7f2dc04cf346ab/users/f3e7c9156f6545b9bf0423eefcd8df76/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:34.177758 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5234cd76-6a69-4b2c-a436-76aa48841f35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6d9e83bd28d42698a7f2dc04cf346ab, user_id=f3e7c9156f6545b9bf0423eefcd8df76, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:34.180458 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5234cd76-6a69-4b2c-a436-76aa48841f35 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:34.190942 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1309/2600] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:25:34 2022] PUT /identity/v3/projects/d6d9e83bd28d42698a7f2dc04cf346ab/users/f3e7c9156f6545b9bf0423eefcd8df76/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:34.201670 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b8c4c-491a-4047-b087-4721d5a8e1aa None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:34.201963 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b8c4c-491a-4047-b087-4721d5a8e1aa None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:34.202324 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b8c4c-491a-4047-b087-4721d5a8e1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:34.233243 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-2e2b8c4c-491a-4047-b087-4721d5a8e1aa None None] MFA Rules not processed for user `f3e7c9156f6545b9bf0423eefcd8df76`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:34.234483 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-2e2b8c4c-491a-4047-b087-4721d5a8e1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:34.308199 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1292/2601] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:34 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:34.320660 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234cd76-6a69-4b2c-a436-76aa48841f35 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:34.322426 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5234cd76-6a69-4b2c-a436-76aa48841f35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:34.390231 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234cd76-6a69-4b2c-a436-76aa48841f35 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:34.394055 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788410bb-0c72-4da8-ae2b-620709a3c0cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:34.394699 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788410bb-0c72-4da8-ae2b-620709a3c0cc service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:34.394983 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788410bb-0c72-4da8-ae2b-620709a3c0cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:34.395417 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788410bb-0c72-4da8-ae2b-620709a3c0cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:34.405745 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788410bb-0c72-4da8-ae2b-620709a3c0cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:34.407248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788410bb-0c72-4da8-ae2b-620709a3c0cc service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:34.418216 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1310/2602] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:34 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:25:34.461190 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b8c4c-491a-4047-b087-4721d5a8e1aa None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:34.462619 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-2e2b8c4c-491a-4047-b087-4721d5a8e1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:34.474677 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b8c4c-491a-4047-b087-4721d5a8e1aa None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:34.478309 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b78cce-3fc5-4537-ac61-f646fc245ae8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:34.479028 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b78cce-3fc5-4537-ac61-f646fc245ae8 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:34.479308 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b78cce-3fc5-4537-ac61-f646fc245ae8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:34.479578 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b78cce-3fc5-4537-ac61-f646fc245ae8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:34.538041 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b78cce-3fc5-4537-ac61-f646fc245ae8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:34.539506 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b78cce-3fc5-4537-ac61-f646fc245ae8 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:34.548820 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1293/2603] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:25:36.037248 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788410bb-0c72-4da8-ae2b-620709a3c0cc service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:36.038810 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-788410bb-0c72-4da8-ae2b-620709a3c0cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:36.103959 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788410bb-0c72-4da8-ae2b-620709a3c0cc service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:36.113124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f3ebe-149b-4795-aa55-bf3beeb2e6ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:36.113743 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f3ebe-149b-4795-aa55-bf3beeb2e6ae service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:36.114023 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f3ebe-149b-4795-aa55-bf3beeb2e6ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:36.114294 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f3ebe-149b-4795-aa55-bf3beeb2e6ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:36.116037 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c13f3ebe-149b-4795-aa55-bf3beeb2e6ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:36.182329 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f3ebe-149b-4795-aa55-bf3beeb2e6ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:36.183965 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f3ebe-149b-4795-aa55-bf3beeb2e6ae service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:36.193684 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1311/2604] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:25:37.471909 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b78cce-3fc5-4537-ac61-f646fc245ae8 service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:37.511777 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:37.551167 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b78cce-3fc5-4537-ac61-f646fc245ae8 service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:37.555892 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032760c9-fe3f-4110-82bd-98ce0099df2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:37.556536 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032760c9-fe3f-4110-82bd-98ce0099df2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:37.556817 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032760c9-fe3f-4110-82bd-98ce0099df2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:37.557093 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032760c9-fe3f-4110-82bd-98ce0099df2f admin admin] PATH_INFO: `/v3/users/a681030f4df04ed282f589e8226377ba` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:37.558218 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032760c9-fe3f-4110-82bd-98ce0099df2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a681030f4df04ed282f589e8226377ba)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:37.560219 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032760c9-fe3f-4110-82bd-98ce0099df2f admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:37.623480 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-032760c9-fe3f-4110-82bd-98ce0099df2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a681030f4df04ed282f589e8226377ba'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:37.624191 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-032760c9-fe3f-4110-82bd-98ce0099df2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a681030f4df04ed282f589e8226377ba'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:37.640411 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-032760c9-fe3f-4110-82bd-98ce0099df2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a681030f4df04ed282f589e8226377ba'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:37.648133 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-032760c9-fe3f-4110-82bd-98ce0099df2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a681030f4df04ed282f589e8226377ba'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:37.656517 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-032760c9-fe3f-4110-82bd-98ce0099df2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a681030f4df04ed282f589e8226377ba'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:37.664882 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1294/2605] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:25:37 2022] DELETE /identity/v3/users/a681030f4df04ed282f589e8226377ba => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:37.669052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e85f51-94e9-472f-a8c0-f283fdf32769 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:37.669541 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e85f51-94e9-472f-a8c0-f283fdf32769 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:37.669628 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e85f51-94e9-472f-a8c0-f283fdf32769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:37.703990 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-f6e85f51-94e9-472f-a8c0-f283fdf32769 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:37.705228 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f6e85f51-94e9-472f-a8c0-f283fdf32769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:37.721427 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:37.776396 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1312/2606] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:37.786707 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032760c9-fe3f-4110-82bd-98ce0099df2f admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:37.789443 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-032760c9-fe3f-4110-82bd-98ce0099df2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:37.867499 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032760c9-fe3f-4110-82bd-98ce0099df2f admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:37.871284 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c04bc-bd88-404b-983b-e919e4f22879 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:37.871906 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c04bc-bd88-404b-983b-e919e4f22879 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:37.872185 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c04bc-bd88-404b-983b-e919e4f22879 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:37.872464 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c04bc-bd88-404b-983b-e919e4f22879 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:37.884942 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c04bc-bd88-404b-983b-e919e4f22879 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:37.888182 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c04bc-bd88-404b-983b-e919e4f22879 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:37.895079 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e85f51-94e9-472f-a8c0-f283fdf32769 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:37.903155 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1295/2607] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:25:37.906632 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e85f51-94e9-472f-a8c0-f283fdf32769 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:37.911694 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25fb529-a776-4a6b-9e7d-2c2cfda939ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:37.912361 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fb529-a776-4a6b-9e7d-2c2cfda939ee service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:37.912713 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fb529-a776-4a6b-9e7d-2c2cfda939ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:37.913041 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fb529-a776-4a6b-9e7d-2c2cfda939ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:37.915138 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c25fb529-a776-4a6b-9e7d-2c2cfda939ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:37.928031 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25fb529-a776-4a6b-9e7d-2c2cfda939ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:37.929923 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25fb529-a776-4a6b-9e7d-2c2cfda939ee service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:37.941136 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1313/2608] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:25:38.345214 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c04bc-bd88-404b-983b-e919e4f22879 service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:38.346738 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-3e0c04bc-bd88-404b-983b-e919e4f22879 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:38.359788 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c04bc-bd88-404b-983b-e919e4f22879 service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:38.365281 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ce224-368d-4a99-bf7f-d71333013666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:38.365281 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ce224-368d-4a99-bf7f-d71333013666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:38.365692 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ce224-368d-4a99-bf7f-d71333013666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:38.365878 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ce224-368d-4a99-bf7f-d71333013666 admin admin] PATH_INFO: `/v3/projects/95693956869f482b80a332e9cd9204ac` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:38.367576 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ce224-368d-4a99-bf7f-d71333013666 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95693956869f482b80a332e9cd9204ac)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:38.369634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ce224-368d-4a99-bf7f-d71333013666 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:38.417942 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:38.419533 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-dd4ce224-368d-4a99-bf7f-d71333013666 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95693956869f482b80a332e9cd9204ac', 'request_id': 'req-dd4ce224-368d-4a99-bf7f-d71333013666'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:38.426752 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-dd4ce224-368d-4a99-bf7f-d71333013666 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95693956869f482b80a332e9cd9204ac', 'request_id': 'req-dd4ce224-368d-4a99-bf7f-d71333013666'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:38.434040 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-dd4ce224-368d-4a99-bf7f-d71333013666 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95693956869f482b80a332e9cd9204ac', 'request_id': 'req-dd4ce224-368d-4a99-bf7f-d71333013666'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:38.447825 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-dd4ce224-368d-4a99-bf7f-d71333013666 admin admin] The token cache is being invalidate because project 95693956869f482b80a332e9cd9204ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:25:38.448349 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-dd4ce224-368d-4a99-bf7f-d71333013666 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:38.448996 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-dd4ce224-368d-4a99-bf7f-d71333013666 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:38.450536 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1296/2609] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:25:38 2022] DELETE /identity/v3/projects/95693956869f482b80a332e9cd9204ac => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:38.454345 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25fb529-a776-4a6b-9e7d-2c2cfda939ee service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:38.464143 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25fb529-a776-4a6b-9e7d-2c2cfda939ee service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:38.522518 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a29518-c85f-409b-b9b4-53e87a7dd6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:38.523152 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a29518-c85f-409b-b9b4-53e87a7dd6c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:38.523562 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a29518-c85f-409b-b9b4-53e87a7dd6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:38.523844 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a29518-c85f-409b-b9b4-53e87a7dd6c8 admin admin] PATH_INFO: `/v3/users/5d088fada49d46ee9a4028f63872be38` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:38.525162 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a29518-c85f-409b-b9b4-53e87a7dd6c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d088fada49d46ee9a4028f63872be38)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:38.527584 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a29518-c85f-409b-b9b4-53e87a7dd6c8 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:38.591560 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-03a29518-c85f-409b-b9b4-53e87a7dd6c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d088fada49d46ee9a4028f63872be38'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:38.599634 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-03a29518-c85f-409b-b9b4-53e87a7dd6c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d088fada49d46ee9a4028f63872be38'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:38.608241 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-03a29518-c85f-409b-b9b4-53e87a7dd6c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d088fada49d46ee9a4028f63872be38'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:38.623052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-03a29518-c85f-409b-b9b4-53e87a7dd6c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d088fada49d46ee9a4028f63872be38'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:38.623770 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-03a29518-c85f-409b-b9b4-53e87a7dd6c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d088fada49d46ee9a4028f63872be38'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:38.629994 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1314/2610] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:25:38 2022] DELETE /identity/v3/users/5d088fada49d46ee9a4028f63872be38 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:39.023915 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ce224-368d-4a99-bf7f-d71333013666 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:39.026614 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-dd4ce224-368d-4a99-bf7f-d71333013666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:39.040178 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ce224-368d-4a99-bf7f-d71333013666 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:39.120878 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10e1f9-d7c1-48e7-b135-bd0a973cb3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:39.121597 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10e1f9-d7c1-48e7-b135-bd0a973cb3de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:39.121975 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10e1f9-d7c1-48e7-b135-bd0a973cb3de admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:39.122347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10e1f9-d7c1-48e7-b135-bd0a973cb3de admin admin] PATH_INFO: `/v3/projects/2c40c320d8ae4cfc8f05609181d1471a` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:39.123614 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10e1f9-d7c1-48e7-b135-bd0a973cb3de admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c40c320d8ae4cfc8f05609181d1471a)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:39.125992 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10e1f9-d7c1-48e7-b135-bd0a973cb3de admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:39.179323 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cf10e1f9-d7c1-48e7-b135-bd0a973cb3de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c40c320d8ae4cfc8f05609181d1471a', 'request_id': 'req-cf10e1f9-d7c1-48e7-b135-bd0a973cb3de'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:39.185149 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cf10e1f9-d7c1-48e7-b135-bd0a973cb3de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c40c320d8ae4cfc8f05609181d1471a', 'request_id': 'req-cf10e1f9-d7c1-48e7-b135-bd0a973cb3de'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:39.192966 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cf10e1f9-d7c1-48e7-b135-bd0a973cb3de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c40c320d8ae4cfc8f05609181d1471a', 'request_id': 'req-cf10e1f9-d7c1-48e7-b135-bd0a973cb3de'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:39.207925 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cf10e1f9-d7c1-48e7-b135-bd0a973cb3de admin admin] The token cache is being invalidate because project 2c40c320d8ae4cfc8f05609181d1471a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:25:39.208369 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cf10e1f9-d7c1-48e7-b135-bd0a973cb3de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:39.209114 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cf10e1f9-d7c1-48e7-b135-bd0a973cb3de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:39.211317 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1297/2611] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:25:39 2022] DELETE /identity/v3/projects/2c40c320d8ae4cfc8f05609181d1471a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:39.215697 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a29518-c85f-409b-b9b4-53e87a7dd6c8 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:39.217522 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-03a29518-c85f-409b-b9b4-53e87a7dd6c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:39.232076 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a29518-c85f-409b-b9b4-53e87a7dd6c8 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:39.257162 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:39.293682 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477bd81-2df9-4826-8653-492258ce7d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:39.294339 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477bd81-2df9-4826-8653-492258ce7d5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:39.294650 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477bd81-2df9-4826-8653-492258ce7d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:39.294928 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477bd81-2df9-4826-8653-492258ce7d5a admin admin] PATH_INFO: `/v3/users/f3e7c9156f6545b9bf0423eefcd8df76` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:39.296100 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a477bd81-2df9-4826-8653-492258ce7d5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3e7c9156f6545b9bf0423eefcd8df76)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:39.298057 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a477bd81-2df9-4826-8653-492258ce7d5a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:39.350042 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a477bd81-2df9-4826-8653-492258ce7d5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3e7c9156f6545b9bf0423eefcd8df76'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:39.359174 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a477bd81-2df9-4826-8653-492258ce7d5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3e7c9156f6545b9bf0423eefcd8df76'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:39.366840 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a477bd81-2df9-4826-8653-492258ce7d5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3e7c9156f6545b9bf0423eefcd8df76'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:39.382936 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a477bd81-2df9-4826-8653-492258ce7d5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3e7c9156f6545b9bf0423eefcd8df76'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:39.383574 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a477bd81-2df9-4826-8653-492258ce7d5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3e7c9156f6545b9bf0423eefcd8df76'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:39.393515 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1315/2612] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:25:39 2022] DELETE /identity/v3/users/f3e7c9156f6545b9bf0423eefcd8df76 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:39.699086 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10e1f9-d7c1-48e7-b135-bd0a973cb3de admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:39.700679 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-cf10e1f9-d7c1-48e7-b135-bd0a973cb3de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:39.738555 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10e1f9-d7c1-48e7-b135-bd0a973cb3de admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:39.798334 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d1fdf-8e22-4d31-bd15-d430ec69df5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:39.798925 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d1fdf-8e22-4d31-bd15-d430ec69df5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:39.799207 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d1fdf-8e22-4d31-bd15-d430ec69df5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:39.799499 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d1fdf-8e22-4d31-bd15-d430ec69df5c admin admin] PATH_INFO: `/v3/projects/d6d9e83bd28d42698a7f2dc04cf346ab` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:39.800631 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d1fdf-8e22-4d31-bd15-d430ec69df5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6d9e83bd28d42698a7f2dc04cf346ab)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:39.802637 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d1fdf-8e22-4d31-bd15-d430ec69df5c admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:39.821395 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:39.870724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-f76d1fdf-8e22-4d31-bd15-d430ec69df5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6d9e83bd28d42698a7f2dc04cf346ab', 'request_id': 'req-f76d1fdf-8e22-4d31-bd15-d430ec69df5c'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:39.877216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-f76d1fdf-8e22-4d31-bd15-d430ec69df5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6d9e83bd28d42698a7f2dc04cf346ab', 'request_id': 'req-f76d1fdf-8e22-4d31-bd15-d430ec69df5c'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:39.884286 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-f76d1fdf-8e22-4d31-bd15-d430ec69df5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6d9e83bd28d42698a7f2dc04cf346ab', 'request_id': 'req-f76d1fdf-8e22-4d31-bd15-d430ec69df5c'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:39.899773 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-f76d1fdf-8e22-4d31-bd15-d430ec69df5c admin admin] The token cache is being invalidate because project d6d9e83bd28d42698a7f2dc04cf346ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:25:39.899998 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-f76d1fdf-8e22-4d31-bd15-d430ec69df5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:39.900624 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-f76d1fdf-8e22-4d31-bd15-d430ec69df5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:39.902447 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1298/2613] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:25:39 2022] DELETE /identity/v3/projects/d6d9e83bd28d42698a7f2dc04cf346ab => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:39.908357 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923d76e-710a-4ce4-9524-0c252e6e11bf None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:39.908722 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923d76e-710a-4ce4-9524-0c252e6e11bf None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:39.909067 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923d76e-710a-4ce4-9524-0c252e6e11bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:39.930595 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-b923d76e-710a-4ce4-9524-0c252e6e11bf None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:39.931932 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b923d76e-710a-4ce4-9524-0c252e6e11bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:39.997873 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1316/2614] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:40.006576 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16fc9e-37cb-499d-a73f-ca1dc9b16883 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:40.006911 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16fc9e-37cb-499d-a73f-ca1dc9b16883 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:40.007135 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16fc9e-37cb-499d-a73f-ca1dc9b16883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:40.028642 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-5a16fc9e-37cb-499d-a73f-ca1dc9b16883 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:40.030001 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-5a16fc9e-37cb-499d-a73f-ca1dc9b16883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:40.040280 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1299/2615] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:40.044374 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923d76e-710a-4ce4-9524-0c252e6e11bf None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:40.055795 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923d76e-710a-4ce4-9524-0c252e6e11bf None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:40.065015 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee5f55-6b63-4c44-993a-3bacadf7ee9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:40.065775 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee5f55-6b63-4c44-993a-3bacadf7ee9b admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:40.066131 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee5f55-6b63-4c44-993a-3bacadf7ee9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:40.066604 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee5f55-6b63-4c44-993a-3bacadf7ee9b admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:40.068477 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee5f55-6b63-4c44-993a-3bacadf7ee9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:25:40.068477 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee5f55-6b63-4c44-993a-3bacadf7ee9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:40.070919 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee5f55-6b63-4c44-993a-3bacadf7ee9b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:40.084823 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1317/2616] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:25:40.090300 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16fc9e-37cb-499d-a73f-ca1dc9b16883 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:40.100605 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16fc9e-37cb-499d-a73f-ca1dc9b16883 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:40.107691 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fee329-c352-4f47-93bc-6e25c80ae3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:40.108321 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fee329-c352-4f47-93bc-6e25c80ae3cc admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:40.108600 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fee329-c352-4f47-93bc-6e25c80ae3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:40.108872 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fee329-c352-4f47-93bc-6e25c80ae3cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:40.109515 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fee329-c352-4f47-93bc-6e25c80ae3cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:40.111501 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fee329-c352-4f47-93bc-6e25c80ae3cc admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:40.153947 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee5f55-6b63-4c44-993a-3bacadf7ee9b admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:40.155451 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1300/2617] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:25:40 2022] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:25:40.166126 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee5f55-6b63-4c44-993a-3bacadf7ee9b admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:40.203470 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:40.239614 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ca2c3-b89b-47c5-847c-8ce1fcde1fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:40.240352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ca2c3-b89b-47c5-847c-8ce1fcde1fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:40.240729 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ca2c3-b89b-47c5-847c-8ce1fcde1fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:40.241495 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ca2c3-b89b-47c5-847c-8ce1fcde1fc6 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:40.242584 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ca2c3-b89b-47c5-847c-8ce1fcde1fc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:40.244678 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ca2c3-b89b-47c5-847c-8ce1fcde1fc6 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:40.269847 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1318/2618] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:25:40 2022] POST /identity/v3/users => generated 292 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:25:40.274172 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fee329-c352-4f47-93bc-6e25c80ae3cc admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:40.285820 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fee329-c352-4f47-93bc-6e25c80ae3cc admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:40.292227 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa0879-070f-4aee-b2ba-89887d2cbe4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:40.293179 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa0879-070f-4aee-b2ba-89887d2cbe4f admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:40.293333 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa0879-070f-4aee-b2ba-89887d2cbe4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:40.293688 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa0879-070f-4aee-b2ba-89887d2cbe4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:40.294500 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa0879-070f-4aee-b2ba-89887d2cbe4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:40.296157 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa0879-070f-4aee-b2ba-89887d2cbe4f admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:40.314858 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1301/2619] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:25:40.316110 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ca2c3-b89b-47c5-847c-8ce1fcde1fc6 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:40.327043 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ca2c3-b89b-47c5-847c-8ce1fcde1fc6 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:40.332935 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d111e-1419-4f96-b592-bdabfbb7ccad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:40.333971 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d111e-1419-4f96-b592-bdabfbb7ccad admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:40.334608 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d111e-1419-4f96-b592-bdabfbb7ccad admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:40.334900 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d111e-1419-4f96-b592-bdabfbb7ccad admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:40.336405 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d111e-1419-4f96-b592-bdabfbb7ccad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:40.339867 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d111e-1419-4f96-b592-bdabfbb7ccad admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:40.358827 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1319/2620] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:25:40.359878 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa0879-070f-4aee-b2ba-89887d2cbe4f admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:40.371535 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa0879-070f-4aee-b2ba-89887d2cbe4f admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:40.376624 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e8c2c-1c2e-4394-a9d6-916d4c988b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:40.377294 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e8c2c-1c2e-4394-a9d6-916d4c988b95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:40.377577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e8c2c-1c2e-4394-a9d6-916d4c988b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:40.377854 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e8c2c-1c2e-4394-a9d6-916d4c988b95 admin admin] PATH_INFO: `/v3/projects/951c7d08bd44465a8c98505dad30d2bf/users/598db6e730174d9ea7b1d126cf388fda/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:40.394160 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e8c2c-1c2e-4394-a9d6-916d4c988b95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=951c7d08bd44465a8c98505dad30d2bf, user_id=598db6e730174d9ea7b1d126cf388fda, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:40.396862 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e8c2c-1c2e-4394-a9d6-916d4c988b95 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:40.415122 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1302/2621] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:25:40 2022] PUT /identity/v3/projects/951c7d08bd44465a8c98505dad30d2bf/users/598db6e730174d9ea7b1d126cf388fda/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:40.424806 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e85b17-bb7d-4c26-9756-c7cf597fbf50 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:40.426109 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e85b17-bb7d-4c26-9756-c7cf597fbf50 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:40.426626 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e85b17-bb7d-4c26-9756-c7cf597fbf50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:40.461147 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-d1e85b17-bb7d-4c26-9756-c7cf597fbf50 None None] MFA Rules not processed for user `598db6e730174d9ea7b1d126cf388fda`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:40.462704 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d1e85b17-bb7d-4c26-9756-c7cf597fbf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:40.571048 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1320/2622] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:40.576507 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e8c2c-1c2e-4394-a9d6-916d4c988b95 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:40.677183 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e8c2c-1c2e-4394-a9d6-916d4c988b95 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:40.682423 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8646a1-133b-4db9-adc8-6510f8e57544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:40.683104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8646a1-133b-4db9-adc8-6510f8e57544 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:40.683383 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8646a1-133b-4db9-adc8-6510f8e57544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:40.683671 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8646a1-133b-4db9-adc8-6510f8e57544 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:40.684352 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8646a1-133b-4db9-adc8-6510f8e57544 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:40.686632 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8646a1-133b-4db9-adc8-6510f8e57544 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:40.727700 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1303/2623] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:25:40 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:25:40.729515 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e85b17-bb7d-4c26-9756-c7cf597fbf50 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:40.741623 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e85b17-bb7d-4c26-9756-c7cf597fbf50 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:40.815428 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743f584-fdc6-44b4-83db-b9456fded365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:40.816162 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743f584-fdc6-44b4-83db-b9456fded365 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:40.816548 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743f584-fdc6-44b4-83db-b9456fded365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:40.817015 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743f584-fdc6-44b4-83db-b9456fded365 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:40.817773 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743f584-fdc6-44b4-83db-b9456fded365 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:40.821001 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743f584-fdc6-44b4-83db-b9456fded365 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:40.853881 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1321/2624] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:25:40 2022] POST /identity/v3/users => generated 299 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:25:40.855795 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8646a1-133b-4db9-adc8-6510f8e57544 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:40.867257 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8646a1-133b-4db9-adc8-6510f8e57544 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:40.875564 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f64d82-e29f-41a0-9531-09e741adf275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:40.876282 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f64d82-e29f-41a0-9531-09e741adf275 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:40.876643 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f64d82-e29f-41a0-9531-09e741adf275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:40.876989 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f64d82-e29f-41a0-9531-09e741adf275 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:40.877720 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f64d82-e29f-41a0-9531-09e741adf275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:40.883161 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f64d82-e29f-41a0-9531-09e741adf275 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:40.899053 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1304/2625] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:25:40.903402 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743f584-fdc6-44b4-83db-b9456fded365 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:40.920738 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743f584-fdc6-44b4-83db-b9456fded365 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:40.925727 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53cf64-f1d4-4ab7-8387-86172d278607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:40.926581 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53cf64-f1d4-4ab7-8387-86172d278607 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:40.926943 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53cf64-f1d4-4ab7-8387-86172d278607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:40.927364 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53cf64-f1d4-4ab7-8387-86172d278607 admin admin] PATH_INFO: `/v3/projects/8058c3a0f2b54bf9842cc1f2c07b647f/users/3610490873ea4ea385f15e343e248e92/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:40.950822 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53cf64-f1d4-4ab7-8387-86172d278607 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8058c3a0f2b54bf9842cc1f2c07b647f, user_id=3610490873ea4ea385f15e343e248e92, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:40.954729 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53cf64-f1d4-4ab7-8387-86172d278607 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:40.984272 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1322/2626] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:25:40 2022] PUT /identity/v3/projects/8058c3a0f2b54bf9842cc1f2c07b647f/users/3610490873ea4ea385f15e343e248e92/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:40.988264 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f64d82-e29f-41a0-9531-09e741adf275 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:41.024064 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f64d82-e29f-41a0-9531-09e741adf275 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:41.032696 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:41.174212 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed53701-0d22-4a5e-b22a-1ba723b76d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:41.175169 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed53701-0d22-4a5e-b22a-1ba723b76d99 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:41.175499 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed53701-0d22-4a5e-b22a-1ba723b76d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:41.176110 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed53701-0d22-4a5e-b22a-1ba723b76d99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:41.177559 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed53701-0d22-4a5e-b22a-1ba723b76d99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:41.179812 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed53701-0d22-4a5e-b22a-1ba723b76d99 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:41.205699 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1305/2627] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:25:41.206362 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53cf64-f1d4-4ab7-8387-86172d278607 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:41.217542 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53cf64-f1d4-4ab7-8387-86172d278607 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:41.222389 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1244b-dc1a-4013-bb41-70f06dd972a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:41.223070 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1244b-dc1a-4013-bb41-70f06dd972a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:41.223366 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1244b-dc1a-4013-bb41-70f06dd972a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:41.223629 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1244b-dc1a-4013-bb41-70f06dd972a2 admin admin] PATH_INFO: `/v3/projects/8058c3a0f2b54bf9842cc1f2c07b647f/users/3610490873ea4ea385f15e343e248e92/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:41.225791 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1244b-dc1a-4013-bb41-70f06dd972a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8058c3a0f2b54bf9842cc1f2c07b647f, user_id=3610490873ea4ea385f15e343e248e92, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:41.228482 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1244b-dc1a-4013-bb41-70f06dd972a2 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:41.231272 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:41.250041 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1323/2628] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:25:41 2022] PUT /identity/v3/projects/8058c3a0f2b54bf9842cc1f2c07b647f/users/3610490873ea4ea385f15e343e248e92/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:25:41.330953 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b2b6b-3dd0-4b11-aab2-4a25ce780f80 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:41.331678 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b2b6b-3dd0-4b11-aab2-4a25ce780f80 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:41.332144 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b2b6b-3dd0-4b11-aab2-4a25ce780f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:41.391113 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-d01b2b6b-3dd0-4b11-aab2-4a25ce780f80 None None] MFA Rules not processed for user `3610490873ea4ea385f15e343e248e92`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:41.392487 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d01b2b6b-3dd0-4b11-aab2-4a25ce780f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:41.539437 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1306/2629] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:41 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:41.544662 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1244b-dc1a-4013-bb41-70f06dd972a2 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:41.546423 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4df1244b-dc1a-4013-bb41-70f06dd972a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:41.622925 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1244b-dc1a-4013-bb41-70f06dd972a2 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:41.626580 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91cdf8-7c8e-4baa-9a2c-8e1d89b60937 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:41.627214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91cdf8-7c8e-4baa-9a2c-8e1d89b60937 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:41.627484 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91cdf8-7c8e-4baa-9a2c-8e1d89b60937 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:41.627756 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91cdf8-7c8e-4baa-9a2c-8e1d89b60937 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:41.694483 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91cdf8-7c8e-4baa-9a2c-8e1d89b60937 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:41.695967 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91cdf8-7c8e-4baa-9a2c-8e1d89b60937 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:41.705049 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1324/2630] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:25:42.204611 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd67f5-a02c-457e-b5c7-f01d6fe1cbce None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:42.205436 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd67f5-a02c-457e-b5c7-f01d6fe1cbce None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:42.205812 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd67f5-a02c-457e-b5c7-f01d6fe1cbce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:42.237575 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-76dd67f5-a02c-457e-b5c7-f01d6fe1cbce None None] MFA Rules not processed for user `3e070c93f47045ecb5bf0a1622395091`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:42.238734 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-76dd67f5-a02c-457e-b5c7-f01d6fe1cbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:42.357254 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1307/2631] 10.222.0.79 () {58 vars in 1009 bytes} [Wed Aug 31 19:25:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:42.434395 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91cdf8-7c8e-4baa-9a2c-8e1d89b60937 service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:42.436255 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-aa91cdf8-7c8e-4baa-9a2c-8e1d89b60937 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:42.585569 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91cdf8-7c8e-4baa-9a2c-8e1d89b60937 service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:42.593958 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba27694-e83b-48ec-a70b-082d7b58b2ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b289a0bef53460ca5173ad946394d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:42.594954 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba27694-e83b-48ec-a70b-082d7b58b2ce service swift] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:42.595443 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba27694-e83b-48ec-a70b-082d7b58b2ce service swift] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:42.596019 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba27694-e83b-48ec-a70b-082d7b58b2ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:42.622980 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba27694-e83b-48ec-a70b-082d7b58b2ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:42.624721 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba27694-e83b-48ec-a70b-082d7b58b2ce service swift] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:42.637301 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1325/2632] 10.222.0.79 () {60 vars in 1384 bytes} [Wed Aug 31 19:25:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:25:43.139408 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd67f5-a02c-457e-b5c7-f01d6fe1cbce None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:43.140901 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-76dd67f5-a02c-457e-b5c7-f01d6fe1cbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:43.159960 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba27694-e83b-48ec-a70b-082d7b58b2ce service swift] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:43.161644 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-aba27694-e83b-48ec-a70b-082d7b58b2ce service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:43.223336 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:43.247910 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:43.357290 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd67f5-a02c-457e-b5c7-f01d6fe1cbce None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:43.362391 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed679a-2d22-46da-be7a-fb2baa301977 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:43.363051 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed679a-2d22-46da-be7a-fb2baa301977 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:43.363331 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed679a-2d22-46da-be7a-fb2baa301977 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:43.363671 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed679a-2d22-46da-be7a-fb2baa301977 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:43.367742 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f6ed679a-2d22-46da-be7a-fb2baa301977 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:43.477465 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba27694-e83b-48ec-a70b-082d7b58b2ce service swift] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:43.484898 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b7f30-0d6b-48f3-999f-2316582b9d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:43.485886 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b7f30-0d6b-48f3-999f-2316582b9d9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:43.486373 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b7f30-0d6b-48f3-999f-2316582b9d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:43.486955 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b7f30-0d6b-48f3-999f-2316582b9d9f admin admin] PATH_INFO: `/v3/users/4e329b952aed44d581a4a29c6070b4dd` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:43.488448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b7f30-0d6b-48f3-999f-2316582b9d9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e329b952aed44d581a4a29c6070b4dd)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:43.490977 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b7f30-0d6b-48f3-999f-2316582b9d9f admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:43.500305 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed679a-2d22-46da-be7a-fb2baa301977 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:43.501676 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed679a-2d22-46da-be7a-fb2baa301977 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:43.513195 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1308/2633] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:25:43.564488 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-683b7f30-0d6b-48f3-999f-2316582b9d9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e329b952aed44d581a4a29c6070b4dd'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:43.577418 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-683b7f30-0d6b-48f3-999f-2316582b9d9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e329b952aed44d581a4a29c6070b4dd'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:43.590406 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-683b7f30-0d6b-48f3-999f-2316582b9d9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e329b952aed44d581a4a29c6070b4dd'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:43.618594 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-683b7f30-0d6b-48f3-999f-2316582b9d9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e329b952aed44d581a4a29c6070b4dd'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:43.619659 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-683b7f30-0d6b-48f3-999f-2316582b9d9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e329b952aed44d581a4a29c6070b4dd'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:43.639540 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1326/2634] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:25:43 2022] DELETE /identity/v3/users/4e329b952aed44d581a4a29c6070b4dd => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:25:43.940281 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed679a-2d22-46da-be7a-fb2baa301977 service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:43.956835 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed679a-2d22-46da-be7a-fb2baa301977 service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:44.076733 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4da789-05bd-4edb-8ea6-89fdd7ca9dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:44.077359 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4da789-05bd-4edb-8ea6-89fdd7ca9dd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:44.077641 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4da789-05bd-4edb-8ea6-89fdd7ca9dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:44.077916 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4da789-05bd-4edb-8ea6-89fdd7ca9dd0 admin admin] PATH_INFO: `/v3/projects/042713cbb86f49a2ba1e8dbb25278604` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:44.079085 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4da789-05bd-4edb-8ea6-89fdd7ca9dd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=042713cbb86f49a2ba1e8dbb25278604)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:44.082509 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4da789-05bd-4edb-8ea6-89fdd7ca9dd0 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:44.162115 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6e4da789-05bd-4edb-8ea6-89fdd7ca9dd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '042713cbb86f49a2ba1e8dbb25278604', 'request_id': 'req-6e4da789-05bd-4edb-8ea6-89fdd7ca9dd0'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:44.169679 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:44.171490 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6e4da789-05bd-4edb-8ea6-89fdd7ca9dd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '042713cbb86f49a2ba1e8dbb25278604', 'request_id': 'req-6e4da789-05bd-4edb-8ea6-89fdd7ca9dd0'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:44.181992 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6e4da789-05bd-4edb-8ea6-89fdd7ca9dd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '042713cbb86f49a2ba1e8dbb25278604', 'request_id': 'req-6e4da789-05bd-4edb-8ea6-89fdd7ca9dd0'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:44.204033 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6e4da789-05bd-4edb-8ea6-89fdd7ca9dd0 admin admin] The token cache is being invalidate because project 042713cbb86f49a2ba1e8dbb25278604 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:25:44.204450 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6e4da789-05bd-4edb-8ea6-89fdd7ca9dd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:44.205673 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6e4da789-05bd-4edb-8ea6-89fdd7ca9dd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:44.207796 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1309/2635] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:25:43 2022] DELETE /identity/v3/projects/042713cbb86f49a2ba1e8dbb25278604 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:44.212722 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119760b4-8e47-4808-abbe-11ccc643ffcd None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:44.213014 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119760b4-8e47-4808-abbe-11ccc643ffcd None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:44.213614 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119760b4-8e47-4808-abbe-11ccc643ffcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:44.294158 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-119760b4-8e47-4808-abbe-11ccc643ffcd None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:44.295973 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-119760b4-8e47-4808-abbe-11ccc643ffcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:44.320745 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:44.380704 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1327/2636] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:44.389577 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5dc72-4c39-4ec4-8dc5-957849aa9394 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:44.390122 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5dc72-4c39-4ec4-8dc5-957849aa9394 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:44.390122 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5dc72-4c39-4ec4-8dc5-957849aa9394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:44.412491 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-cde5dc72-4c39-4ec4-8dc5-957849aa9394 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:44.414711 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-cde5dc72-4c39-4ec4-8dc5-957849aa9394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:44.427158 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1310/2637] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:44.431149 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119760b4-8e47-4808-abbe-11ccc643ffcd None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:44.446746 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119760b4-8e47-4808-abbe-11ccc643ffcd None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:44.456116 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf2ee6-e91e-4bd3-a08d-b3a9a5183ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:44.456747 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf2ee6-e91e-4bd3-a08d-b3a9a5183ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:44.457027 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf2ee6-e91e-4bd3-a08d-b3a9a5183ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:44.457542 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf2ee6-e91e-4bd3-a08d-b3a9a5183ed6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:44.458220 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf2ee6-e91e-4bd3-a08d-b3a9a5183ed6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:25:44.458560 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf2ee6-e91e-4bd3-a08d-b3a9a5183ed6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:44.460859 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf2ee6-e91e-4bd3-a08d-b3a9a5183ed6 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:44.492755 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1328/2638] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:25:44.497250 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5dc72-4c39-4ec4-8dc5-957849aa9394 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:44.507387 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5dc72-4c39-4ec4-8dc5-957849aa9394 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:44.512767 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7357806-0350-4cae-bd7d-70cbb39640d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:44.513587 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7357806-0350-4cae-bd7d-70cbb39640d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:44.514054 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7357806-0350-4cae-bd7d-70cbb39640d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:44.514548 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7357806-0350-4cae-bd7d-70cbb39640d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:44.515146 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7357806-0350-4cae-bd7d-70cbb39640d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:44.517200 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7357806-0350-4cae-bd7d-70cbb39640d5 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:44.565482 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1311/2639] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:25:44 2022] POST /identity/v3/projects => generated 405 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:25:44.570578 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf2ee6-e91e-4bd3-a08d-b3a9a5183ed6 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:44.583342 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf2ee6-e91e-4bd3-a08d-b3a9a5183ed6 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:44.655336 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e04b9-652c-4c6d-bd0a-a479eac8c0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:44.656605 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e04b9-652c-4c6d-bd0a-a479eac8c0ce admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:44.657093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e04b9-652c-4c6d-bd0a-a479eac8c0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:44.657366 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e04b9-652c-4c6d-bd0a-a479eac8c0ce admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:44.658008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e04b9-652c-4c6d-bd0a-a479eac8c0ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:44.660167 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e04b9-652c-4c6d-bd0a-a479eac8c0ce admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:44.688237 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1329/2640] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:25:44 2022] POST /identity/v3/users => generated 303 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:25:44.690106 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7357806-0350-4cae-bd7d-70cbb39640d5 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:44.704108 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7357806-0350-4cae-bd7d-70cbb39640d5 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:44.715224 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b0d9c-5244-4c25-931b-34e79691a2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:44.715860 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b0d9c-5244-4c25-931b-34e79691a2d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:44.716203 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b0d9c-5244-4c25-931b-34e79691a2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:44.716407 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b0d9c-5244-4c25-931b-34e79691a2d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:44.717071 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b0d9c-5244-4c25-931b-34e79691a2d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:44.719973 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b0d9c-5244-4c25-931b-34e79691a2d6 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:44.739079 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1312/2641] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:25:44.740153 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e04b9-652c-4c6d-bd0a-a479eac8c0ce admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:44.752452 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e04b9-652c-4c6d-bd0a-a479eac8c0ce admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:44.758124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ba6df-1b7a-47a1-983a-1e9f5d4a1430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:44.758935 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ba6df-1b7a-47a1-983a-1e9f5d4a1430 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:44.759222 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ba6df-1b7a-47a1-983a-1e9f5d4a1430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:44.759495 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ba6df-1b7a-47a1-983a-1e9f5d4a1430 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:44.760330 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ba6df-1b7a-47a1-983a-1e9f5d4a1430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:44.761941 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ba6df-1b7a-47a1-983a-1e9f5d4a1430 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:44.780736 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1330/2642] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:25:44.781919 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b0d9c-5244-4c25-931b-34e79691a2d6 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:44.794941 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b0d9c-5244-4c25-931b-34e79691a2d6 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:44.808237 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611b1bb-aa6f-4a2b-9e10-c47b5acdb5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:44.808824 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611b1bb-aa6f-4a2b-9e10-c47b5acdb5e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:44.809099 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611b1bb-aa6f-4a2b-9e10-c47b5acdb5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:44.809368 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611b1bb-aa6f-4a2b-9e10-c47b5acdb5e6 admin admin] PATH_INFO: `/v3/projects/5a0efce01db54f408c095a9a65580990/users/a6e82255415f42dcbb3e9c651a26d345/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:44.836011 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0611b1bb-aa6f-4a2b-9e10-c47b5acdb5e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a0efce01db54f408c095a9a65580990, user_id=a6e82255415f42dcbb3e9c651a26d345, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:44.839262 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0611b1bb-aa6f-4a2b-9e10-c47b5acdb5e6 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:44.866731 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1313/2643] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:25:44 2022] PUT /identity/v3/projects/5a0efce01db54f408c095a9a65580990/users/a6e82255415f42dcbb3e9c651a26d345/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:25:44.885124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2377d4-bbfe-4d3c-918c-2e00972046d4 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:44.885124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2377d4-bbfe-4d3c-918c-2e00972046d4 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:44.885124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2377d4-bbfe-4d3c-918c-2e00972046d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:44.944734 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-3d2377d4-bbfe-4d3c-918c-2e00972046d4 None None] MFA Rules not processed for user `a6e82255415f42dcbb3e9c651a26d345`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:44.950244 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3d2377d4-bbfe-4d3c-918c-2e00972046d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:45.090845 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1331/2644] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:44 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:45.096387 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611b1bb-aa6f-4a2b-9e10-c47b5acdb5e6 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:45.215595 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611b1bb-aa6f-4a2b-9e10-c47b5acdb5e6 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:45.225731 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f01c40-4f00-492f-9344-6d40027114e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:45.226364 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f01c40-4f00-492f-9344-6d40027114e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:45.226714 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f01c40-4f00-492f-9344-6d40027114e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:45.226990 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f01c40-4f00-492f-9344-6d40027114e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:45.228175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f01c40-4f00-492f-9344-6d40027114e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:45.229923 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f01c40-4f00-492f-9344-6d40027114e9 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:45.281753 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1314/2645] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:25:45 2022] POST /identity/v3/projects => generated 405 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:25:45.285313 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2377d4-bbfe-4d3c-918c-2e00972046d4 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:45.300421 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2377d4-bbfe-4d3c-918c-2e00972046d4 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:45.356343 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:45.436304 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a882da-8a86-4800-983f-3079a68b407b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:45.437060 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a882da-8a86-4800-983f-3079a68b407b admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:45.437344 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a882da-8a86-4800-983f-3079a68b407b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:45.437618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a882da-8a86-4800-983f-3079a68b407b admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:45.439907 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a882da-8a86-4800-983f-3079a68b407b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:45.440469 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a882da-8a86-4800-983f-3079a68b407b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:45.473511 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1332/2646] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:25:45 2022] POST /identity/v3/users => generated 309 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:25:45.476358 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f01c40-4f00-492f-9344-6d40027114e9 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:45.492487 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f01c40-4f00-492f-9344-6d40027114e9 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:45.500346 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af33b15-a048-4dbc-8398-9883c0e51672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:45.501131 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af33b15-a048-4dbc-8398-9883c0e51672 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:45.501522 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af33b15-a048-4dbc-8398-9883c0e51672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:45.501906 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af33b15-a048-4dbc-8398-9883c0e51672 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:45.502998 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af33b15-a048-4dbc-8398-9883c0e51672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:45.507714 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af33b15-a048-4dbc-8398-9883c0e51672 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:45.535880 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1315/2647] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:25:45.542346 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a882da-8a86-4800-983f-3079a68b407b admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:45.549234 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a882da-8a86-4800-983f-3079a68b407b admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:45.580396 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11dbc3-7b4d-49fa-baf2-c975a4c2ce65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:45.582046 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11dbc3-7b4d-49fa-baf2-c975a4c2ce65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:45.582342 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11dbc3-7b4d-49fa-baf2-c975a4c2ce65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:45.582945 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11dbc3-7b4d-49fa-baf2-c975a4c2ce65 admin admin] PATH_INFO: `/v3/projects/38f5f193038a4a08bf938dbc3943621f/users/3ab4199cc6954691a63cf053e88fd98f/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:45.615246 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11dbc3-7b4d-49fa-baf2-c975a4c2ce65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38f5f193038a4a08bf938dbc3943621f, user_id=3ab4199cc6954691a63cf053e88fd98f, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:45.620913 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11dbc3-7b4d-49fa-baf2-c975a4c2ce65 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:45.652470 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1333/2648] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:25:45 2022] PUT /identity/v3/projects/38f5f193038a4a08bf938dbc3943621f/users/3ab4199cc6954691a63cf053e88fd98f/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:45.654125 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af33b15-a048-4dbc-8398-9883c0e51672 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:45.674129 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af33b15-a048-4dbc-8398-9883c0e51672 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:45.772628 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:45.785080 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74bceaa-1ecc-498b-a73c-0f7e7b53f3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:45.786203 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bceaa-1ecc-498b-a73c-0f7e7b53f3d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:45.786752 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bceaa-1ecc-498b-a73c-0f7e7b53f3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:45.787196 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bceaa-1ecc-498b-a73c-0f7e7b53f3d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:45.789022 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74bceaa-1ecc-498b-a73c-0f7e7b53f3d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:45.791252 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74bceaa-1ecc-498b-a73c-0f7e7b53f3d4 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:45.806090 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1316/2649] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:25:45.810370 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11dbc3-7b4d-49fa-baf2-c975a4c2ce65 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:45.821601 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11dbc3-7b4d-49fa-baf2-c975a4c2ce65 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:45.829769 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1e9d8-f900-4d3b-a23a-27e5b4a64141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:45.830736 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1e9d8-f900-4d3b-a23a-27e5b4a64141 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:45.831191 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1e9d8-f900-4d3b-a23a-27e5b4a64141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:45.831756 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1e9d8-f900-4d3b-a23a-27e5b4a64141 admin admin] PATH_INFO: `/v3/projects/38f5f193038a4a08bf938dbc3943621f/users/3ab4199cc6954691a63cf053e88fd98f/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:45.833914 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1e9d8-f900-4d3b-a23a-27e5b4a64141 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38f5f193038a4a08bf938dbc3943621f, user_id=3ab4199cc6954691a63cf053e88fd98f, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:45.837402 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1e9d8-f900-4d3b-a23a-27e5b4a64141 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:45.855219 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1334/2650] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:25:45 2022] PUT /identity/v3/projects/38f5f193038a4a08bf938dbc3943621f/users/3ab4199cc6954691a63cf053e88fd98f/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:45.865685 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff38102-5b4f-4213-9e40-9325e7823018 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:45.865941 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff38102-5b4f-4213-9e40-9325e7823018 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:45.866164 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff38102-5b4f-4213-9e40-9325e7823018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:45.920489 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-2ff38102-5b4f-4213-9e40-9325e7823018 None None] MFA Rules not processed for user `3ab4199cc6954691a63cf053e88fd98f`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:45.921740 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-2ff38102-5b4f-4213-9e40-9325e7823018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:46.016729 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1317/2651] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:45 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:46.024526 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1e9d8-f900-4d3b-a23a-27e5b4a64141 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:46.026730 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-53b1e9d8-f900-4d3b-a23a-27e5b4a64141 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:46.099605 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1e9d8-f900-4d3b-a23a-27e5b4a64141 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:46.104280 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094e1f2-4a4b-49f1-b036-19fa6d279040 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:46.105028 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094e1f2-4a4b-49f1-b036-19fa6d279040 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:46.105415 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094e1f2-4a4b-49f1-b036-19fa6d279040 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:46.105822 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094e1f2-4a4b-49f1-b036-19fa6d279040 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:46.120952 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9094e1f2-4a4b-49f1-b036-19fa6d279040 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:46.122591 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9094e1f2-4a4b-49f1-b036-19fa6d279040 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:46.146013 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1335/2652] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:46 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:25:46.300631 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff38102-5b4f-4213-9e40-9325e7823018 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:46.433777 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff38102-5b4f-4213-9e40-9325e7823018 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:46.444209 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49d8ee-c27e-44f9-abbf-083a713f44fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:46.444650 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49d8ee-c27e-44f9-abbf-083a713f44fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:46.445072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49d8ee-c27e-44f9-abbf-083a713f44fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:46.445222 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49d8ee-c27e-44f9-abbf-083a713f44fd admin admin] PATH_INFO: `/v3/users/a6e82255415f42dcbb3e9c651a26d345` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:46.447698 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee49d8ee-c27e-44f9-abbf-083a713f44fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6e82255415f42dcbb3e9c651a26d345)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:46.449687 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee49d8ee-c27e-44f9-abbf-083a713f44fd admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:46.555752 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094e1f2-4a4b-49f1-b036-19fa6d279040 service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:46.569339 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-ee49d8ee-c27e-44f9-abbf-083a713f44fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6e82255415f42dcbb3e9c651a26d345'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:46.571373 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-ee49d8ee-c27e-44f9-abbf-083a713f44fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6e82255415f42dcbb3e9c651a26d345'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:46.574888 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094e1f2-4a4b-49f1-b036-19fa6d279040 service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:46.585286 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89144e94-bd5f-4af5-a0e8-6e95bfc71045 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:46.586957 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89144e94-bd5f-4af5-a0e8-6e95bfc71045 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:46.588883 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89144e94-bd5f-4af5-a0e8-6e95bfc71045 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:46.589897 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89144e94-bd5f-4af5-a0e8-6e95bfc71045 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:46.593016 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-89144e94-bd5f-4af5-a0e8-6e95bfc71045 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:46.603619 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-ee49d8ee-c27e-44f9-abbf-083a713f44fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6e82255415f42dcbb3e9c651a26d345'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:46.627607 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-ee49d8ee-c27e-44f9-abbf-083a713f44fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6e82255415f42dcbb3e9c651a26d345'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:46.637241 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:46.645321 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-ee49d8ee-c27e-44f9-abbf-083a713f44fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6e82255415f42dcbb3e9c651a26d345'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:46.658832 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1318/2653] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:25:46 2022] DELETE /identity/v3/users/a6e82255415f42dcbb3e9c651a26d345 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:46.663685 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be61b4-4b38-4695-9dd6-2a69c04b7fd4 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:46.663968 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be61b4-4b38-4695-9dd6-2a69c04b7fd4 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:46.664238 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be61b4-4b38-4695-9dd6-2a69c04b7fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:46.684884 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89144e94-bd5f-4af5-a0e8-6e95bfc71045 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:46.686603 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89144e94-bd5f-4af5-a0e8-6e95bfc71045 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:46.692024 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-85be61b4-4b38-4695-9dd6-2a69c04b7fd4 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:46.694207 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-85be61b4-4b38-4695-9dd6-2a69c04b7fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:46.698399 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1336/2654] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:25:46.781705 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1319/2655] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:46.796437 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89144e94-bd5f-4af5-a0e8-6e95bfc71045 service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:46.798022 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-89144e94-bd5f-4af5-a0e8-6e95bfc71045 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:46.816124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:46.934264 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89144e94-bd5f-4af5-a0e8-6e95bfc71045 service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:47.031867 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13e65a-c356-4ea6-b9f2-f78be453ac61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:47.032711 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13e65a-c356-4ea6-b9f2-f78be453ac61 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:47.033107 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13e65a-c356-4ea6-b9f2-f78be453ac61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:47.033517 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13e65a-c356-4ea6-b9f2-f78be453ac61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:47.056215 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d13e65a-c356-4ea6-b9f2-f78be453ac61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:47.062211 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d13e65a-c356-4ea6-b9f2-f78be453ac61 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:47.111527 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1337/2656] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:25:47.816837 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be61b4-4b38-4695-9dd6-2a69c04b7fd4 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:47.818958 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-85be61b4-4b38-4695-9dd6-2a69c04b7fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:47.837856 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be61b4-4b38-4695-9dd6-2a69c04b7fd4 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:47.849203 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66c6f5-5850-405a-b506-5f91d5d777bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:47.850735 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66c6f5-5850-405a-b506-5f91d5d777bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:47.851198 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66c6f5-5850-405a-b506-5f91d5d777bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:47.851669 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66c6f5-5850-405a-b506-5f91d5d777bf admin admin] PATH_INFO: `/v3/projects/5a0efce01db54f408c095a9a65580990` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:47.853295 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66c6f5-5850-405a-b506-5f91d5d777bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a0efce01db54f408c095a9a65580990)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:47.857386 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66c6f5-5850-405a-b506-5f91d5d777bf admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:47.944683 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1f66c6f5-5850-405a-b506-5f91d5d777bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a0efce01db54f408c095a9a65580990', 'request_id': 'req-1f66c6f5-5850-405a-b506-5f91d5d777bf'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:47.951383 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1f66c6f5-5850-405a-b506-5f91d5d777bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a0efce01db54f408c095a9a65580990', 'request_id': 'req-1f66c6f5-5850-405a-b506-5f91d5d777bf'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:47.960447 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1f66c6f5-5850-405a-b506-5f91d5d777bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a0efce01db54f408c095a9a65580990', 'request_id': 'req-1f66c6f5-5850-405a-b506-5f91d5d777bf'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:47.986755 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1f66c6f5-5850-405a-b506-5f91d5d777bf admin admin] The token cache is being invalidate because project 5a0efce01db54f408c095a9a65580990 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:25:47.987148 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1f66c6f5-5850-405a-b506-5f91d5d777bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:47.988010 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1f66c6f5-5850-405a-b506-5f91d5d777bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:47.996222 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1320/2657] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:25:47 2022] DELETE /identity/v3/projects/5a0efce01db54f408c095a9a65580990 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:47.997531 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13e65a-c356-4ea6-b9f2-f78be453ac61 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:48.015801 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13e65a-c356-4ea6-b9f2-f78be453ac61 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:48.120926 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9b7e7-f137-4a28-b0f8-d9bc470573dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:48.121807 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9b7e7-f137-4a28-b0f8-d9bc470573dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:48.122779 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9b7e7-f137-4a28-b0f8-d9bc470573dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:48.123236 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9b7e7-f137-4a28-b0f8-d9bc470573dd admin admin] PATH_INFO: `/v3/users/3ab4199cc6954691a63cf053e88fd98f` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:48.124504 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9b7e7-f137-4a28-b0f8-d9bc470573dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ab4199cc6954691a63cf053e88fd98f)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:48.132987 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9b7e7-f137-4a28-b0f8-d9bc470573dd admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:48.236741 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-40e9b7e7-f137-4a28-b0f8-d9bc470573dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ab4199cc6954691a63cf053e88fd98f'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:48.252137 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-40e9b7e7-f137-4a28-b0f8-d9bc470573dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ab4199cc6954691a63cf053e88fd98f'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:48.265034 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-40e9b7e7-f137-4a28-b0f8-d9bc470573dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ab4199cc6954691a63cf053e88fd98f'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:48.272381 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:48.282121 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-40e9b7e7-f137-4a28-b0f8-d9bc470573dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ab4199cc6954691a63cf053e88fd98f'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:48.283352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-40e9b7e7-f137-4a28-b0f8-d9bc470573dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ab4199cc6954691a63cf053e88fd98f'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:48.298797 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1338/2658] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:25:47 2022] DELETE /identity/v3/users/3ab4199cc6954691a63cf053e88fd98f => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:49.177839 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66c6f5-5850-405a-b506-5f91d5d777bf admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:49.179454 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1f66c6f5-5850-405a-b506-5f91d5d777bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:49.208200 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66c6f5-5850-405a-b506-5f91d5d777bf admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:49.332359 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5baec-ed85-49cb-b601-1ebfe8eb00be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:49.333439 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5baec-ed85-49cb-b601-1ebfe8eb00be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:49.333820 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5baec-ed85-49cb-b601-1ebfe8eb00be admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:49.335144 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5baec-ed85-49cb-b601-1ebfe8eb00be admin admin] PATH_INFO: `/v3/projects/38f5f193038a4a08bf938dbc3943621f` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:49.336896 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b5baec-ed85-49cb-b601-1ebfe8eb00be admin admin] RBAC: Authorizing `identity:delete_project(project_id=38f5f193038a4a08bf938dbc3943621f)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:49.339643 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b5baec-ed85-49cb-b601-1ebfe8eb00be admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:49.373971 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:49.423040 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-53b5baec-ed85-49cb-b601-1ebfe8eb00be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38f5f193038a4a08bf938dbc3943621f', 'request_id': 'req-53b5baec-ed85-49cb-b601-1ebfe8eb00be'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:49.433583 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-53b5baec-ed85-49cb-b601-1ebfe8eb00be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38f5f193038a4a08bf938dbc3943621f', 'request_id': 'req-53b5baec-ed85-49cb-b601-1ebfe8eb00be'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:49.445375 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-53b5baec-ed85-49cb-b601-1ebfe8eb00be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38f5f193038a4a08bf938dbc3943621f', 'request_id': 'req-53b5baec-ed85-49cb-b601-1ebfe8eb00be'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:49.464921 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-53b5baec-ed85-49cb-b601-1ebfe8eb00be admin admin] The token cache is being invalidate because project 38f5f193038a4a08bf938dbc3943621f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:25:49.465473 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-53b5baec-ed85-49cb-b601-1ebfe8eb00be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:49.466383 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-53b5baec-ed85-49cb-b601-1ebfe8eb00be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:49.468838 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1321/2659] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:25:49 2022] DELETE /identity/v3/projects/38f5f193038a4a08bf938dbc3943621f => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:49.473961 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e66f09-5f9b-4b5e-9733-a684ff6021d2 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:49.474509 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e66f09-5f9b-4b5e-9733-a684ff6021d2 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:49.474612 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e66f09-5f9b-4b5e-9733-a684ff6021d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:49.496416 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-50e66f09-5f9b-4b5e-9733-a684ff6021d2 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:49.497651 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-50e66f09-5f9b-4b5e-9733-a684ff6021d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:49.634434 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1339/2660] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:49.635279 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f088c3-210d-4450-b6f4-781e2d52d44c None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:49.635645 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f088c3-210d-4450-b6f4-781e2d52d44c None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:49.636524 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f088c3-210d-4450-b6f4-781e2d52d44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:49.669684 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-b8f088c3-210d-4450-b6f4-781e2d52d44c None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:49.671068 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-b8f088c3-210d-4450-b6f4-781e2d52d44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:49.695727 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1322/2661] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:49.700224 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e66f09-5f9b-4b5e-9733-a684ff6021d2 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:49.712093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e66f09-5f9b-4b5e-9733-a684ff6021d2 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:49.717401 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea38f52-95ed-47e4-bfd5-2b66850d9450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:49.718072 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea38f52-95ed-47e4-bfd5-2b66850d9450 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:49.718408 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea38f52-95ed-47e4-bfd5-2b66850d9450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:49.718734 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea38f52-95ed-47e4-bfd5-2b66850d9450 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:49.719399 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea38f52-95ed-47e4-bfd5-2b66850d9450 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:25:49.719700 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea38f52-95ed-47e4-bfd5-2b66850d9450 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:49.723205 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea38f52-95ed-47e4-bfd5-2b66850d9450 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:49.746060 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1340/2662] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:25:49.749679 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f088c3-210d-4450-b6f4-781e2d52d44c None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:49.772863 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f088c3-210d-4450-b6f4-781e2d52d44c None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:49.780228 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9cc26-683b-4889-b0f2-3198e520550f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:49.781168 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9cc26-683b-4889-b0f2-3198e520550f admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:49.781536 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9cc26-683b-4889-b0f2-3198e520550f admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:49.782476 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9cc26-683b-4889-b0f2-3198e520550f admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:49.782595 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df9cc26-683b-4889-b0f2-3198e520550f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:49.784852 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df9cc26-683b-4889-b0f2-3198e520550f admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:49.822556 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1323/2663] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:25:49 2022] POST /identity/v3/projects => generated 387 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:25:49.826362 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea38f52-95ed-47e4-bfd5-2b66850d9450 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:49.837635 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea38f52-95ed-47e4-bfd5-2b66850d9450 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:49.921746 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20605a3a-8fee-419f-a4ca-802aa2c7ba71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:49.925147 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20605a3a-8fee-419f-a4ca-802aa2c7ba71 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:49.925147 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20605a3a-8fee-419f-a4ca-802aa2c7ba71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:49.925147 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20605a3a-8fee-419f-a4ca-802aa2c7ba71 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:49.925147 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20605a3a-8fee-419f-a4ca-802aa2c7ba71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:49.926488 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20605a3a-8fee-419f-a4ca-802aa2c7ba71 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:49.955069 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1341/2664] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:25:49 2022] POST /identity/v3/users => generated 294 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:25:49.958774 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9cc26-683b-4889-b0f2-3198e520550f admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:49.974871 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9cc26-683b-4889-b0f2-3198e520550f admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:49.993082 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359db0b-9b8a-422c-8442-b4e94ebb3992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:49.993596 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359db0b-9b8a-422c-8442-b4e94ebb3992 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:49.993936 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359db0b-9b8a-422c-8442-b4e94ebb3992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:49.994275 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359db0b-9b8a-422c-8442-b4e94ebb3992 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:49.995214 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359db0b-9b8a-422c-8442-b4e94ebb3992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:49.998979 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359db0b-9b8a-422c-8442-b4e94ebb3992 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:50.020369 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1324/2665] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:25:50.022050 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20605a3a-8fee-419f-a4ca-802aa2c7ba71 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:50.035083 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20605a3a-8fee-419f-a4ca-802aa2c7ba71 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:50.052461 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700e59c-fd93-4907-9b62-486391760894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:50.053274 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700e59c-fd93-4907-9b62-486391760894 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:50.054159 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700e59c-fd93-4907-9b62-486391760894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:50.056888 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700e59c-fd93-4907-9b62-486391760894 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:50.056888 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700e59c-fd93-4907-9b62-486391760894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:50.058372 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700e59c-fd93-4907-9b62-486391760894 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:50.079203 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1342/2666] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:25:50.083605 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359db0b-9b8a-422c-8442-b4e94ebb3992 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:50.096659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359db0b-9b8a-422c-8442-b4e94ebb3992 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:50.103242 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4659a46-0b82-4251-bb1a-96145b0c2cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:50.103962 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4659a46-0b82-4251-bb1a-96145b0c2cb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:50.104266 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4659a46-0b82-4251-bb1a-96145b0c2cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:50.104545 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4659a46-0b82-4251-bb1a-96145b0c2cb5 admin admin] PATH_INFO: `/v3/projects/67cae450889f452ba1fd91fdb18fcbc7/users/ee0cd41b1caa4eaebd56ab1540403ab3/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:50.126370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4659a46-0b82-4251-bb1a-96145b0c2cb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67cae450889f452ba1fd91fdb18fcbc7, user_id=ee0cd41b1caa4eaebd56ab1540403ab3, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:50.131031 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4659a46-0b82-4251-bb1a-96145b0c2cb5 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:50.154964 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1325/2667] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:25:50 2022] PUT /identity/v3/projects/67cae450889f452ba1fd91fdb18fcbc7/users/ee0cd41b1caa4eaebd56ab1540403ab3/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:50.166538 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad2b1e-12f0-4419-b593-7f4391602b63 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:50.166815 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad2b1e-12f0-4419-b593-7f4391602b63 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:50.167067 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad2b1e-12f0-4419-b593-7f4391602b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:50.204482 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-c5ad2b1e-12f0-4419-b593-7f4391602b63 None None] MFA Rules not processed for user `ee0cd41b1caa4eaebd56ab1540403ab3`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:50.206348 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c5ad2b1e-12f0-4419-b593-7f4391602b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:50.265871 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:50.302796 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1343/2668] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:50.307500 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4659a46-0b82-4251-bb1a-96145b0c2cb5 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:50.404558 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4659a46-0b82-4251-bb1a-96145b0c2cb5 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:50.428120 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f723ab-d469-4170-87ba-d005b624f4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:50.429693 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f723ab-d469-4170-87ba-d005b624f4a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:50.430033 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f723ab-d469-4170-87ba-d005b624f4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:50.430330 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f723ab-d469-4170-87ba-d005b624f4a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:50.431157 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f723ab-d469-4170-87ba-d005b624f4a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:50.433498 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f723ab-d469-4170-87ba-d005b624f4a0 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:50.480715 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1326/2669] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:25:50 2022] POST /identity/v3/projects => generated 387 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:25:50.485156 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad2b1e-12f0-4419-b593-7f4391602b63 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:50.505992 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad2b1e-12f0-4419-b593-7f4391602b63 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:50.639832 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377a706-f76a-4e01-9af7-cbdaa91b01aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:50.640949 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377a706-f76a-4e01-9af7-cbdaa91b01aa admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:50.641390 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377a706-f76a-4e01-9af7-cbdaa91b01aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:50.641820 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377a706-f76a-4e01-9af7-cbdaa91b01aa admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:50.642807 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c377a706-f76a-4e01-9af7-cbdaa91b01aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:50.645572 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c377a706-f76a-4e01-9af7-cbdaa91b01aa admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:50.689772 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1344/2670] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:25:50 2022] POST /identity/v3/users => generated 300 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:25:50.694599 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f723ab-d469-4170-87ba-d005b624f4a0 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:50.711194 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f723ab-d469-4170-87ba-d005b624f4a0 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:50.721585 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1aaa5a-2cf1-4627-93e1-fa6d106569b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:50.722929 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1aaa5a-2cf1-4627-93e1-fa6d106569b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:50.723437 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1aaa5a-2cf1-4627-93e1-fa6d106569b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:50.723981 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1aaa5a-2cf1-4627-93e1-fa6d106569b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:50.724929 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1aaa5a-2cf1-4627-93e1-fa6d106569b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:50.727105 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1aaa5a-2cf1-4627-93e1-fa6d106569b0 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:50.741724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1327/2671] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:25:50.750419 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377a706-f76a-4e01-9af7-cbdaa91b01aa admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:50.764413 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377a706-f76a-4e01-9af7-cbdaa91b01aa admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:50.772675 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de87fd-118e-4c6f-80e3-9c65ea6cd822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:50.773450 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de87fd-118e-4c6f-80e3-9c65ea6cd822 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:50.773990 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de87fd-118e-4c6f-80e3-9c65ea6cd822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:50.774273 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de87fd-118e-4c6f-80e3-9c65ea6cd822 admin admin] PATH_INFO: `/v3/projects/bc18a4a78148414899471344207a4a83/users/ce260269ed844c78be7997724592a189/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:50.797843 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56de87fd-118e-4c6f-80e3-9c65ea6cd822 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc18a4a78148414899471344207a4a83, user_id=ce260269ed844c78be7997724592a189, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:50.800573 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56de87fd-118e-4c6f-80e3-9c65ea6cd822 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:50.826438 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1345/2672] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:25:50 2022] PUT /identity/v3/projects/bc18a4a78148414899471344207a4a83/users/ce260269ed844c78be7997724592a189/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:25:50.830568 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1aaa5a-2cf1-4627-93e1-fa6d106569b0 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:50.847753 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1aaa5a-2cf1-4627-93e1-fa6d106569b0 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:50.892243 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:50.958321 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e1aae-ceb6-450b-a9ce-86de4e9b85e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:50.959452 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e1aae-ceb6-450b-a9ce-86de4e9b85e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:50.960056 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e1aae-ceb6-450b-a9ce-86de4e9b85e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:50.960200 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e1aae-ceb6-450b-a9ce-86de4e9b85e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:50.960849 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e1aae-ceb6-450b-a9ce-86de4e9b85e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:50.963781 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e1aae-ceb6-450b-a9ce-86de4e9b85e8 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:50.977255 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1328/2673] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:25:50.981056 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de87fd-118e-4c6f-80e3-9c65ea6cd822 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:50.996183 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de87fd-118e-4c6f-80e3-9c65ea6cd822 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:51.017324 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1320b-09a0-45b9-a648-b1084fa9eead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:51.018127 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1320b-09a0-45b9-a648-b1084fa9eead admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:51.019403 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1320b-09a0-45b9-a648-b1084fa9eead admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:51.020155 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1320b-09a0-45b9-a648-b1084fa9eead admin admin] PATH_INFO: `/v3/projects/bc18a4a78148414899471344207a4a83/users/ce260269ed844c78be7997724592a189/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:51.025092 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a1320b-09a0-45b9-a648-b1084fa9eead admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc18a4a78148414899471344207a4a83, user_id=ce260269ed844c78be7997724592a189, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:51.028530 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a1320b-09a0-45b9-a648-b1084fa9eead admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:51.042291 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1346/2674] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:25:50 2022] PUT /identity/v3/projects/bc18a4a78148414899471344207a4a83/users/ce260269ed844c78be7997724592a189/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:25:51.054605 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25ef34-5850-4f69-b31b-ef7ae2375d6d None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:51.057835 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25ef34-5850-4f69-b31b-ef7ae2375d6d None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:51.058158 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25ef34-5850-4f69-b31b-ef7ae2375d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:51.118995 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-8a25ef34-5850-4f69-b31b-ef7ae2375d6d None None] MFA Rules not processed for user `ce260269ed844c78be7997724592a189`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:51.120244 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-8a25ef34-5850-4f69-b31b-ef7ae2375d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:51.293177 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1329/2675] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:51 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:51.336367 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1320b-09a0-45b9-a648-b1084fa9eead admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:51.336367 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a5a1320b-09a0-45b9-a648-b1084fa9eead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:51.448062 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1320b-09a0-45b9-a648-b1084fa9eead admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:51.464885 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c2408-6ad2-4cd5-9a7e-5db53ba8c20f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:51.466328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c2408-6ad2-4cd5-9a7e-5db53ba8c20f service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:51.467164 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c2408-6ad2-4cd5-9a7e-5db53ba8c20f service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:51.467345 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c2408-6ad2-4cd5-9a7e-5db53ba8c20f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:51.486098 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c2408-6ad2-4cd5-9a7e-5db53ba8c20f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:51.488950 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c2408-6ad2-4cd5-9a7e-5db53ba8c20f service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:51.508660 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1347/2676] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:51 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:25:51.626194 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25ef34-5850-4f69-b31b-ef7ae2375d6d None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:51.759442 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25ef34-5850-4f69-b31b-ef7ae2375d6d None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:51.764763 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a297bc01-3909-40a1-b7bc-4ce2bd5dba40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:51.765549 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297bc01-3909-40a1-b7bc-4ce2bd5dba40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:51.765830 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297bc01-3909-40a1-b7bc-4ce2bd5dba40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:51.766104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297bc01-3909-40a1-b7bc-4ce2bd5dba40 admin admin] PATH_INFO: `/v3/users/ee0cd41b1caa4eaebd56ab1540403ab3` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:51.767495 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a297bc01-3909-40a1-b7bc-4ce2bd5dba40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee0cd41b1caa4eaebd56ab1540403ab3)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:51.769725 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a297bc01-3909-40a1-b7bc-4ce2bd5dba40 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:51.875331 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:51.880401 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a297bc01-3909-40a1-b7bc-4ce2bd5dba40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee0cd41b1caa4eaebd56ab1540403ab3'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:51.882884 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a297bc01-3909-40a1-b7bc-4ce2bd5dba40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee0cd41b1caa4eaebd56ab1540403ab3'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:51.914190 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a297bc01-3909-40a1-b7bc-4ce2bd5dba40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee0cd41b1caa4eaebd56ab1540403ab3'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:51.921982 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a297bc01-3909-40a1-b7bc-4ce2bd5dba40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee0cd41b1caa4eaebd56ab1540403ab3'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:51.944913 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a297bc01-3909-40a1-b7bc-4ce2bd5dba40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee0cd41b1caa4eaebd56ab1540403ab3'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:51.957314 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1330/2677] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:25:51 2022] DELETE /identity/v3/users/ee0cd41b1caa4eaebd56ab1540403ab3 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:25:51.967773 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bd5ef-3a41-4694-9f84-068ccd286497 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:51.968586 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bd5ef-3a41-4694-9f84-068ccd286497 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:51.969332 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bd5ef-3a41-4694-9f84-068ccd286497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:52.020497 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-135bd5ef-3a41-4694-9f84-068ccd286497 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:52.029558 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-135bd5ef-3a41-4694-9f84-068ccd286497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:52.113701 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:52.169626 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1348/2678] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:52.179085 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a297bc01-3909-40a1-b7bc-4ce2bd5dba40 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:52.181376 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-a297bc01-3909-40a1-b7bc-4ce2bd5dba40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:52.270098 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a297bc01-3909-40a1-b7bc-4ce2bd5dba40 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:52.274677 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035d849-70fa-4bf9-983f-3dbb8e5a5a28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:52.275380 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035d849-70fa-4bf9-983f-3dbb8e5a5a28 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:52.275736 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035d849-70fa-4bf9-983f-3dbb8e5a5a28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:52.276083 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035d849-70fa-4bf9-983f-3dbb8e5a5a28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:52.286552 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c035d849-70fa-4bf9-983f-3dbb8e5a5a28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:52.288323 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c035d849-70fa-4bf9-983f-3dbb8e5a5a28 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:52.298167 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1331/2679] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:25:52.436183 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135bd5ef-3a41-4694-9f84-068ccd286497 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:52.437790 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-135bd5ef-3a41-4694-9f84-068ccd286497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:52.456648 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135bd5ef-3a41-4694-9f84-068ccd286497 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:52.468724 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a149d-9ec1-4997-b344-554cc6084922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:52.469685 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a149d-9ec1-4997-b344-554cc6084922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:52.470119 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a149d-9ec1-4997-b344-554cc6084922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:52.470977 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a149d-9ec1-4997-b344-554cc6084922 admin admin] PATH_INFO: `/v3/users/598db6e730174d9ea7b1d126cf388fda` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:52.473098 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a149d-9ec1-4997-b344-554cc6084922 admin admin] RBAC: Authorizing `identity:delete_user(user_id=598db6e730174d9ea7b1d126cf388fda)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:52.476821 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a149d-9ec1-4997-b344-554cc6084922 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:52.638158 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-638a149d-9ec1-4997-b344-554cc6084922 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '598db6e730174d9ea7b1d126cf388fda'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:52.664632 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-638a149d-9ec1-4997-b344-554cc6084922 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '598db6e730174d9ea7b1d126cf388fda'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:52.684021 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-638a149d-9ec1-4997-b344-554cc6084922 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '598db6e730174d9ea7b1d126cf388fda'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:52.735521 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-638a149d-9ec1-4997-b344-554cc6084922 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '598db6e730174d9ea7b1d126cf388fda'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:52.736742 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-638a149d-9ec1-4997-b344-554cc6084922 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '598db6e730174d9ea7b1d126cf388fda'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:52.751431 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e9bae-0d29-41bf-86cd-20747ee787d4 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:52.754265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e9bae-0d29-41bf-86cd-20747ee787d4 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:52.754352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1349/2680] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:25:52 2022] DELETE /identity/v3/users/598db6e730174d9ea7b1d126cf388fda => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:52.754437 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e9bae-0d29-41bf-86cd-20747ee787d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:52.790703 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-894e9bae-0d29-41bf-86cd-20747ee787d4 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:52.793795 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-894e9bae-0d29-41bf-86cd-20747ee787d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:52.846975 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a149d-9ec1-4997-b344-554cc6084922 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:52.849433 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-638a149d-9ec1-4997-b344-554cc6084922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:52.938297 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1332/2681] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:52.962471 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e9bae-0d29-41bf-86cd-20747ee787d4 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:52.966073 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-894e9bae-0d29-41bf-86cd-20747ee787d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:53.025038 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a149d-9ec1-4997-b344-554cc6084922 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:53.041467 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558262cc-3083-41c1-8a84-8f377fa34fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:53.042298 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558262cc-3083-41c1-8a84-8f377fa34fab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:53.042661 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558262cc-3083-41c1-8a84-8f377fa34fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:53.042997 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558262cc-3083-41c1-8a84-8f377fa34fab admin admin] PATH_INFO: `/v3/projects/67cae450889f452ba1fd91fdb18fcbc7` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:53.044356 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558262cc-3083-41c1-8a84-8f377fa34fab admin admin] RBAC: Authorizing `identity:delete_project(project_id=67cae450889f452ba1fd91fdb18fcbc7)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:53.046373 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558262cc-3083-41c1-8a84-8f377fa34fab admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:53.159012 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e9bae-0d29-41bf-86cd-20747ee787d4 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:53.181442 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-558262cc-3083-41c1-8a84-8f377fa34fab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67cae450889f452ba1fd91fdb18fcbc7', 'request_id': 'req-558262cc-3083-41c1-8a84-8f377fa34fab'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:53.186804 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:53.200357 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-558262cc-3083-41c1-8a84-8f377fa34fab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67cae450889f452ba1fd91fdb18fcbc7', 'request_id': 'req-558262cc-3083-41c1-8a84-8f377fa34fab'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:53.216555 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-558262cc-3083-41c1-8a84-8f377fa34fab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67cae450889f452ba1fd91fdb18fcbc7', 'request_id': 'req-558262cc-3083-41c1-8a84-8f377fa34fab'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:53.234720 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-558262cc-3083-41c1-8a84-8f377fa34fab admin admin] The token cache is being invalidate because project 67cae450889f452ba1fd91fdb18fcbc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:25:53.235268 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-558262cc-3083-41c1-8a84-8f377fa34fab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:53.237041 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-558262cc-3083-41c1-8a84-8f377fa34fab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:53.239662 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1350/2682] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:25:52 2022] DELETE /identity/v3/projects/67cae450889f452ba1fd91fdb18fcbc7 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:25:53.243535 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558262cc-3083-41c1-8a84-8f377fa34fab admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:53.255174 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-558262cc-3083-41c1-8a84-8f377fa34fab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:53.261380 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:53.365628 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2230b29-ca2c-483e-9576-584a05586032 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:53.366564 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2230b29-ca2c-483e-9576-584a05586032 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:53.367026 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2230b29-ca2c-483e-9576-584a05586032 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:53.367538 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2230b29-ca2c-483e-9576-584a05586032 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:53.370589 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-e2230b29-ca2c-483e-9576-584a05586032 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:53.525933 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2230b29-ca2c-483e-9576-584a05586032 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:53.528218 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2230b29-ca2c-483e-9576-584a05586032 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:53.533994 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558262cc-3083-41c1-8a84-8f377fa34fab admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:53.544207 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1333/2683] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:25:53.564999 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31227456-3e34-44e5-bbd9-c3812728e794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:53.569407 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31227456-3e34-44e5-bbd9-c3812728e794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:53.572591 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31227456-3e34-44e5-bbd9-c3812728e794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:53.572591 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31227456-3e34-44e5-bbd9-c3812728e794 admin admin] PATH_INFO: `/v3/users/ce260269ed844c78be7997724592a189` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:53.580240 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31227456-3e34-44e5-bbd9-c3812728e794 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce260269ed844c78be7997724592a189)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:53.582481 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31227456-3e34-44e5-bbd9-c3812728e794 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:53.759365 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-31227456-3e34-44e5-bbd9-c3812728e794 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce260269ed844c78be7997724592a189'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:53.779755 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-31227456-3e34-44e5-bbd9-c3812728e794 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce260269ed844c78be7997724592a189'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:53.803798 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-31227456-3e34-44e5-bbd9-c3812728e794 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce260269ed844c78be7997724592a189'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:53.837646 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-31227456-3e34-44e5-bbd9-c3812728e794 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce260269ed844c78be7997724592a189'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:53.839072 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-31227456-3e34-44e5-bbd9-c3812728e794 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce260269ed844c78be7997724592a189'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:53.858557 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1351/2684] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:25:53 2022] DELETE /identity/v3/users/ce260269ed844c78be7997724592a189 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:54.511519 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2230b29-ca2c-483e-9576-584a05586032 service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:54.512887 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-e2230b29-ca2c-483e-9576-584a05586032 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:54.529737 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2230b29-ca2c-483e-9576-584a05586032 service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:54.611702 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31227456-3e34-44e5-bbd9-c3812728e794 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:54.613322 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-31227456-3e34-44e5-bbd9-c3812728e794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:54.654011 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51025697-f9dc-4253-a1bf-17390a0cc368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:54.655515 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51025697-f9dc-4253-a1bf-17390a0cc368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:54.655920 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51025697-f9dc-4253-a1bf-17390a0cc368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:54.656205 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51025697-f9dc-4253-a1bf-17390a0cc368 admin admin] PATH_INFO: `/v3/projects/951c7d08bd44465a8c98505dad30d2bf` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:54.657588 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51025697-f9dc-4253-a1bf-17390a0cc368 admin admin] RBAC: Authorizing `identity:delete_project(project_id=951c7d08bd44465a8c98505dad30d2bf)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:54.660339 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51025697-f9dc-4253-a1bf-17390a0cc368 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:54.752303 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-51025697-f9dc-4253-a1bf-17390a0cc368 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '951c7d08bd44465a8c98505dad30d2bf', 'request_id': 'req-51025697-f9dc-4253-a1bf-17390a0cc368'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:54.763345 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-51025697-f9dc-4253-a1bf-17390a0cc368 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '951c7d08bd44465a8c98505dad30d2bf', 'request_id': 'req-51025697-f9dc-4253-a1bf-17390a0cc368'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:54.780820 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-51025697-f9dc-4253-a1bf-17390a0cc368 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '951c7d08bd44465a8c98505dad30d2bf', 'request_id': 'req-51025697-f9dc-4253-a1bf-17390a0cc368'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:54.794573 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:54.799259 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-51025697-f9dc-4253-a1bf-17390a0cc368 admin admin] The token cache is being invalidate because project 951c7d08bd44465a8c98505dad30d2bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:25:54.800463 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-51025697-f9dc-4253-a1bf-17390a0cc368 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:54.802802 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-51025697-f9dc-4253-a1bf-17390a0cc368 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:54.804910 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1334/2685] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:25:54 2022] DELETE /identity/v3/projects/951c7d08bd44465a8c98505dad30d2bf => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:54.805816 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51025697-f9dc-4253-a1bf-17390a0cc368 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:54.808768 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-51025697-f9dc-4253-a1bf-17390a0cc368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:54.900605 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31227456-3e34-44e5-bbd9-c3812728e794 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:54.909583 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51025697-f9dc-4253-a1bf-17390a0cc368 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:54.918302 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d005e-c7c5-4a03-9742-a90355cd3e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:54.920505 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d005e-c7c5-4a03-9742-a90355cd3e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:54.920910 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c584c-a086-4e52-9a35-ff997c5dd286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:54.921304 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d005e-c7c5-4a03-9742-a90355cd3e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:54.921547 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c584c-a086-4e52-9a35-ff997c5dd286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:54.921819 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c584c-a086-4e52-9a35-ff997c5dd286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:54.922091 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c584c-a086-4e52-9a35-ff997c5dd286 admin admin] PATH_INFO: `/v3/users/abed66138e4d482a985e2f6754a7a573` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:54.922917 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d005e-c7c5-4a03-9742-a90355cd3e29 admin admin] PATH_INFO: `/v3/projects/bc18a4a78148414899471344207a4a83` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:54.923271 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6c584c-a086-4e52-9a35-ff997c5dd286 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abed66138e4d482a985e2f6754a7a573)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:54.925343 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6c584c-a086-4e52-9a35-ff997c5dd286 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:54.927759 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d005e-c7c5-4a03-9742-a90355cd3e29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc18a4a78148414899471344207a4a83)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:54.931371 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d005e-c7c5-4a03-9742-a90355cd3e29 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:54.934796 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:55.013490 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-bb6c584c-a086-4e52-9a35-ff997c5dd286 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abed66138e4d482a985e2f6754a7a573'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:55.014450 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-bb6c584c-a086-4e52-9a35-ff997c5dd286 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abed66138e4d482a985e2f6754a7a573'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:55.037106 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-bb6c584c-a086-4e52-9a35-ff997c5dd286 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abed66138e4d482a985e2f6754a7a573'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:55.040736 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ef3d005e-c7c5-4a03-9742-a90355cd3e29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc18a4a78148414899471344207a4a83', 'request_id': 'req-ef3d005e-c7c5-4a03-9742-a90355cd3e29'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:55.049533 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-bb6c584c-a086-4e52-9a35-ff997c5dd286 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abed66138e4d482a985e2f6754a7a573'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:55.055008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ef3d005e-c7c5-4a03-9742-a90355cd3e29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc18a4a78148414899471344207a4a83', 'request_id': 'req-ef3d005e-c7c5-4a03-9742-a90355cd3e29'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:55.059922 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-bb6c584c-a086-4e52-9a35-ff997c5dd286 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abed66138e4d482a985e2f6754a7a573'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:55.063077 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ef3d005e-c7c5-4a03-9742-a90355cd3e29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc18a4a78148414899471344207a4a83', 'request_id': 'req-ef3d005e-c7c5-4a03-9742-a90355cd3e29'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:55.069882 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1335/2686] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:25:54 2022] DELETE /identity/v3/users/abed66138e4d482a985e2f6754a7a573 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:55.071382 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c584c-a086-4e52-9a35-ff997c5dd286 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:55.073382 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-bb6c584c-a086-4e52-9a35-ff997c5dd286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:55.107715 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ef3d005e-c7c5-4a03-9742-a90355cd3e29 admin admin] The token cache is being invalidate because project bc18a4a78148414899471344207a4a83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:25:55.109386 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ef3d005e-c7c5-4a03-9742-a90355cd3e29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:55.113771 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ef3d005e-c7c5-4a03-9742-a90355cd3e29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:55.117035 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1352/2687] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:25:54 2022] DELETE /identity/v3/projects/bc18a4a78148414899471344207a4a83 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:55.121813 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6112fd-3572-4fd0-aec4-f0b032c9cfff None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:55.122329 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6112fd-3572-4fd0-aec4-f0b032c9cfff None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:55.122934 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6112fd-3572-4fd0-aec4-f0b032c9cfff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:55.170806 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-6a6112fd-3572-4fd0-aec4-f0b032c9cfff None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:55.172450 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6a6112fd-3572-4fd0-aec4-f0b032c9cfff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:55.183850 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1353/2688] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:25:55.184752 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c584c-a086-4e52-9a35-ff997c5dd286 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:55.189748 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062e1cf-4952-480f-88de-6805c86669a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:55.190414 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062e1cf-4952-480f-88de-6805c86669a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:55.190715 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062e1cf-4952-480f-88de-6805c86669a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:55.190992 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062e1cf-4952-480f-88de-6805c86669a6 admin admin] PATH_INFO: `/v3/users/3610490873ea4ea385f15e343e248e92` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:55.192333 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a062e1cf-4952-480f-88de-6805c86669a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3610490873ea4ea385f15e343e248e92)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:55.196001 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01b2b3-f825-4185-9cc5-0cc7a0a58679 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:55.196001 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01b2b3-f825-4185-9cc5-0cc7a0a58679 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:55.196001 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01b2b3-f825-4185-9cc5-0cc7a0a58679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:55.196351 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a062e1cf-4952-480f-88de-6805c86669a6 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:55.222855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:55.267277 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-4f01b2b3-f825-4185-9cc5-0cc7a0a58679 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:55.277630 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4f01b2b3-f825-4185-9cc5-0cc7a0a58679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:55.310977 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1354/2689] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:55.312187 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a062e1cf-4952-480f-88de-6805c86669a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3610490873ea4ea385f15e343e248e92'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:55.312331 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f01b2b3-f825-4185-9cc5-0cc7a0a58679 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:55.315068 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a062e1cf-4952-480f-88de-6805c86669a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3610490873ea4ea385f15e343e248e92'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:55.337396 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f01b2b3-f825-4185-9cc5-0cc7a0a58679 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:55.347128 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a062e1cf-4952-480f-88de-6805c86669a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3610490873ea4ea385f15e343e248e92'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:55.351723 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142adef-65bd-42b6-a34c-ca3345efb47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:55.352714 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142adef-65bd-42b6-a34c-ca3345efb47d admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:55.353006 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142adef-65bd-42b6-a34c-ca3345efb47d admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:55.353275 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142adef-65bd-42b6-a34c-ca3345efb47d admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:55.354263 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142adef-65bd-42b6-a34c-ca3345efb47d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:25:55.354498 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142adef-65bd-42b6-a34c-ca3345efb47d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:55.357822 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142adef-65bd-42b6-a34c-ca3345efb47d admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:55.379839 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a062e1cf-4952-480f-88de-6805c86669a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3610490873ea4ea385f15e343e248e92'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:55.388885 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1355/2690] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:25:55.390030 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142adef-65bd-42b6-a34c-ca3345efb47d admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:55.401432 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a062e1cf-4952-480f-88de-6805c86669a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3610490873ea4ea385f15e343e248e92'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:55.411521 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1336/2691] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:25:55 2022] DELETE /identity/v3/users/3610490873ea4ea385f15e343e248e92 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:55.412830 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142adef-65bd-42b6-a34c-ca3345efb47d admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:55.490307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062e1cf-4952-480f-88de-6805c86669a6 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:55.492763 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-a062e1cf-4952-480f-88de-6805c86669a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:55.554851 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee740f37-0dbe-46e4-ab2f-70bb5dd4252e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:55.555772 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee740f37-0dbe-46e4-ab2f-70bb5dd4252e admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:55.556202 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee740f37-0dbe-46e4-ab2f-70bb5dd4252e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:55.556622 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee740f37-0dbe-46e4-ab2f-70bb5dd4252e admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:55.557409 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee740f37-0dbe-46e4-ab2f-70bb5dd4252e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:55.559620 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee740f37-0dbe-46e4-ab2f-70bb5dd4252e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:55.585325 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062e1cf-4952-480f-88de-6805c86669a6 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:55.591759 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c7417-4803-44e6-b3f1-96e2d853e021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:55.592617 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c7417-4803-44e6-b3f1-96e2d853e021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:55.592952 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c7417-4803-44e6-b3f1-96e2d853e021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:55.593231 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c7417-4803-44e6-b3f1-96e2d853e021 admin admin] PATH_INFO: `/v3/projects/1fa484f252b744e08c35cb5328b14ffe` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:55.594565 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c7417-4803-44e6-b3f1-96e2d853e021 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fa484f252b744e08c35cb5328b14ffe)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:55.596735 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c7417-4803-44e6-b3f1-96e2d853e021 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:55.599783 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1356/2692] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:25:55 2022] POST /identity/v3/projects => generated 385 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:25:55.604026 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee740f37-0dbe-46e4-ab2f-70bb5dd4252e admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:55.605857 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ee740f37-0dbe-46e4-ab2f-70bb5dd4252e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:55.683377 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-b13c7417-4803-44e6-b3f1-96e2d853e021 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fa484f252b744e08c35cb5328b14ffe', 'request_id': 'req-b13c7417-4803-44e6-b3f1-96e2d853e021'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:55.686353 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:55.698278 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-b13c7417-4803-44e6-b3f1-96e2d853e021 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fa484f252b744e08c35cb5328b14ffe', 'request_id': 'req-b13c7417-4803-44e6-b3f1-96e2d853e021'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:55.713904 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-b13c7417-4803-44e6-b3f1-96e2d853e021 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fa484f252b744e08c35cb5328b14ffe', 'request_id': 'req-b13c7417-4803-44e6-b3f1-96e2d853e021'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:55.723053 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee740f37-0dbe-46e4-ab2f-70bb5dd4252e admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:55.745035 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-b13c7417-4803-44e6-b3f1-96e2d853e021 admin admin] The token cache is being invalidate because project 1fa484f252b744e08c35cb5328b14ffe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:25:55.745035 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-b13c7417-4803-44e6-b3f1-96e2d853e021 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:55.745226 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-b13c7417-4803-44e6-b3f1-96e2d853e021 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:55.752034 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1337/2693] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:25:55 2022] DELETE /identity/v3/projects/1fa484f252b744e08c35cb5328b14ffe => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:55.752965 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c7417-4803-44e6-b3f1-96e2d853e021 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:55.757135 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-b13c7417-4803-44e6-b3f1-96e2d853e021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:55.814554 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:55.839113 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77f978-69dd-4156-b90d-9db8a853571b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:55.839784 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77f978-69dd-4156-b90d-9db8a853571b admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:55.840089 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77f978-69dd-4156-b90d-9db8a853571b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:55.840266 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77f978-69dd-4156-b90d-9db8a853571b admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:55.840901 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c77f978-69dd-4156-b90d-9db8a853571b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:55.843008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c77f978-69dd-4156-b90d-9db8a853571b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:55.867494 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c7417-4803-44e6-b3f1-96e2d853e021 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:55.873287 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af545e7-414b-4d3f-a4e9-2b676bb8d777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:55.874116 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af545e7-414b-4d3f-a4e9-2b676bb8d777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:55.874408 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af545e7-414b-4d3f-a4e9-2b676bb8d777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:55.874735 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af545e7-414b-4d3f-a4e9-2b676bb8d777 admin admin] PATH_INFO: `/v3/users/37af2ca3d04d4662b0eeb73b90c662fb` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:55.875986 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af545e7-414b-4d3f-a4e9-2b676bb8d777 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37af2ca3d04d4662b0eeb73b90c662fb)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:55.878344 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af545e7-414b-4d3f-a4e9-2b676bb8d777 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:55.881580 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1357/2694] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:25:55 2022] POST /identity/v3/users => generated 293 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:25:55.885544 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77f978-69dd-4156-b90d-9db8a853571b admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:55.887463 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5c77f978-69dd-4156-b90d-9db8a853571b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:55.903719 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77f978-69dd-4156-b90d-9db8a853571b admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:55.913400 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633bd6c-14a2-492f-a03d-32ab2d9fa10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:55.914194 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633bd6c-14a2-492f-a03d-32ab2d9fa10c admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:55.914629 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633bd6c-14a2-492f-a03d-32ab2d9fa10c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:55.915007 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633bd6c-14a2-492f-a03d-32ab2d9fa10c admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:55.915792 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633bd6c-14a2-492f-a03d-32ab2d9fa10c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:55.917603 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633bd6c-14a2-492f-a03d-32ab2d9fa10c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:55.938626 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1358/2695] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:25:55.938626 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633bd6c-14a2-492f-a03d-32ab2d9fa10c admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:55.953698 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633bd6c-14a2-492f-a03d-32ab2d9fa10c admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:55.982627 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348f2ee-b1ab-495d-b223-1af8aef1c684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:55.982627 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348f2ee-b1ab-495d-b223-1af8aef1c684 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:55.982627 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348f2ee-b1ab-495d-b223-1af8aef1c684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:55.982627 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348f2ee-b1ab-495d-b223-1af8aef1c684 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:55.983142 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348f2ee-b1ab-495d-b223-1af8aef1c684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:55.983142 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348f2ee-b1ab-495d-b223-1af8aef1c684 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:55.987635 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3af545e7-414b-4d3f-a4e9-2b676bb8d777 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37af2ca3d04d4662b0eeb73b90c662fb'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:55.988347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3af545e7-414b-4d3f-a4e9-2b676bb8d777 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37af2ca3d04d4662b0eeb73b90c662fb'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:56.004472 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1359/2696] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:25:56.004472 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348f2ee-b1ab-495d-b223-1af8aef1c684 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:56.006212 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3348f2ee-b1ab-495d-b223-1af8aef1c684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:56.022384 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348f2ee-b1ab-495d-b223-1af8aef1c684 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:56.027112 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad13f98-4e70-4eb8-a417-d3637fa4be3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:56.027926 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad13f98-4e70-4eb8-a417-d3637fa4be3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:56.028414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad13f98-4e70-4eb8-a417-d3637fa4be3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:56.028861 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad13f98-4e70-4eb8-a417-d3637fa4be3d admin admin] PATH_INFO: `/v3/projects/8058c3a0f2b54bf9842cc1f2c07b647f` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:56.031281 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3af545e7-414b-4d3f-a4e9-2b676bb8d777 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37af2ca3d04d4662b0eeb73b90c662fb'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:56.036047 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad13f98-4e70-4eb8-a417-d3637fa4be3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8058c3a0f2b54bf9842cc1f2c07b647f)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:56.040073 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad13f98-4e70-4eb8-a417-d3637fa4be3d admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:56.043795 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3af545e7-414b-4d3f-a4e9-2b676bb8d777 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37af2ca3d04d4662b0eeb73b90c662fb'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:56.056424 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3af545e7-414b-4d3f-a4e9-2b676bb8d777 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37af2ca3d04d4662b0eeb73b90c662fb'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:56.065922 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1338/2697] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:25:55 2022] DELETE /identity/v3/users/37af2ca3d04d4662b0eeb73b90c662fb => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:56.066815 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af545e7-414b-4d3f-a4e9-2b676bb8d777 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:56.068419 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-3af545e7-414b-4d3f-a4e9-2b676bb8d777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:56.141096 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7ad13f98-4e70-4eb8-a417-d3637fa4be3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8058c3a0f2b54bf9842cc1f2c07b647f', 'request_id': 'req-7ad13f98-4e70-4eb8-a417-d3637fa4be3d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:56.147349 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7ad13f98-4e70-4eb8-a417-d3637fa4be3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8058c3a0f2b54bf9842cc1f2c07b647f', 'request_id': 'req-7ad13f98-4e70-4eb8-a417-d3637fa4be3d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:56.154782 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7ad13f98-4e70-4eb8-a417-d3637fa4be3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8058c3a0f2b54bf9842cc1f2c07b647f', 'request_id': 'req-7ad13f98-4e70-4eb8-a417-d3637fa4be3d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:56.171785 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7ad13f98-4e70-4eb8-a417-d3637fa4be3d admin admin] The token cache is being invalidate because project 8058c3a0f2b54bf9842cc1f2c07b647f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:25:56.172072 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7ad13f98-4e70-4eb8-a417-d3637fa4be3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:56.172818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7ad13f98-4e70-4eb8-a417-d3637fa4be3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:56.176507 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1360/2698] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:25:56 2022] DELETE /identity/v3/projects/8058c3a0f2b54bf9842cc1f2c07b647f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:56.182297 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8eba2-66b7-4b0e-a4eb-0d541395ae30 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:56.182712 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8eba2-66b7-4b0e-a4eb-0d541395ae30 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:56.182904 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8eba2-66b7-4b0e-a4eb-0d541395ae30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:56.192227 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af545e7-414b-4d3f-a4e9-2b676bb8d777 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:56.210752 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-88d8eba2-66b7-4b0e-a4eb-0d541395ae30 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:56.212071 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-88d8eba2-66b7-4b0e-a4eb-0d541395ae30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:56.267413 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:56.267620 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:56.280759 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cad845-ee16-4ccd-8bc9-c6fc216e9bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:56.282104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cad845-ee16-4ccd-8bc9-c6fc216e9bef admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:56.283203 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cad845-ee16-4ccd-8bc9-c6fc216e9bef admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:56.283884 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cad845-ee16-4ccd-8bc9-c6fc216e9bef admin admin] PATH_INFO: `/v3/projects/64518b67f5494e14ad9a1ebb867964df/users/8bbf6788d3b14ef9800dd86136b6e366/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:56.305720 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1361/2699] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:25:56.307334 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5cbe12-c235-4f02-ae35-2195c7d86d1d None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:56.307623 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5cbe12-c235-4f02-ae35-2195c7d86d1d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:56.308140 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5cbe12-c235-4f02-ae35-2195c7d86d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:56.309619 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cad845-ee16-4ccd-8bc9-c6fc216e9bef admin admin] RBAC: Authorizing `identity:create_grant(project_id=64518b67f5494e14ad9a1ebb867964df, user_id=8bbf6788d3b14ef9800dd86136b6e366, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:56.319949 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cad845-ee16-4ccd-8bc9-c6fc216e9bef admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:56.334045 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-2e5cbe12-c235-4f02-ae35-2195c7d86d1d None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:56.338305 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2e5cbe12-c235-4f02-ae35-2195c7d86d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:56.348868 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1339/2700] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:25:56 2022] PUT /identity/v3/projects/64518b67f5494e14ad9a1ebb867964df/users/8bbf6788d3b14ef9800dd86136b6e366/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:56.350543 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cad845-ee16-4ccd-8bc9-c6fc216e9bef admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:56.352349 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-15cad845-ee16-4ccd-8bc9-c6fc216e9bef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:56.437188 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1362/2701] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:56.437188 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d068f3-1760-4189-9888-765d32855118 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:56.437188 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d068f3-1760-4189-9888-765d32855118 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:56.437188 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d068f3-1760-4189-9888-765d32855118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:56.443445 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cad845-ee16-4ccd-8bc9-c6fc216e9bef admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:56.449137 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71441d3c-a072-4597-bf5f-52f866f57206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:56.449960 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71441d3c-a072-4597-bf5f-52f866f57206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:56.450402 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71441d3c-a072-4597-bf5f-52f866f57206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:56.450890 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71441d3c-a072-4597-bf5f-52f866f57206 admin admin] PATH_INFO: `/v3/projects/f39e1bd9e83e47fe8d52d2c3299c1ab6` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:56.453256 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71441d3c-a072-4597-bf5f-52f866f57206 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f39e1bd9e83e47fe8d52d2c3299c1ab6)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:56.456891 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71441d3c-a072-4597-bf5f-52f866f57206 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:56.496171 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-39d068f3-1760-4189-9888-765d32855118 None None] MFA Rules not processed for user `8bbf6788d3b14ef9800dd86136b6e366`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:56.497936 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-39d068f3-1760-4189-9888-765d32855118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:56.540092 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-71441d3c-a072-4597-bf5f-52f866f57206 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f39e1bd9e83e47fe8d52d2c3299c1ab6', 'request_id': 'req-71441d3c-a072-4597-bf5f-52f866f57206'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:56.557865 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-71441d3c-a072-4597-bf5f-52f866f57206 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f39e1bd9e83e47fe8d52d2c3299c1ab6', 'request_id': 'req-71441d3c-a072-4597-bf5f-52f866f57206'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:56.576934 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-71441d3c-a072-4597-bf5f-52f866f57206 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f39e1bd9e83e47fe8d52d2c3299c1ab6', 'request_id': 'req-71441d3c-a072-4597-bf5f-52f866f57206'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:56.603750 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-71441d3c-a072-4597-bf5f-52f866f57206 admin admin] The token cache is being invalidate because project f39e1bd9e83e47fe8d52d2c3299c1ab6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:25:56.604435 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-71441d3c-a072-4597-bf5f-52f866f57206 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:56.605007 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-71441d3c-a072-4597-bf5f-52f866f57206 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:56.607715 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1340/2702] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:25:56 2022] DELETE /identity/v3/projects/f39e1bd9e83e47fe8d52d2c3299c1ab6 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:56.608672 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71441d3c-a072-4597-bf5f-52f866f57206 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:56.613870 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-71441d3c-a072-4597-bf5f-52f866f57206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:56.623255 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1363/2703] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:56.635625 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d068f3-1760-4189-9888-765d32855118 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:56.637628 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-39d068f3-1760-4189-9888-765d32855118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:56.769670 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71441d3c-a072-4597-bf5f-52f866f57206 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:56.778378 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb812fe-5ec0-405d-9815-9ad8bb733c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:56.779936 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb812fe-5ec0-405d-9815-9ad8bb733c99 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:56.780467 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb812fe-5ec0-405d-9815-9ad8bb733c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:56.781330 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb812fe-5ec0-405d-9815-9ad8bb733c99 admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:56.782638 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb812fe-5ec0-405d-9815-9ad8bb733c99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:25:56.783237 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb812fe-5ec0-405d-9815-9ad8bb733c99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:56.785920 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb812fe-5ec0-405d-9815-9ad8bb733c99 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:56.804609 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1341/2704] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:25:56.812643 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb812fe-5ec0-405d-9815-9ad8bb733c99 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:56.819088 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:56.828783 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb812fe-5ec0-405d-9815-9ad8bb733c99 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:56.834871 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d068f3-1760-4189-9888-765d32855118 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:56.846520 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c991e63-61ac-42fd-a901-d06775084ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:56.846520 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c991e63-61ac-42fd-a901-d06775084ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:56.846520 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c991e63-61ac-42fd-a901-d06775084ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:56.846520 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c991e63-61ac-42fd-a901-d06775084ff5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:56.846972 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c991e63-61ac-42fd-a901-d06775084ff5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:56.847233 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c991e63-61ac-42fd-a901-d06775084ff5 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:56.901237 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:56.914878 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1342/2705] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:25:56 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:25:56.922953 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c991e63-61ac-42fd-a901-d06775084ff5 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:56.933558 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ca8c2-2402-4d45-ba3e-07d9b43c73a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:56.934634 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ca8c2-2402-4d45-ba3e-07d9b43c73a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:56.934634 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ca8c2-2402-4d45-ba3e-07d9b43c73a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:56.934903 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ca8c2-2402-4d45-ba3e-07d9b43c73a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:56.936950 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-865ca8c2-2402-4d45-ba3e-07d9b43c73a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:57.001477 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c991e63-61ac-42fd-a901-d06775084ff5 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:57.013444 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d961caf-6963-4cf2-9385-c5239f742cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:57.014590 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d961caf-6963-4cf2-9385-c5239f742cb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:57.015110 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ca8c2-2402-4d45-ba3e-07d9b43c73a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:57.015461 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d961caf-6963-4cf2-9385-c5239f742cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:57.016410 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d961caf-6963-4cf2-9385-c5239f742cb0 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:57.016768 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ca8c2-2402-4d45-ba3e-07d9b43c73a9 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:57.017305 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d961caf-6963-4cf2-9385-c5239f742cb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:57.019331 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d961caf-6963-4cf2-9385-c5239f742cb0 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:57.026272 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1364/2706] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:56 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:25:57.048481 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ca8c2-2402-4d45-ba3e-07d9b43c73a9 service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:57.049980 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-865ca8c2-2402-4d45-ba3e-07d9b43c73a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:57.059315 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1343/2707] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:25:56 2022] POST /identity/v3/users => generated 288 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:25:57.060439 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d961caf-6963-4cf2-9385-c5239f742cb0 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:57.065417 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ca8c2-2402-4d45-ba3e-07d9b43c73a9 service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:57.072438 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d961caf-6963-4cf2-9385-c5239f742cb0 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:57.072947 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9861d57-907c-44d9-b954-fd32d9f50a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:57.073699 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9861d57-907c-44d9-b954-fd32d9f50a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:57.074086 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9861d57-907c-44d9-b954-fd32d9f50a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:57.074594 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9861d57-907c-44d9-b954-fd32d9f50a40 admin admin] PATH_INFO: `/v3/users/8bbf6788d3b14ef9800dd86136b6e366` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:57.075952 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9861d57-907c-44d9-b954-fd32d9f50a40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bbf6788d3b14ef9800dd86136b6e366)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:57.077520 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a93d62-2023-48a2-929e-419358daf0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:57.078062 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a93d62-2023-48a2-929e-419358daf0a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:57.078197 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9861d57-907c-44d9-b954-fd32d9f50a40 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:57.078336 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a93d62-2023-48a2-929e-419358daf0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:57.078649 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a93d62-2023-48a2-929e-419358daf0a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:57.079315 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a93d62-2023-48a2-929e-419358daf0a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:57.080996 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a93d62-2023-48a2-929e-419358daf0a8 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:57.094448 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1344/2708] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:25:57.098422 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a93d62-2023-48a2-929e-419358daf0a8 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:57.114435 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a93d62-2023-48a2-929e-419358daf0a8 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:57.121663 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb29fd-4196-4cbe-b6b4-497972d0de0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:57.122555 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb29fd-4196-4cbe-b6b4-497972d0de0f admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:57.122992 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb29fd-4196-4cbe-b6b4-497972d0de0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:57.123419 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb29fd-4196-4cbe-b6b4-497972d0de0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:57.124211 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb29fd-4196-4cbe-b6b4-497972d0de0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:57.126287 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb29fd-4196-4cbe-b6b4-497972d0de0f admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:57.144383 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1345/2709] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:25:57.145718 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb29fd-4196-4cbe-b6b4-497972d0de0f admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:57.155312 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e9861d57-907c-44d9-b954-fd32d9f50a40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bbf6788d3b14ef9800dd86136b6e366'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:57.158437 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb29fd-4196-4cbe-b6b4-497972d0de0f admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:57.169374 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2ea4a-ccd7-4bf7-8bc0-fa65cb1a5a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:57.169374 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2ea4a-ccd7-4bf7-8bc0-fa65cb1a5a4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:57.169374 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2ea4a-ccd7-4bf7-8bc0-fa65cb1a5a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:57.169374 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2ea4a-ccd7-4bf7-8bc0-fa65cb1a5a4a admin admin] PATH_INFO: `/v3/projects/d43909c44c674c24931c78303ff150fa/users/df4b1f90b62949259c077469c810cebb/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:57.171997 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e9861d57-907c-44d9-b954-fd32d9f50a40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bbf6788d3b14ef9800dd86136b6e366'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:57.183518 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e9861d57-907c-44d9-b954-fd32d9f50a40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bbf6788d3b14ef9800dd86136b6e366'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:57.185422 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d2ea4a-ccd7-4bf7-8bc0-fa65cb1a5a4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d43909c44c674c24931c78303ff150fa, user_id=df4b1f90b62949259c077469c810cebb, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:57.188383 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d2ea4a-ccd7-4bf7-8bc0-fa65cb1a5a4a admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:57.200693 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e9861d57-907c-44d9-b954-fd32d9f50a40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bbf6788d3b14ef9800dd86136b6e366'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:57.204761 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e9861d57-907c-44d9-b954-fd32d9f50a40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bbf6788d3b14ef9800dd86136b6e366'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:57.211012 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1365/2710] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:25:57 2022] DELETE /identity/v3/users/8bbf6788d3b14ef9800dd86136b6e366 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:57.211645 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1346/2711] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:25:57 2022] PUT /identity/v3/projects/d43909c44c674c24931c78303ff150fa/users/df4b1f90b62949259c077469c810cebb/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:57.215749 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbdb2e-33d6-48d1-a25b-6410abd73179 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:57.216042 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbdb2e-33d6-48d1-a25b-6410abd73179 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:57.216454 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbdb2e-33d6-48d1-a25b-6410abd73179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:57.225327 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d665821-8b51-4bb5-82e6-2b583e219115 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:57.225631 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d665821-8b51-4bb5-82e6-2b583e219115 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:57.225897 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d665821-8b51-4bb5-82e6-2b583e219115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:57.243537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-1ffbdb2e-33d6-48d1-a25b-6410abd73179 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:57.244732 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1ffbdb2e-33d6-48d1-a25b-6410abd73179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:57.259717 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-5d665821-8b51-4bb5-82e6-2b583e219115 None None] MFA Rules not processed for user `df4b1f90b62949259c077469c810cebb`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:57.260942 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-5d665821-8b51-4bb5-82e6-2b583e219115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:57.304569 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:57.317498 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1366/2712] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:57.327102 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffbdb2e-33d6-48d1-a25b-6410abd73179 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:57.328775 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1ffbdb2e-33d6-48d1-a25b-6410abd73179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:57.345881 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1347/2713] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:57.358364 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d665821-8b51-4bb5-82e6-2b583e219115 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:57.359844 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-5d665821-8b51-4bb5-82e6-2b583e219115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:57.377481 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:57.395062 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffbdb2e-33d6-48d1-a25b-6410abd73179 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:57.398910 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3648b4d-3fbf-4a62-a8e3-04a81820b4d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:57.399520 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3648b4d-3fbf-4a62-a8e3-04a81820b4d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:57.399801 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3648b4d-3fbf-4a62-a8e3-04a81820b4d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:57.400460 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3648b4d-3fbf-4a62-a8e3-04a81820b4d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:57.410238 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3648b4d-3fbf-4a62-a8e3-04a81820b4d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:57.411784 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3648b4d-3fbf-4a62-a8e3-04a81820b4d8 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:57.421831 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1367/2714] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:25:57.423122 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d665821-8b51-4bb5-82e6-2b583e219115 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:57.426850 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538322ae-0705-4cc0-9609-03a8cf37c1b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:57.427465 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538322ae-0705-4cc0-9609-03a8cf37c1b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:57.427743 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538322ae-0705-4cc0-9609-03a8cf37c1b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:57.428083 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538322ae-0705-4cc0-9609-03a8cf37c1b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:57.437160 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538322ae-0705-4cc0-9609-03a8cf37c1b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:57.438629 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538322ae-0705-4cc0-9609-03a8cf37c1b1 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:57.447423 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1348/2715] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:25:57.737195 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3648b4d-3fbf-4a62-a8e3-04a81820b4d8 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:57.740166 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a3648b4d-3fbf-4a62-a8e3-04a81820b4d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:57.764116 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3648b4d-3fbf-4a62-a8e3-04a81820b4d8 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:57.769588 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b4f6e-ddfe-4168-a121-02e7ba63ee7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:57.770644 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b4f6e-ddfe-4168-a121-02e7ba63ee7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:57.770735 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b4f6e-ddfe-4168-a121-02e7ba63ee7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:57.771013 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b4f6e-ddfe-4168-a121-02e7ba63ee7d admin admin] PATH_INFO: `/v3/projects/64518b67f5494e14ad9a1ebb867964df` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:57.772955 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b4f6e-ddfe-4168-a121-02e7ba63ee7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=64518b67f5494e14ad9a1ebb867964df)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:57.775122 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b4f6e-ddfe-4168-a121-02e7ba63ee7d admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:57.828180 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0f9b4f6e-ddfe-4168-a121-02e7ba63ee7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64518b67f5494e14ad9a1ebb867964df', 'request_id': 'req-0f9b4f6e-ddfe-4168-a121-02e7ba63ee7d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:57.834757 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0f9b4f6e-ddfe-4168-a121-02e7ba63ee7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64518b67f5494e14ad9a1ebb867964df', 'request_id': 'req-0f9b4f6e-ddfe-4168-a121-02e7ba63ee7d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:57.841765 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0f9b4f6e-ddfe-4168-a121-02e7ba63ee7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64518b67f5494e14ad9a1ebb867964df', 'request_id': 'req-0f9b4f6e-ddfe-4168-a121-02e7ba63ee7d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:57.856830 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0f9b4f6e-ddfe-4168-a121-02e7ba63ee7d admin admin] The token cache is being invalidate because project 64518b67f5494e14ad9a1ebb867964df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:25:57.857114 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0f9b4f6e-ddfe-4168-a121-02e7ba63ee7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:57.857844 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0f9b4f6e-ddfe-4168-a121-02e7ba63ee7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:57.859363 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1368/2716] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:25:57 2022] DELETE /identity/v3/projects/64518b67f5494e14ad9a1ebb867964df => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:57.864252 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651b5ea-3ce0-4a80-be4d-ff2824151b57 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:57.864869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651b5ea-3ce0-4a80-be4d-ff2824151b57 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:57.864957 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651b5ea-3ce0-4a80-be4d-ff2824151b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:57.889020 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-4651b5ea-3ce0-4a80-be4d-ff2824151b57 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:57.890316 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-4651b5ea-3ce0-4a80-be4d-ff2824151b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:57.951661 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1349/2717] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:25:57.964356 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfce17-2763-42ba-9b05-ddb92ece4999 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:57.964817 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfce17-2763-42ba-9b05-ddb92ece4999 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:57.965195 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfce17-2763-42ba-9b05-ddb92ece4999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:57.987401 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-0bdfce17-2763-42ba-9b05-ddb92ece4999 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:57.988606 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0bdfce17-2763-42ba-9b05-ddb92ece4999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:57.997330 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1369/2718] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:58.001734 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651b5ea-3ce0-4a80-be4d-ff2824151b57 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:58.013416 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651b5ea-3ce0-4a80-be4d-ff2824151b57 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:58.019222 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049831f3-ad2d-4eaa-b7c4-def81cf8b8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:58.019962 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049831f3-ad2d-4eaa-b7c4-def81cf8b8f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:58.020340 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049831f3-ad2d-4eaa-b7c4-def81cf8b8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:58.020610 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049831f3-ad2d-4eaa-b7c4-def81cf8b8f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:58.021335 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049831f3-ad2d-4eaa-b7c4-def81cf8b8f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:25:58.022185 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049831f3-ad2d-4eaa-b7c4-def81cf8b8f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:58.023825 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049831f3-ad2d-4eaa-b7c4-def81cf8b8f4 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:58.047908 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1350/2719] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:25:58.052443 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfce17-2763-42ba-9b05-ddb92ece4999 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:58.062780 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfce17-2763-42ba-9b05-ddb92ece4999 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:58.069853 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7606f33-c087-4905-93fe-c81bfafcf1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:58.070626 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7606f33-c087-4905-93fe-c81bfafcf1da admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:58.070906 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7606f33-c087-4905-93fe-c81bfafcf1da admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:58.071176 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7606f33-c087-4905-93fe-c81bfafcf1da admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:58.071813 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7606f33-c087-4905-93fe-c81bfafcf1da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:58.073798 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7606f33-c087-4905-93fe-c81bfafcf1da admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:58.103357 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1370/2720] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:25:58 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:25:58.107440 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049831f3-ad2d-4eaa-b7c4-def81cf8b8f4 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:58.117474 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049831f3-ad2d-4eaa-b7c4-def81cf8b8f4 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:58.176262 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed97be-5b5c-4fa1-a0d9-90b5b86debee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:58.177042 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed97be-5b5c-4fa1-a0d9-90b5b86debee admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:58.177429 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed97be-5b5c-4fa1-a0d9-90b5b86debee admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:58.177834 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed97be-5b5c-4fa1-a0d9-90b5b86debee admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:58.178622 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed97be-5b5c-4fa1-a0d9-90b5b86debee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:58.180648 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed97be-5b5c-4fa1-a0d9-90b5b86debee admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:58.203903 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1351/2721] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:25:58 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:25:58.207949 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7606f33-c087-4905-93fe-c81bfafcf1da admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:58.220087 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7606f33-c087-4905-93fe-c81bfafcf1da admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:58.224830 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583f176-49d6-488e-a9bb-e3bda1c32e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:58.225436 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583f176-49d6-488e-a9bb-e3bda1c32e4c admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:58.225712 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583f176-49d6-488e-a9bb-e3bda1c32e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:58.225987 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583f176-49d6-488e-a9bb-e3bda1c32e4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:58.226662 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f583f176-49d6-488e-a9bb-e3bda1c32e4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:58.228254 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f583f176-49d6-488e-a9bb-e3bda1c32e4c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:58.238212 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1371/2722] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:25:58.242283 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed97be-5b5c-4fa1-a0d9-90b5b86debee admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:58.252576 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed97be-5b5c-4fa1-a0d9-90b5b86debee admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:58.257786 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5776509-93f5-42d2-af66-8d8157767cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:58.258393 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5776509-93f5-42d2-af66-8d8157767cdb admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:58.258714 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5776509-93f5-42d2-af66-8d8157767cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:58.259098 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5776509-93f5-42d2-af66-8d8157767cdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:58.259747 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5776509-93f5-42d2-af66-8d8157767cdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:58.261397 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5776509-93f5-42d2-af66-8d8157767cdb admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:58.274512 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1352/2723] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:25:58.278710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583f176-49d6-488e-a9bb-e3bda1c32e4c admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:58.288610 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583f176-49d6-488e-a9bb-e3bda1c32e4c admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:58.293306 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0ba12-d8a3-44ff-835e-def417d16ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:58.293954 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0ba12-d8a3-44ff-835e-def417d16ff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:58.294236 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0ba12-d8a3-44ff-835e-def417d16ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:58.294537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0ba12-d8a3-44ff-835e-def417d16ff1 admin admin] PATH_INFO: `/v3/projects/c8ed316a7cc143b8b74756f1beaf8759/users/47dc593a23524beaaba96f22375fe9f4/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:58.313555 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0ba12-d8a3-44ff-835e-def417d16ff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8ed316a7cc143b8b74756f1beaf8759, user_id=47dc593a23524beaaba96f22375fe9f4, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:58.316236 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0ba12-d8a3-44ff-835e-def417d16ff1 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:58.336162 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1372/2724] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:25:58 2022] PUT /identity/v3/projects/c8ed316a7cc143b8b74756f1beaf8759/users/47dc593a23524beaaba96f22375fe9f4/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:58.347253 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28078641-4392-4ba2-880e-dc9d49badcb9 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:58.347561 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28078641-4392-4ba2-880e-dc9d49badcb9 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:58.347866 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28078641-4392-4ba2-880e-dc9d49badcb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:58.376537 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-28078641-4392-4ba2-880e-dc9d49badcb9 None None] MFA Rules not processed for user `47dc593a23524beaaba96f22375fe9f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:58.377688 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-28078641-4392-4ba2-880e-dc9d49badcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:58.388031 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:58.453419 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1353/2725] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:58.461420 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0ba12-d8a3-44ff-835e-def417d16ff1 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:58.463421 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e6a0ba12-d8a3-44ff-835e-def417d16ff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:58.489110 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:58.523486 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0ba12-d8a3-44ff-835e-def417d16ff1 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:58.527216 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed29ab-7ab1-4be5-9ff3-07b6601bc9f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:58.527824 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed29ab-7ab1-4be5-9ff3-07b6601bc9f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:58.528101 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed29ab-7ab1-4be5-9ff3-07b6601bc9f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:58.528373 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed29ab-7ab1-4be5-9ff3-07b6601bc9f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:58.537815 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed29ab-7ab1-4be5-9ff3-07b6601bc9f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:58.539282 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed29ab-7ab1-4be5-9ff3-07b6601bc9f1 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:58.548596 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1373/2726] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:25:58.572645 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28078641-4392-4ba2-880e-dc9d49badcb9 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:58.637182 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28078641-4392-4ba2-880e-dc9d49badcb9 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:58.641750 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4214e24c-ec80-4f5d-8410-a3712efc3720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:58.642377 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214e24c-ec80-4f5d-8410-a3712efc3720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:58.642692 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214e24c-ec80-4f5d-8410-a3712efc3720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:58.642971 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214e24c-ec80-4f5d-8410-a3712efc3720 admin admin] PATH_INFO: `/v3/users/47dc593a23524beaaba96f22375fe9f4` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:58.644109 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4214e24c-ec80-4f5d-8410-a3712efc3720 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47dc593a23524beaaba96f22375fe9f4)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:58.646014 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4214e24c-ec80-4f5d-8410-a3712efc3720 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:58.691956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-4214e24c-ec80-4f5d-8410-a3712efc3720 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47dc593a23524beaaba96f22375fe9f4'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:58.692634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-4214e24c-ec80-4f5d-8410-a3712efc3720 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47dc593a23524beaaba96f22375fe9f4'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:58.704980 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-4214e24c-ec80-4f5d-8410-a3712efc3720 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47dc593a23524beaaba96f22375fe9f4'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:58.712523 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-4214e24c-ec80-4f5d-8410-a3712efc3720 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47dc593a23524beaaba96f22375fe9f4'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:58.720336 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-4214e24c-ec80-4f5d-8410-a3712efc3720 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47dc593a23524beaaba96f22375fe9f4'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:58.726986 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1354/2727] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:25:58 2022] DELETE /identity/v3/users/47dc593a23524beaaba96f22375fe9f4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:58.731463 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d52b8-1e37-405c-9749-bf0bbddbd5fb None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:58.731775 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d52b8-1e37-405c-9749-bf0bbddbd5fb None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:58.732050 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d52b8-1e37-405c-9749-bf0bbddbd5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:58.751066 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-8a0d52b8-1e37-405c-9749-bf0bbddbd5fb None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:58.752404 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8a0d52b8-1e37-405c-9749-bf0bbddbd5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:58.811451 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1374/2728] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:58.821625 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4214e24c-ec80-4f5d-8410-a3712efc3720 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:58.823103 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-4214e24c-ec80-4f5d-8410-a3712efc3720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:58.861193 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:58.886306 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4214e24c-ec80-4f5d-8410-a3712efc3720 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:58.890077 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c6cb74-e436-4ff4-adc1-f2aa7a090b21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:58.890626 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6cb74-e436-4ff4-adc1-f2aa7a090b21 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:58.890928 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6cb74-e436-4ff4-adc1-f2aa7a090b21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:58.891194 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6cb74-e436-4ff4-adc1-f2aa7a090b21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:58.901421 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c6cb74-e436-4ff4-adc1-f2aa7a090b21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:58.902906 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c6cb74-e436-4ff4-adc1-f2aa7a090b21 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:58.912127 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1355/2729] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:25:59.267061 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d52b8-1e37-405c-9749-bf0bbddbd5fb None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:59.268655 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8a0d52b8-1e37-405c-9749-bf0bbddbd5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:59.280950 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d52b8-1e37-405c-9749-bf0bbddbd5fb None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:59.286503 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b979b89-b72d-441e-b619-f4cdbd4b70a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:59.287296 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b979b89-b72d-441e-b619-f4cdbd4b70a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:59.287579 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b979b89-b72d-441e-b619-f4cdbd4b70a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:59.287851 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b979b89-b72d-441e-b619-f4cdbd4b70a9 admin admin] PATH_INFO: `/v3/projects/c8ed316a7cc143b8b74756f1beaf8759` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:59.289059 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b979b89-b72d-441e-b619-f4cdbd4b70a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8ed316a7cc143b8b74756f1beaf8759)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:59.291014 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b979b89-b72d-441e-b619-f4cdbd4b70a9 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:59.343393 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6b979b89-b72d-441e-b619-f4cdbd4b70a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8ed316a7cc143b8b74756f1beaf8759', 'request_id': 'req-6b979b89-b72d-441e-b619-f4cdbd4b70a9'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:59.348927 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6b979b89-b72d-441e-b619-f4cdbd4b70a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8ed316a7cc143b8b74756f1beaf8759', 'request_id': 'req-6b979b89-b72d-441e-b619-f4cdbd4b70a9'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:59.355177 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6b979b89-b72d-441e-b619-f4cdbd4b70a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8ed316a7cc143b8b74756f1beaf8759', 'request_id': 'req-6b979b89-b72d-441e-b619-f4cdbd4b70a9'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:59.368149 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6b979b89-b72d-441e-b619-f4cdbd4b70a9 admin admin] The token cache is being invalidate because project c8ed316a7cc143b8b74756f1beaf8759 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:25:59.368454 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6b979b89-b72d-441e-b619-f4cdbd4b70a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:59.369066 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6b979b89-b72d-441e-b619-f4cdbd4b70a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:25:59.370587 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1375/2730] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:25:59 2022] DELETE /identity/v3/projects/c8ed316a7cc143b8b74756f1beaf8759 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:59.375870 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9c42b-3ced-4648-a0eb-3737078dcbc0 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:59.376229 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9c42b-3ced-4648-a0eb-3737078dcbc0 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:59.376800 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9c42b-3ced-4648-a0eb-3737078dcbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:59.396846 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-d8f9c42b-3ced-4648-a0eb-3737078dcbc0 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:59.398051 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d8f9c42b-3ced-4648-a0eb-3737078dcbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:59.455827 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1356/2731] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:59.463837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26479612-093b-4e16-a92f-4962b33c4fc8 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:59.464117 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26479612-093b-4e16-a92f-4962b33c4fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:59.464470 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26479612-093b-4e16-a92f-4962b33c4fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:59.484097 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-26479612-093b-4e16-a92f-4962b33c4fc8 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:59.485334 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-26479612-093b-4e16-a92f-4962b33c4fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:59.493883 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1376/2732] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:59.498166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9c42b-3ced-4648-a0eb-3737078dcbc0 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:59.508450 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9c42b-3ced-4648-a0eb-3737078dcbc0 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:59.512980 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e5e48-183f-4d00-a1a4-fea3ef8ced7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:59.513574 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e5e48-183f-4d00-a1a4-fea3ef8ced7c admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:59.513855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e5e48-183f-4d00-a1a4-fea3ef8ced7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:59.514122 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e5e48-183f-4d00-a1a4-fea3ef8ced7c admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:59.514821 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e5e48-183f-4d00-a1a4-fea3ef8ced7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:25:59.515117 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e5e48-183f-4d00-a1a4-fea3ef8ced7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:59.516692 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e5e48-183f-4d00-a1a4-fea3ef8ced7c admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:59.528587 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1357/2733] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:25:59.533354 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26479612-093b-4e16-a92f-4962b33c4fc8 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:59.543754 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26479612-093b-4e16-a92f-4962b33c4fc8 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:59.548344 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5493b5-5330-4b4b-bf2d-73e0aa57ba1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:59.548945 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5493b5-5330-4b4b-bf2d-73e0aa57ba1a admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:59.549217 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5493b5-5330-4b4b-bf2d-73e0aa57ba1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:59.549478 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5493b5-5330-4b4b-bf2d-73e0aa57ba1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:59.550127 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5493b5-5330-4b4b-bf2d-73e0aa57ba1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:59.552069 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5493b5-5330-4b4b-bf2d-73e0aa57ba1a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:59.580423 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1377/2734] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:25:59 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:25:59.584677 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e5e48-183f-4d00-a1a4-fea3ef8ced7c admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:59.597507 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e5e48-183f-4d00-a1a4-fea3ef8ced7c admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:59.656370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e4efc-1615-43c7-9b9d-b3eef162fbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:59.657488 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e4efc-1615-43c7-9b9d-b3eef162fbe4 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:59.657776 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e4efc-1615-43c7-9b9d-b3eef162fbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:59.658051 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e4efc-1615-43c7-9b9d-b3eef162fbe4 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:59.658713 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e4efc-1615-43c7-9b9d-b3eef162fbe4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:59.660625 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e4efc-1615-43c7-9b9d-b3eef162fbe4 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:59.684295 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1358/2735] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:25:59 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:25:59.689722 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5493b5-5330-4b4b-bf2d-73e0aa57ba1a admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:59.700019 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5493b5-5330-4b4b-bf2d-73e0aa57ba1a admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:59.704775 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae020fe8-4b78-4cf9-a9e0-83268d3d7560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:59.705378 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae020fe8-4b78-4cf9-a9e0-83268d3d7560 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:59.705656 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae020fe8-4b78-4cf9-a9e0-83268d3d7560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:59.705998 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae020fe8-4b78-4cf9-a9e0-83268d3d7560 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:59.706609 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae020fe8-4b78-4cf9-a9e0-83268d3d7560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:59.708200 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae020fe8-4b78-4cf9-a9e0-83268d3d7560 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:59.718690 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1378/2736] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:25:59.722794 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e4efc-1615-43c7-9b9d-b3eef162fbe4 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:59.733192 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e4efc-1615-43c7-9b9d-b3eef162fbe4 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:59.737988 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733e17d-30a7-477c-aa49-3cf80e7f49e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:59.738618 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733e17d-30a7-477c-aa49-3cf80e7f49e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:59.738900 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733e17d-30a7-477c-aa49-3cf80e7f49e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:59.739174 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733e17d-30a7-477c-aa49-3cf80e7f49e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:59.739816 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1733e17d-30a7-477c-aa49-3cf80e7f49e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:59.742230 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1733e17d-30a7-477c-aa49-3cf80e7f49e7 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:59.753018 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1359/2737] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:25:59.757208 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae020fe8-4b78-4cf9-a9e0-83268d3d7560 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:59.767012 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae020fe8-4b78-4cf9-a9e0-83268d3d7560 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:25:59.771563 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f28e5-c3b1-42b0-a3c1-c054ead46967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:25:59.772260 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f28e5-c3b1-42b0-a3c1-c054ead46967 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:59.772542 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f28e5-c3b1-42b0-a3c1-c054ead46967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:59.772808 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f28e5-c3b1-42b0-a3c1-c054ead46967 admin admin] PATH_INFO: `/v3/projects/58ed7781c48643e4b6d8e4003efcfd2b/users/67bdd5d59daa41f7abf64b0696ae3b65/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:59.775780 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:59.791319 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20f28e5-c3b1-42b0-a3c1-c054ead46967 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58ed7781c48643e4b6d8e4003efcfd2b, user_id=67bdd5d59daa41f7abf64b0696ae3b65, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:25:59.794169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20f28e5-c3b1-42b0-a3c1-c054ead46967 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:25:59.808346 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1379/2738] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:25:59 2022] PUT /identity/v3/projects/58ed7781c48643e4b6d8e4003efcfd2b/users/67bdd5d59daa41f7abf64b0696ae3b65/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:25:59.819905 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c151a1-1225-4ccd-b237-345c560cfb80 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:25:59.820191 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c151a1-1225-4ccd-b237-345c560cfb80 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:25:59.820469 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c151a1-1225-4ccd-b237-345c560cfb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:25:59.850351 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-69c151a1-1225-4ccd-b237-345c560cfb80 None None] MFA Rules not processed for user `67bdd5d59daa41f7abf64b0696ae3b65`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:25:59.851639 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-69c151a1-1225-4ccd-b237-345c560cfb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:25:59.891538 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:59.921011 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1360/2739] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:25:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:25:59.934985 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f28e5-c3b1-42b0-a3c1-c054ead46967 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:25:59.936705 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f20f28e5-c3b1-42b0-a3c1-c054ead46967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:00.005468 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f28e5-c3b1-42b0-a3c1-c054ead46967 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:00.009272 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e05ba-2076-4547-a58d-686c9d1b1a94 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '254dd957da6345f79bcab42b27b8d2cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:00.009880 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e05ba-2076-4547-a58d-686c9d1b1a94 service glance] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:00.010160 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e05ba-2076-4547-a58d-686c9d1b1a94 service glance] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:00.010433 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e05ba-2076-4547-a58d-686c9d1b1a94 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:00.019052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e05ba-2076-4547-a58d-686c9d1b1a94 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:00.020473 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e05ba-2076-4547-a58d-686c9d1b1a94 service glance] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:00.029665 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1380/2740] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:25:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:26:00.214060 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c151a1-1225-4ccd-b237-345c560cfb80 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:00.216664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-69c151a1-1225-4ccd-b237-345c560cfb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:00.343977 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c151a1-1225-4ccd-b237-345c560cfb80 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:00.349262 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7d5bd-ad6e-4bde-9b48-26dfd240250b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece00ea631594381bf1c27cfc2ece6f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:00.349903 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7d5bd-ad6e-4bde-9b48-26dfd240250b service placement] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:00.350181 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7d5bd-ad6e-4bde-9b48-26dfd240250b service placement] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:00.350453 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7d5bd-ad6e-4bde-9b48-26dfd240250b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:00.353165 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f3d7d5bd-ad6e-4bde-9b48-26dfd240250b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:00.366300 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d7d5bd-ad6e-4bde-9b48-26dfd240250b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:00.368320 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d7d5bd-ad6e-4bde-9b48-26dfd240250b service placement] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:00.380294 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1361/2741] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:26:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:26:02.466420 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbc938-ae97-447f-967a-509bb8a3a1f9 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:02.466936 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbc938-ae97-447f-967a-509bb8a3a1f9 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:02.467052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbc938-ae97-447f-967a-509bb8a3a1f9 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:02.468625 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1381/2742] 10.222.0.79 () {54 vars in 921 bytes} [Wed Aug 31 19:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:26:02.475144 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ec3e9-a5e8-48af-924e-0469b2a59fe2 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:02.475678 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ec3e9-a5e8-48af-924e-0469b2a59fe2 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:02.475988 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ec3e9-a5e8-48af-924e-0469b2a59fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:02.687987 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-945ec3e9-a5e8-48af-924e-0469b2a59fe2 None None] MFA Rules not processed for user `1fd6d45d1bc3479da72cb1a1990a6137`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:26:02.689735 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-945ec3e9-a5e8-48af-924e-0469b2a59fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:02.792652 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:02.805071 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1362/2743] 10.222.0.79 () {58 vars in 1018 bytes} [Wed Aug 31 19:26:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:26:02.819282 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedbc938-ae97-447f-967a-509bb8a3a1f9 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:02.835054 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedbc938-ae97-447f-967a-509bb8a3a1f9 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:02.839623 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06017ad-47b8-4b2f-9bdc-c2f22ad3646c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '254dd957da6345f79bcab42b27b8d2cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:02.840813 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06017ad-47b8-4b2f-9bdc-c2f22ad3646c service glance] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:02.841352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06017ad-47b8-4b2f-9bdc-c2f22ad3646c service glance] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:02.841851 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06017ad-47b8-4b2f-9bdc-c2f22ad3646c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:02.855983 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06017ad-47b8-4b2f-9bdc-c2f22ad3646c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:02.857683 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06017ad-47b8-4b2f-9bdc-c2f22ad3646c service glance] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:02.877033 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1382/2744] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:26:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:26:02.957697 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf50c7-66aa-47b7-a077-efbe69f74e83 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:02.958490 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf50c7-66aa-47b7-a077-efbe69f74e83 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:02.958490 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf50c7-66aa-47b7-a077-efbe69f74e83 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:02.960954 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1363/2745] 10.222.0.79 () {54 vars in 921 bytes} [Wed Aug 31 19:26:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:26:02.968724 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45524af-bf85-4974-b387-8aeb83451754 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:02.969250 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45524af-bf85-4974-b387-8aeb83451754 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:02.969713 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45524af-bf85-4974-b387-8aeb83451754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:03.003447 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-e45524af-bf85-4974-b387-8aeb83451754 None None] MFA Rules not processed for user `a91998a2818444a595adc06f1f481fe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:26:03.004679 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e45524af-bf85-4974-b387-8aeb83451754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:03.064435 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1383/2746] 10.222.0.79 () {58 vars in 1018 bytes} [Wed Aug 31 19:26:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:26:03.077144 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf50c7-66aa-47b7-a077-efbe69f74e83 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:03.078907 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-abbf50c7-66aa-47b7-a077-efbe69f74e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:03.093201 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf50c7-66aa-47b7-a077-efbe69f74e83 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:03.096656 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb760d-c107-41e7-b90d-49908561c986 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:03.097247 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb760d-c107-41e7-b90d-49908561c986 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:03.097520 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb760d-c107-41e7-b90d-49908561c986 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:03.097786 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb760d-c107-41e7-b90d-49908561c986 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:03.105449 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb760d-c107-41e7-b90d-49908561c986 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:03.107007 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb760d-c107-41e7-b90d-49908561c986 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:03.114835 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1364/2747] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:26:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:26:03.202509 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa294d4-6b9c-46b1-8ea4-d62a09e7c0f3 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:03.202795 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa294d4-6b9c-46b1-8ea4-d62a09e7c0f3 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:03.203074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa294d4-6b9c-46b1-8ea4-d62a09e7c0f3 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:03.204417 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1384/2748] 10.222.0.79 () {54 vars in 921 bytes} [Wed Aug 31 19:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 19:26:03.209859 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d31e9-6609-4793-98c2-3aa688b4dfb5 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:03.210229 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d31e9-6609-4793-98c2-3aa688b4dfb5 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:03.210558 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d31e9-6609-4793-98c2-3aa688b4dfb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:03.231420 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-b66d31e9-6609-4793-98c2-3aa688b4dfb5 None None] MFA Rules not processed for user `1fd6d45d1bc3479da72cb1a1990a6137`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:26:03.232726 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-b66d31e9-6609-4793-98c2-3aa688b4dfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:03.243339 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1365/2749] 10.222.0.79 () {58 vars in 1018 bytes} [Wed Aug 31 19:26:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:26:03.254044 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa294d4-6b9c-46b1-8ea4-d62a09e7c0f3 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:03.255920 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-daa294d4-6b9c-46b1-8ea4-d62a09e7c0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:03.273380 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa294d4-6b9c-46b1-8ea4-d62a09e7c0f3 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:03.277730 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c3d85-80d9-40cd-ac24-381a30bb6f90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:03.278328 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c3d85-80d9-40cd-ac24-381a30bb6f90 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:03.278636 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c3d85-80d9-40cd-ac24-381a30bb6f90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:03.278907 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c3d85-80d9-40cd-ac24-381a30bb6f90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:03.291733 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c3d85-80d9-40cd-ac24-381a30bb6f90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:03.293625 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c3d85-80d9-40cd-ac24-381a30bb6f90 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:03.305382 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1385/2750] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:26:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:26:05.582992 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d58ef1-fb16-448b-92cb-d2672bae5a56 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:05.583544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d58ef1-fb16-448b-92cb-d2672bae5a56 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:05.583544 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d58ef1-fb16-448b-92cb-d2672bae5a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:05.606322 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-35d58ef1-fb16-448b-92cb-d2672bae5a56 None None] MFA Rules not processed for user `3e070c93f47045ecb5bf0a1622395091`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:26:05.607633 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-35d58ef1-fb16-448b-92cb-d2672bae5a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:05.666078 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1366/2751] 10.222.0.79 () {58 vars in 1009 bytes} [Wed Aug 31 19:26:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:26:05.677900 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c3d85-80d9-40cd-ac24-381a30bb6f90 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:05.679367 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-fb1c3d85-80d9-40cd-ac24-381a30bb6f90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:05.731448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:05.749799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c3d85-80d9-40cd-ac24-381a30bb6f90 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:05.754929 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250450d7-9c54-4bfb-9908-5bcbce036439 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b289a0bef53460ca5173ad946394d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:05.755600 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250450d7-9c54-4bfb-9908-5bcbce036439 service swift] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:05.756489 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250450d7-9c54-4bfb-9908-5bcbce036439 service swift] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:05.756845 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250450d7-9c54-4bfb-9908-5bcbce036439 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:05.765658 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250450d7-9c54-4bfb-9908-5bcbce036439 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:05.767285 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250450d7-9c54-4bfb-9908-5bcbce036439 service swift] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:05.775831 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1386/2752] 10.222.0.79 () {60 vars in 1384 bytes} [Wed Aug 31 19:26:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:26:09.281072 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d58ef1-fb16-448b-92cb-d2672bae5a56 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:09.283113 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-35d58ef1-fb16-448b-92cb-d2672bae5a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:09.359469 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d58ef1-fb16-448b-92cb-d2672bae5a56 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:09.364372 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0febc196-f2c3-4ae7-a8f7-11f9a8edd13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:09.365835 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febc196-f2c3-4ae7-a8f7-11f9a8edd13c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:09.366122 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febc196-f2c3-4ae7-a8f7-11f9a8edd13c admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:09.366594 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febc196-f2c3-4ae7-a8f7-11f9a8edd13c admin admin] PATH_INFO: `/v3/users/df4b1f90b62949259c077469c810cebb` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:09.367750 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0febc196-f2c3-4ae7-a8f7-11f9a8edd13c admin admin] RBAC: Authorizing `identity:delete_user(user_id=df4b1f90b62949259c077469c810cebb)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:09.369854 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0febc196-f2c3-4ae7-a8f7-11f9a8edd13c admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:09.436270 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-0febc196-f2c3-4ae7-a8f7-11f9a8edd13c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df4b1f90b62949259c077469c810cebb'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:26:09.437082 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-0febc196-f2c3-4ae7-a8f7-11f9a8edd13c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df4b1f90b62949259c077469c810cebb'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:26:09.456104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-0febc196-f2c3-4ae7-a8f7-11f9a8edd13c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df4b1f90b62949259c077469c810cebb'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:26:09.463481 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-0febc196-f2c3-4ae7-a8f7-11f9a8edd13c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df4b1f90b62949259c077469c810cebb'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:26:09.471908 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-0febc196-f2c3-4ae7-a8f7-11f9a8edd13c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df4b1f90b62949259c077469c810cebb'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:26:09.474980 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:09.483769 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1367/2753] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:26:09 2022] DELETE /identity/v3/users/df4b1f90b62949259c077469c810cebb => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:26:09.489570 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a6aa3-f57e-4164-a62f-d9e502da6cca None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:09.490669 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a6aa3-f57e-4164-a62f-d9e502da6cca None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:09.491103 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a6aa3-f57e-4164-a62f-d9e502da6cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:09.511662 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-294a6aa3-f57e-4164-a62f-d9e502da6cca None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:26:09.512879 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-294a6aa3-f57e-4164-a62f-d9e502da6cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:09.593171 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1387/2754] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:26:09.603920 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0febc196-f2c3-4ae7-a8f7-11f9a8edd13c admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:09.605458 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-0febc196-f2c3-4ae7-a8f7-11f9a8edd13c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:09.676157 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0febc196-f2c3-4ae7-a8f7-11f9a8edd13c admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:09.681476 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a7e05-0607-4699-856b-1fff3a861fbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:09.682230 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a7e05-0607-4699-856b-1fff3a861fbf service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:09.682614 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a7e05-0607-4699-856b-1fff3a861fbf service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:09.683085 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a7e05-0607-4699-856b-1fff3a861fbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:09.693044 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a7e05-0607-4699-856b-1fff3a861fbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:09.694692 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a7e05-0607-4699-856b-1fff3a861fbf service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:09.705471 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1368/2755] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:26:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:26:10.088574 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a6aa3-f57e-4164-a62f-d9e502da6cca None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:10.092661 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-294a6aa3-f57e-4164-a62f-d9e502da6cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:10.109131 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a6aa3-f57e-4164-a62f-d9e502da6cca None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:10.169021 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9498f7-0f0f-4e64-b170-b2c7f046aa3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:10.169785 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9498f7-0f0f-4e64-b170-b2c7f046aa3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:10.170269 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9498f7-0f0f-4e64-b170-b2c7f046aa3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:10.170810 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9498f7-0f0f-4e64-b170-b2c7f046aa3b admin admin] PATH_INFO: `/v3/projects/d43909c44c674c24931c78303ff150fa` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:10.172704 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9498f7-0f0f-4e64-b170-b2c7f046aa3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d43909c44c674c24931c78303ff150fa)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:10.174801 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9498f7-0f0f-4e64-b170-b2c7f046aa3b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:10.240686 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-db9498f7-0f0f-4e64-b170-b2c7f046aa3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd43909c44c674c24931c78303ff150fa', 'request_id': 'req-db9498f7-0f0f-4e64-b170-b2c7f046aa3b'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:26:10.248242 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-db9498f7-0f0f-4e64-b170-b2c7f046aa3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd43909c44c674c24931c78303ff150fa', 'request_id': 'req-db9498f7-0f0f-4e64-b170-b2c7f046aa3b'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:26:10.257530 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-db9498f7-0f0f-4e64-b170-b2c7f046aa3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd43909c44c674c24931c78303ff150fa', 'request_id': 'req-db9498f7-0f0f-4e64-b170-b2c7f046aa3b'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:26:10.270369 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-db9498f7-0f0f-4e64-b170-b2c7f046aa3b admin admin] The token cache is being invalidate because project d43909c44c674c24931c78303ff150fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:26:10.270693 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-db9498f7-0f0f-4e64-b170-b2c7f046aa3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:26:10.271970 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-db9498f7-0f0f-4e64-b170-b2c7f046aa3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:26:10.273611 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1388/2756] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:26:10 2022] DELETE /identity/v3/projects/d43909c44c674c24931c78303ff150fa => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:26:10.279488 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6b0f9-e60d-4155-a197-f3fb9743b72f None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:10.279488 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6b0f9-e60d-4155-a197-f3fb9743b72f None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:10.279488 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6b0f9-e60d-4155-a197-f3fb9743b72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:10.306408 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-9da6b0f9-e60d-4155-a197-f3fb9743b72f None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:26:10.308280 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-9da6b0f9-e60d-4155-a197-f3fb9743b72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:10.392444 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1369/2757] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:26:10.402781 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df497ba3-1757-441f-8481-3cac7b8cc09f None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:10.403190 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df497ba3-1757-441f-8481-3cac7b8cc09f None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:10.403368 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df497ba3-1757-441f-8481-3cac7b8cc09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:10.423183 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-df497ba3-1757-441f-8481-3cac7b8cc09f None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:26:10.424387 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-df497ba3-1757-441f-8481-3cac7b8cc09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:10.435459 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1389/2758] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:26:10.440382 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da6b0f9-e60d-4155-a197-f3fb9743b72f None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:10.451634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da6b0f9-e60d-4155-a197-f3fb9743b72f None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:10.457112 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39da6a4-e78a-4cc1-b09e-fc405f5564ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:10.457855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39da6a4-e78a-4cc1-b09e-fc405f5564ec admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:10.458156 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39da6a4-e78a-4cc1-b09e-fc405f5564ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:10.458432 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39da6a4-e78a-4cc1-b09e-fc405f5564ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:10.459148 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39da6a4-e78a-4cc1-b09e-fc405f5564ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:26:10.459452 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39da6a4-e78a-4cc1-b09e-fc405f5564ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:10.461636 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39da6a4-e78a-4cc1-b09e-fc405f5564ec admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:10.476636 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1370/2759] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:26:10.480999 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df497ba3-1757-441f-8481-3cac7b8cc09f None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:10.491747 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df497ba3-1757-441f-8481-3cac7b8cc09f None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:10.496845 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38b1ff-ccae-459c-86e9-ad69771211b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:10.497463 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38b1ff-ccae-459c-86e9-ad69771211b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:10.497740 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38b1ff-ccae-459c-86e9-ad69771211b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:10.498014 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38b1ff-ccae-459c-86e9-ad69771211b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:10.498671 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38b1ff-ccae-459c-86e9-ad69771211b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:10.500600 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38b1ff-ccae-459c-86e9-ad69771211b9 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:10.539742 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1390/2760] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:26:10 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:26:10.542849 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39da6a4-e78a-4cc1-b09e-fc405f5564ec admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:10.555235 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39da6a4-e78a-4cc1-b09e-fc405f5564ec admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:10.624897 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25ce5f-e054-41a3-b2df-c0269a640a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:10.625548 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25ce5f-e054-41a3-b2df-c0269a640a94 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:10.625834 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25ce5f-e054-41a3-b2df-c0269a640a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:10.626147 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25ce5f-e054-41a3-b2df-c0269a640a94 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:10.626896 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e25ce5f-e054-41a3-b2df-c0269a640a94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:10.628877 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e25ce5f-e054-41a3-b2df-c0269a640a94 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:10.656808 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1371/2761] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:26:10 2022] POST /identity/v3/users => generated 286 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:26:10.661587 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38b1ff-ccae-459c-86e9-ad69771211b9 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:10.672709 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38b1ff-ccae-459c-86e9-ad69771211b9 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:10.678754 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc89ef-0374-41bf-96b1-cb6713420d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:10.679375 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc89ef-0374-41bf-96b1-cb6713420d81 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:10.679655 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc89ef-0374-41bf-96b1-cb6713420d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:10.679994 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc89ef-0374-41bf-96b1-cb6713420d81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:10.680649 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc89ef-0374-41bf-96b1-cb6713420d81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:10.682269 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc89ef-0374-41bf-96b1-cb6713420d81 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:10.696520 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1391/2762] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:26:10.701027 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25ce5f-e054-41a3-b2df-c0269a640a94 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:10.711510 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25ce5f-e054-41a3-b2df-c0269a640a94 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:10.716553 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c511eaa9-e1d2-411e-9c0c-0e291877f14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:10.717149 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511eaa9-e1d2-411e-9c0c-0e291877f14d admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:10.717426 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511eaa9-e1d2-411e-9c0c-0e291877f14d admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:10.717692 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511eaa9-e1d2-411e-9c0c-0e291877f14d admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:10.718366 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c511eaa9-e1d2-411e-9c0c-0e291877f14d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:10.720115 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c511eaa9-e1d2-411e-9c0c-0e291877f14d admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:10.731387 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1372/2763] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:26:10.735853 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc89ef-0374-41bf-96b1-cb6713420d81 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:10.750552 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc89ef-0374-41bf-96b1-cb6713420d81 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:10.757458 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe70cab-4f7b-4295-926c-7db197234e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:10.758361 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe70cab-4f7b-4295-926c-7db197234e06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:10.758795 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe70cab-4f7b-4295-926c-7db197234e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:10.758991 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe70cab-4f7b-4295-926c-7db197234e06 admin admin] PATH_INFO: `/v3/projects/d134a86ab43d4b959dba533d01494a62/users/b49522be45994a569153afbbbbe22371/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:10.775558 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe70cab-4f7b-4295-926c-7db197234e06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d134a86ab43d4b959dba533d01494a62, user_id=b49522be45994a569153afbbbbe22371, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:10.778433 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe70cab-4f7b-4295-926c-7db197234e06 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:10.790380 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:10.804019 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1392/2764] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:26:10 2022] PUT /identity/v3/projects/d134a86ab43d4b959dba533d01494a62/users/b49522be45994a569153afbbbbe22371/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:26:10.815182 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1828159-5c43-4f59-b558-cb57eea6d11c None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:10.815439 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1828159-5c43-4f59-b558-cb57eea6d11c None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:10.815744 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1828159-5c43-4f59-b558-cb57eea6d11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:10.836397 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:10.848726 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-e1828159-5c43-4f59-b558-cb57eea6d11c None None] MFA Rules not processed for user `b49522be45994a569153afbbbbe22371`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:26:10.850888 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-e1828159-5c43-4f59-b558-cb57eea6d11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:10.920857 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1373/2765] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:26:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:26:14.614115 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe70cab-4f7b-4295-926c-7db197234e06 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:14.616742 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-dbe70cab-4f7b-4295-926c-7db197234e06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:14.698232 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe70cab-4f7b-4295-926c-7db197234e06 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:14.701878 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eaccae-0119-43df-ac31-48c8f20a894c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '254dd957da6345f79bcab42b27b8d2cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:14.702516 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eaccae-0119-43df-ac31-48c8f20a894c service glance] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:14.702794 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eaccae-0119-43df-ac31-48c8f20a894c service glance] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:14.703061 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eaccae-0119-43df-ac31-48c8f20a894c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:14.714344 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eaccae-0119-43df-ac31-48c8f20a894c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:14.715246 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eaccae-0119-43df-ac31-48c8f20a894c service glance] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:14.725752 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1393/2766] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:26:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:26:20.919922 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=28 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:21.098160 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1828159-5c43-4f59-b558-cb57eea6d11c None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:21.099588 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-e1828159-5c43-4f59-b558-cb57eea6d11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:21.164294 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1828159-5c43-4f59-b558-cb57eea6d11c None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:21.168801 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62381c0b-af84-4ec2-903a-b27358e748ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:21.169559 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62381c0b-af84-4ec2-903a-b27358e748ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:21.169849 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62381c0b-af84-4ec2-903a-b27358e748ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:21.170119 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62381c0b-af84-4ec2-903a-b27358e748ea admin admin] PATH_INFO: `/v3/users/67bdd5d59daa41f7abf64b0696ae3b65` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:21.171289 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62381c0b-af84-4ec2-903a-b27358e748ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=67bdd5d59daa41f7abf64b0696ae3b65)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:21.173509 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62381c0b-af84-4ec2-903a-b27358e748ea admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:21.221610 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-62381c0b-af84-4ec2-903a-b27358e748ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67bdd5d59daa41f7abf64b0696ae3b65'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:26:21.222267 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-62381c0b-af84-4ec2-903a-b27358e748ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67bdd5d59daa41f7abf64b0696ae3b65'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:26:21.234663 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-62381c0b-af84-4ec2-903a-b27358e748ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67bdd5d59daa41f7abf64b0696ae3b65'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:26:21.242253 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-62381c0b-af84-4ec2-903a-b27358e748ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67bdd5d59daa41f7abf64b0696ae3b65'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:26:21.250858 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-62381c0b-af84-4ec2-903a-b27358e748ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67bdd5d59daa41f7abf64b0696ae3b65'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:26:21.260442 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1374/2767] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:26:21 2022] DELETE /identity/v3/users/67bdd5d59daa41f7abf64b0696ae3b65 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:26:21.265010 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d80ba-d6ae-4b2e-922d-2500b7629c8b None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:21.265511 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d80ba-d6ae-4b2e-922d-2500b7629c8b None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:21.265693 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d80ba-d6ae-4b2e-922d-2500b7629c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:21.284997 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-756d80ba-d6ae-4b2e-922d-2500b7629c8b None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:26:21.286198 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-756d80ba-d6ae-4b2e-922d-2500b7629c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:21.348743 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1394/2768] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:26:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:26:21.359594 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62381c0b-af84-4ec2-903a-b27358e748ea admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:21.361046 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-62381c0b-af84-4ec2-903a-b27358e748ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:21.418998 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62381c0b-af84-4ec2-903a-b27358e748ea admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:21.422702 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f3614-9b82-443a-9bc8-7f356fb44749 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:21.423347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f3614-9b82-443a-9bc8-7f356fb44749 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:21.423625 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f3614-9b82-443a-9bc8-7f356fb44749 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:21.423896 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f3614-9b82-443a-9bc8-7f356fb44749 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:21.435118 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f3614-9b82-443a-9bc8-7f356fb44749 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:21.436949 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f3614-9b82-443a-9bc8-7f356fb44749 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:21.447008 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1375/2769] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:26:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:26:21.720584 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d80ba-d6ae-4b2e-922d-2500b7629c8b None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:21.722023 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-756d80ba-d6ae-4b2e-922d-2500b7629c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:21.734621 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d80ba-d6ae-4b2e-922d-2500b7629c8b None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:21.739788 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97acd649-ba92-4e99-bc10-fe0b7426a6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:21.740579 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acd649-ba92-4e99-bc10-fe0b7426a6d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:21.740932 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acd649-ba92-4e99-bc10-fe0b7426a6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:21.741273 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acd649-ba92-4e99-bc10-fe0b7426a6d5 admin admin] PATH_INFO: `/v3/projects/58ed7781c48643e4b6d8e4003efcfd2b` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:21.742565 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97acd649-ba92-4e99-bc10-fe0b7426a6d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58ed7781c48643e4b6d8e4003efcfd2b)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:21.745473 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97acd649-ba92-4e99-bc10-fe0b7426a6d5 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:21.798260 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-97acd649-ba92-4e99-bc10-fe0b7426a6d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58ed7781c48643e4b6d8e4003efcfd2b', 'request_id': 'req-97acd649-ba92-4e99-bc10-fe0b7426a6d5'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:26:21.804854 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-97acd649-ba92-4e99-bc10-fe0b7426a6d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58ed7781c48643e4b6d8e4003efcfd2b', 'request_id': 'req-97acd649-ba92-4e99-bc10-fe0b7426a6d5'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:26:21.811078 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-97acd649-ba92-4e99-bc10-fe0b7426a6d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58ed7781c48643e4b6d8e4003efcfd2b', 'request_id': 'req-97acd649-ba92-4e99-bc10-fe0b7426a6d5'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:26:21.824143 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-97acd649-ba92-4e99-bc10-fe0b7426a6d5 admin admin] The token cache is being invalidate because project 58ed7781c48643e4b6d8e4003efcfd2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:26:21.824545 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-97acd649-ba92-4e99-bc10-fe0b7426a6d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:26:21.825170 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-97acd649-ba92-4e99-bc10-fe0b7426a6d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:26:21.826757 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1395/2770] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:26:21 2022] DELETE /identity/v3/projects/58ed7781c48643e4b6d8e4003efcfd2b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:26:21.832887 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fe718-ce3b-4c5a-aab6-84957901569c None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:21.833170 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fe718-ce3b-4c5a-aab6-84957901569c None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:21.833445 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fe718-ce3b-4c5a-aab6-84957901569c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:21.854101 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-079fe718-ce3b-4c5a-aab6-84957901569c None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:26:21.855393 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-079fe718-ce3b-4c5a-aab6-84957901569c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:21.872936 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:21.917692 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1376/2771] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:26:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:26:21.925410 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c847b-5aed-445f-ba16-cb7412593e91 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:21.925635 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c847b-5aed-445f-ba16-cb7412593e91 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:21.925909 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c847b-5aed-445f-ba16-cb7412593e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:21.946673 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-264c847b-5aed-445f-ba16-cb7412593e91 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:26:21.947871 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-264c847b-5aed-445f-ba16-cb7412593e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:21.955997 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1396/2772] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:26:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:26:21.961331 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fe718-ce3b-4c5a-aab6-84957901569c None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:21.971189 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fe718-ce3b-4c5a-aab6-84957901569c None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:21.976480 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b30618-3b95-424a-a9d7-2e5b00e71d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:21.977079 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b30618-3b95-424a-a9d7-2e5b00e71d21 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:21.977357 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b30618-3b95-424a-a9d7-2e5b00e71d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:21.977628 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b30618-3b95-424a-a9d7-2e5b00e71d21 admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:21.978269 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b30618-3b95-424a-a9d7-2e5b00e71d21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:26:21.978605 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b30618-3b95-424a-a9d7-2e5b00e71d21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:21.980176 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b30618-3b95-424a-a9d7-2e5b00e71d21 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:21.992065 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1377/2773] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:26:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:26:21.996807 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c847b-5aed-445f-ba16-cb7412593e91 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:22.005986 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c847b-5aed-445f-ba16-cb7412593e91 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:22.011740 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd558f-5e1a-4d4c-822d-32a8992dce13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:22.012347 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd558f-5e1a-4d4c-822d-32a8992dce13 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:22.012628 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd558f-5e1a-4d4c-822d-32a8992dce13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:22.012929 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd558f-5e1a-4d4c-822d-32a8992dce13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:22.013582 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd558f-5e1a-4d4c-822d-32a8992dce13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:22.015529 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd558f-5e1a-4d4c-822d-32a8992dce13 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:22.039297 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:22.051032 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1397/2774] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:26:21 2022] POST /identity/v3/projects => generated 369 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:26:22.052220 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b30618-3b95-424a-a9d7-2e5b00e71d21 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:22.062569 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b30618-3b95-424a-a9d7-2e5b00e71d21 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:22.124240 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f05c19-1eee-45b2-aee8-0bd480e6dbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:22.125140 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f05c19-1eee-45b2-aee8-0bd480e6dbd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:22.125463 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f05c19-1eee-45b2-aee8-0bd480e6dbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:22.125779 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f05c19-1eee-45b2-aee8-0bd480e6dbd3 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:22.127082 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f05c19-1eee-45b2-aee8-0bd480e6dbd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:22.129073 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f05c19-1eee-45b2-aee8-0bd480e6dbd3 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:22.152002 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1378/2775] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:26:22 2022] POST /identity/v3/users => generated 285 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:26:22.156195 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd558f-5e1a-4d4c-822d-32a8992dce13 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:22.172093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd558f-5e1a-4d4c-822d-32a8992dce13 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:22.181092 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c857b-7280-4659-85e0-3ef6f845c4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:22.181468 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c857b-7280-4659-85e0-3ef6f845c4ed admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:22.181824 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c857b-7280-4659-85e0-3ef6f845c4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:22.182340 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c857b-7280-4659-85e0-3ef6f845c4ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:22.183457 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c857b-7280-4659-85e0-3ef6f845c4ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:22.186093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c857b-7280-4659-85e0-3ef6f845c4ed admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:22.202732 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1398/2776] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:26:22.208208 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f05c19-1eee-45b2-aee8-0bd480e6dbd3 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:22.219407 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f05c19-1eee-45b2-aee8-0bd480e6dbd3 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:22.224235 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa7869-e513-4e7f-8a5a-b7837dbc8983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:22.225410 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa7869-e513-4e7f-8a5a-b7837dbc8983 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:22.225691 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa7869-e513-4e7f-8a5a-b7837dbc8983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:22.225982 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa7869-e513-4e7f-8a5a-b7837dbc8983 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:22.226652 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa7869-e513-4e7f-8a5a-b7837dbc8983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:22.228249 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa7869-e513-4e7f-8a5a-b7837dbc8983 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:22.241613 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1379/2777] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:26:22.246053 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c857b-7280-4659-85e0-3ef6f845c4ed admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:22.255998 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c857b-7280-4659-85e0-3ef6f845c4ed admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:22.261114 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccb4f3-5325-4e23-a2dd-efbdf44ae561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:22.261765 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccb4f3-5325-4e23-a2dd-efbdf44ae561 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:22.262039 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccb4f3-5325-4e23-a2dd-efbdf44ae561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:22.262308 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccb4f3-5325-4e23-a2dd-efbdf44ae561 admin admin] PATH_INFO: `/v3/projects/f17b20836aa34a25a2a7c4951863ad22/users/237e2b3dba6f404094a5d8f8396a0d22/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:22.277474 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ccb4f3-5325-4e23-a2dd-efbdf44ae561 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f17b20836aa34a25a2a7c4951863ad22, user_id=237e2b3dba6f404094a5d8f8396a0d22, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:22.280232 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ccb4f3-5325-4e23-a2dd-efbdf44ae561 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:22.294169 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1399/2778] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:26:22 2022] PUT /identity/v3/projects/f17b20836aa34a25a2a7c4951863ad22/users/237e2b3dba6f404094a5d8f8396a0d22/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:26:22.305166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb178d8-90a8-4593-ba67-2518196428d3 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:22.305452 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb178d8-90a8-4593-ba67-2518196428d3 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:22.305724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb178d8-90a8-4593-ba67-2518196428d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:22.349374 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-fbb178d8-90a8-4593-ba67-2518196428d3 None None] MFA Rules not processed for user `237e2b3dba6f404094a5d8f8396a0d22`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:26:22.351136 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-fbb178d8-90a8-4593-ba67-2518196428d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:22.419990 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1380/2779] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:26:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:26:22.436318 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccb4f3-5325-4e23-a2dd-efbdf44ae561 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:22.439080 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f3ccb4f3-5325-4e23-a2dd-efbdf44ae561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:22.511820 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccb4f3-5325-4e23-a2dd-efbdf44ae561 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:22.515512 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c282206-0437-4f22-9e3f-f893302558ab service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '254dd957da6345f79bcab42b27b8d2cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:22.516260 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c282206-0437-4f22-9e3f-f893302558ab service glance] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:22.516453 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c282206-0437-4f22-9e3f-f893302558ab service glance] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:22.516721 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c282206-0437-4f22-9e3f-f893302558ab service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:22.526569 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c282206-0437-4f22-9e3f-f893302558ab service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:22.528050 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c282206-0437-4f22-9e3f-f893302558ab service glance] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:22.539510 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1400/2780] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:26:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:26:23.247141 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6556357-d8b0-4115-96ef-8eedbf5dbc91 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:23.247733 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6556357-d8b0-4115-96ef-8eedbf5dbc91 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:23.247733 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6556357-d8b0-4115-96ef-8eedbf5dbc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:23.271015 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-c6556357-d8b0-4115-96ef-8eedbf5dbc91 None None] MFA Rules not processed for user `3e070c93f47045ecb5bf0a1622395091`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:26:23.272226 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-c6556357-d8b0-4115-96ef-8eedbf5dbc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:23.285385 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:23.344172 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1381/2781] 10.222.0.79 () {58 vars in 967 bytes} [Wed Aug 31 19:26:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:26:23.357239 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c282206-0437-4f22-9e3f-f893302558ab service glance] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:23.358705 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0c282206-0437-4f22-9e3f-f893302558ab service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:23.432525 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c282206-0437-4f22-9e3f-f893302558ab service glance] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:23.437790 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2fc273-184a-4e41-9b53-46eed50689b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b289a0bef53460ca5173ad946394d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:23.438398 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fc273-184a-4e41-9b53-46eed50689b3 service swift] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:23.438704 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fc273-184a-4e41-9b53-46eed50689b3 service swift] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:23.438972 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fc273-184a-4e41-9b53-46eed50689b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:23.452601 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2fc273-184a-4e41-9b53-46eed50689b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:23.454166 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2fc273-184a-4e41-9b53-46eed50689b3 service swift] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:23.462988 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1401/2782] 10.222.0.79 () {60 vars in 1384 bytes} [Wed Aug 31 19:26:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:26:33.336840 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=17 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:33.459835 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=74,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:42.877699 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6556357-d8b0-4115-96ef-8eedbf5dbc91 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:42.879212 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-c6556357-d8b0-4115-96ef-8eedbf5dbc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:42.944819 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6556357-d8b0-4115-96ef-8eedbf5dbc91 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:42.949552 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f6ff31-24aa-4282-a31e-a7747a71839c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:42.950151 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6ff31-24aa-4282-a31e-a7747a71839c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:42.950430 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6ff31-24aa-4282-a31e-a7747a71839c admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:42.950732 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6ff31-24aa-4282-a31e-a7747a71839c admin admin] PATH_INFO: `/v3/users/b49522be45994a569153afbbbbe22371` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:42.951902 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f6ff31-24aa-4282-a31e-a7747a71839c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b49522be45994a569153afbbbbe22371)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:42.953809 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f6ff31-24aa-4282-a31e-a7747a71839c admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:43.013003 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-39f6ff31-24aa-4282-a31e-a7747a71839c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b49522be45994a569153afbbbbe22371'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:26:43.013920 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-39f6ff31-24aa-4282-a31e-a7747a71839c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b49522be45994a569153afbbbbe22371'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:26:43.027112 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-39f6ff31-24aa-4282-a31e-a7747a71839c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b49522be45994a569153afbbbbe22371'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:26:43.033971 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-39f6ff31-24aa-4282-a31e-a7747a71839c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b49522be45994a569153afbbbbe22371'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:26:43.042702 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-39f6ff31-24aa-4282-a31e-a7747a71839c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b49522be45994a569153afbbbbe22371'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:26:43.048628 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1382/2783] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:26:42 2022] DELETE /identity/v3/users/b49522be45994a569153afbbbbe22371 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:26:43.054290 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999ec73-55de-40fd-9c97-5bead826d7f5 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:43.054799 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999ec73-55de-40fd-9c97-5bead826d7f5 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:43.054980 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999ec73-55de-40fd-9c97-5bead826d7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:43.073956 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-4999ec73-55de-40fd-9c97-5bead826d7f5 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:26:43.075181 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4999ec73-55de-40fd-9c97-5bead826d7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:43.134534 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1402/2784] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:26:43.144823 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f6ff31-24aa-4282-a31e-a7747a71839c admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:43.146220 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-39f6ff31-24aa-4282-a31e-a7747a71839c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:43.203612 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f6ff31-24aa-4282-a31e-a7747a71839c admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:43.207297 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e76a1-8a06-4edc-8abe-268025e4b7f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:43.207904 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e76a1-8a06-4edc-8abe-268025e4b7f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:43.208184 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e76a1-8a06-4edc-8abe-268025e4b7f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:43.208459 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e76a1-8a06-4edc-8abe-268025e4b7f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:43.217709 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82e76a1-8a06-4edc-8abe-268025e4b7f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:43.219151 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82e76a1-8a06-4edc-8abe-268025e4b7f8 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:43.229438 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1383/2785] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:26:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:26:43.546008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999ec73-55de-40fd-9c97-5bead826d7f5 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:43.548352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4999ec73-55de-40fd-9c97-5bead826d7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:43.565576 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999ec73-55de-40fd-9c97-5bead826d7f5 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:43.570522 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb4fba-c187-4c92-8e62-a3db59e226b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:43.571262 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb4fba-c187-4c92-8e62-a3db59e226b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:43.571552 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb4fba-c187-4c92-8e62-a3db59e226b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:43.571837 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb4fba-c187-4c92-8e62-a3db59e226b7 admin admin] PATH_INFO: `/v3/projects/d134a86ab43d4b959dba533d01494a62` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:43.572979 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb4fba-c187-4c92-8e62-a3db59e226b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d134a86ab43d4b959dba533d01494a62)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:43.575033 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb4fba-c187-4c92-8e62-a3db59e226b7 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:43.633441 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-21fb4fba-c187-4c92-8e62-a3db59e226b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd134a86ab43d4b959dba533d01494a62', 'request_id': 'req-21fb4fba-c187-4c92-8e62-a3db59e226b7'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:26:43.639813 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-21fb4fba-c187-4c92-8e62-a3db59e226b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd134a86ab43d4b959dba533d01494a62', 'request_id': 'req-21fb4fba-c187-4c92-8e62-a3db59e226b7'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:26:43.647489 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-21fb4fba-c187-4c92-8e62-a3db59e226b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd134a86ab43d4b959dba533d01494a62', 'request_id': 'req-21fb4fba-c187-4c92-8e62-a3db59e226b7'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:26:43.660366 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-21fb4fba-c187-4c92-8e62-a3db59e226b7 admin admin] The token cache is being invalidate because project d134a86ab43d4b959dba533d01494a62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:26:43.660654 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-21fb4fba-c187-4c92-8e62-a3db59e226b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:26:43.661282 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-21fb4fba-c187-4c92-8e62-a3db59e226b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:26:43.663484 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1403/2786] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:26:43 2022] DELETE /identity/v3/projects/d134a86ab43d4b959dba533d01494a62 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:26:43.668428 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc8575-4e85-4d0c-a567-9a0126efa236 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:43.668718 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc8575-4e85-4d0c-a567-9a0126efa236 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:43.669444 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc8575-4e85-4d0c-a567-9a0126efa236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:43.692065 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-76cc8575-4e85-4d0c-a567-9a0126efa236 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:26:43.693328 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-76cc8575-4e85-4d0c-a567-9a0126efa236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:43.719807 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:43.771824 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1384/2787] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:26:43.781429 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13030b-c0ba-4885-a47c-1d474ec42648 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:43.781622 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13030b-c0ba-4885-a47c-1d474ec42648 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:43.781870 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13030b-c0ba-4885-a47c-1d474ec42648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:43.802660 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-7b13030b-c0ba-4885-a47c-1d474ec42648 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:26:43.803931 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7b13030b-c0ba-4885-a47c-1d474ec42648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:43.815872 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1404/2788] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:26:43.817905 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc8575-4e85-4d0c-a567-9a0126efa236 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:43.828924 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc8575-4e85-4d0c-a567-9a0126efa236 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:43.835068 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120abb75-7ca8-4848-920e-8b67ea46c320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:43.835864 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120abb75-7ca8-4848-920e-8b67ea46c320 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:43.836146 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120abb75-7ca8-4848-920e-8b67ea46c320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:43.836417 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120abb75-7ca8-4848-920e-8b67ea46c320 admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:43.838071 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120abb75-7ca8-4848-920e-8b67ea46c320 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:26:43.838378 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120abb75-7ca8-4848-920e-8b67ea46c320 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:43.840196 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120abb75-7ca8-4848-920e-8b67ea46c320 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:43.852803 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1385/2789] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:26:43.857246 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b13030b-c0ba-4885-a47c-1d474ec42648 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:43.866623 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b13030b-c0ba-4885-a47c-1d474ec42648 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:43.871238 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7eecbe-e428-482c-81c2-315655416e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:43.871844 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7eecbe-e428-482c-81c2-315655416e7f admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:43.872103 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7eecbe-e428-482c-81c2-315655416e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:43.872371 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7eecbe-e428-482c-81c2-315655416e7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:43.873000 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7eecbe-e428-482c-81c2-315655416e7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:43.874953 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7eecbe-e428-482c-81c2-315655416e7f admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:43.906011 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1405/2790] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:26:43 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:26:43.911495 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120abb75-7ca8-4848-920e-8b67ea46c320 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:43.921424 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120abb75-7ca8-4848-920e-8b67ea46c320 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:43.979490 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda81156-7153-4478-9120-ed150abdaa7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:43.980094 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda81156-7153-4478-9120-ed150abdaa7c admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:43.980371 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda81156-7153-4478-9120-ed150abdaa7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:43.980635 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda81156-7153-4478-9120-ed150abdaa7c admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:43.981252 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda81156-7153-4478-9120-ed150abdaa7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:43.983234 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda81156-7153-4478-9120-ed150abdaa7c admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:44.005511 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1386/2791] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:26:43 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:26:44.010216 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7eecbe-e428-482c-81c2-315655416e7f admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:44.021128 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7eecbe-e428-482c-81c2-315655416e7f admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:44.026451 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97181291-28c6-4313-82cd-84c7d4cbd208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:44.027125 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97181291-28c6-4313-82cd-84c7d4cbd208 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:44.027405 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97181291-28c6-4313-82cd-84c7d4cbd208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:44.027675 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97181291-28c6-4313-82cd-84c7d4cbd208 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:44.028333 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97181291-28c6-4313-82cd-84c7d4cbd208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:44.029967 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97181291-28c6-4313-82cd-84c7d4cbd208 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:44.040367 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1406/2792] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:26:44.044676 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda81156-7153-4478-9120-ed150abdaa7c admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:44.055781 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda81156-7153-4478-9120-ed150abdaa7c admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:44.061071 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4d8a3-1950-4037-bbc6-7b0ff5e9594f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:44.061847 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4d8a3-1950-4037-bbc6-7b0ff5e9594f admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:44.062138 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4d8a3-1950-4037-bbc6-7b0ff5e9594f admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:44.062509 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4d8a3-1950-4037-bbc6-7b0ff5e9594f admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:44.063246 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4d8a3-1950-4037-bbc6-7b0ff5e9594f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:44.064969 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4d8a3-1950-4037-bbc6-7b0ff5e9594f admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:44.076428 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1387/2793] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:26:44.080869 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97181291-28c6-4313-82cd-84c7d4cbd208 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:44.091938 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97181291-28c6-4313-82cd-84c7d4cbd208 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:44.096560 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c3473-fc81-434b-bcd9-5bd84fef45a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:44.097216 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c3473-fc81-434b-bcd9-5bd84fef45a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:44.097494 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c3473-fc81-434b-bcd9-5bd84fef45a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:44.097768 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c3473-fc81-434b-bcd9-5bd84fef45a1 admin admin] PATH_INFO: `/v3/projects/bd15207b3f5e466c8fdaeca7bc034417/users/e7f7c4ae78ae45ab8a659b4327ca538d/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:44.114226 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44c3473-fc81-434b-bcd9-5bd84fef45a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd15207b3f5e466c8fdaeca7bc034417, user_id=e7f7c4ae78ae45ab8a659b4327ca538d, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:44.117580 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44c3473-fc81-434b-bcd9-5bd84fef45a1 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:44.131980 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1407/2794] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:26:44 2022] PUT /identity/v3/projects/bd15207b3f5e466c8fdaeca7bc034417/users/e7f7c4ae78ae45ab8a659b4327ca538d/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:26:44.137125 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a04e5d-e23d-431a-bbab-14bce7520803 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:44.137411 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a04e5d-e23d-431a-bbab-14bce7520803 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:44.137712 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a04e5d-e23d-431a-bbab-14bce7520803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:44.156735 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-38a04e5d-e23d-431a-bbab-14bce7520803 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:26:44.157869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-38a04e5d-e23d-431a-bbab-14bce7520803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:44.219976 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1388/2795] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:26:44.229902 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c3473-fc81-434b-bcd9-5bd84fef45a1 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:44.231685 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a44c3473-fc81-434b-bcd9-5bd84fef45a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:44.256881 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:44.295758 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c3473-fc81-434b-bcd9-5bd84fef45a1 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:44.300231 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df087769-4470-44f6-b6bf-c4c0088ce2f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:44.300839 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df087769-4470-44f6-b6bf-c4c0088ce2f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:44.301116 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df087769-4470-44f6-b6bf-c4c0088ce2f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:44.301383 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df087769-4470-44f6-b6bf-c4c0088ce2f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:44.311218 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df087769-4470-44f6-b6bf-c4c0088ce2f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:44.312761 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df087769-4470-44f6-b6bf-c4c0088ce2f4 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:44.323733 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1408/2796] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:26:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:26:44.998281 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31014f36-a87c-40eb-86fb-0312b618669e None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:44.998887 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31014f36-a87c-40eb-86fb-0312b618669e None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:44.998887 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31014f36-a87c-40eb-86fb-0312b618669e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:45.034488 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-31014f36-a87c-40eb-86fb-0312b618669e None None] MFA Rules not processed for user `e7f7c4ae78ae45ab8a659b4327ca538d`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:26:45.035761 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-31014f36-a87c-40eb-86fb-0312b618669e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:45.064146 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:45.146436 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1389/2797] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:26:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:26:45.159505 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df087769-4470-44f6-b6bf-c4c0088ce2f4 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:45.161127 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-df087769-4470-44f6-b6bf-c4c0088ce2f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:45.281234 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df087769-4470-44f6-b6bf-c4c0088ce2f4 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:45.285079 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eafe3f6-8f79-416e-9f0d-449a495af7d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:45.285592 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafe3f6-8f79-416e-9f0d-449a495af7d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:45.285866 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafe3f6-8f79-416e-9f0d-449a495af7d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:45.286133 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafe3f6-8f79-416e-9f0d-449a495af7d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:45.295986 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eafe3f6-8f79-416e-9f0d-449a495af7d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:45.297416 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eafe3f6-8f79-416e-9f0d-449a495af7d5 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:45.306943 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1409/2798] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:26:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:26:46.696169 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729e674-2844-4630-96ff-682588753a97 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:46.696743 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729e674-2844-4630-96ff-682588753a97 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:46.696743 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729e674-2844-4630-96ff-682588753a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:46.716355 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-5729e674-2844-4630-96ff-682588753a97 None None] MFA Rules not processed for user `e7f7c4ae78ae45ab8a659b4327ca538d`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:26:46.717659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-5729e674-2844-4630-96ff-682588753a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:46.724533 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1390/2799] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:26:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:26:51.025662 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eafe3f6-8f79-416e-9f0d-449a495af7d5 service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:51.027138 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2eafe3f6-8f79-416e-9f0d-449a495af7d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:51.043823 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eafe3f6-8f79-416e-9f0d-449a495af7d5 service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:51.049414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6aead5-4e84-4e29-8e88-b497349cdd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:51.050076 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6aead5-4e84-4e29-8e88-b497349cdd30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:51.050582 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6aead5-4e84-4e29-8e88-b497349cdd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:51.050961 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6aead5-4e84-4e29-8e88-b497349cdd30 admin admin] PATH_INFO: `/v3/users/237e2b3dba6f404094a5d8f8396a0d22` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:51.052410 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6aead5-4e84-4e29-8e88-b497349cdd30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=237e2b3dba6f404094a5d8f8396a0d22)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:51.055012 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6aead5-4e84-4e29-8e88-b497349cdd30 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:51.104724 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3f6aead5-4e84-4e29-8e88-b497349cdd30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '237e2b3dba6f404094a5d8f8396a0d22'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:26:51.112988 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3f6aead5-4e84-4e29-8e88-b497349cdd30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '237e2b3dba6f404094a5d8f8396a0d22'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:26:51.120584 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3f6aead5-4e84-4e29-8e88-b497349cdd30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '237e2b3dba6f404094a5d8f8396a0d22'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:26:51.135083 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3f6aead5-4e84-4e29-8e88-b497349cdd30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '237e2b3dba6f404094a5d8f8396a0d22'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:26:51.136082 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3f6aead5-4e84-4e29-8e88-b497349cdd30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '237e2b3dba6f404094a5d8f8396a0d22'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:26:51.145778 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1410/2800] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:26:51 2022] DELETE /identity/v3/users/237e2b3dba6f404094a5d8f8396a0d22 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:26:51.150319 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a0d28-d85d-4f3d-9583-a6ebfe63bbe7 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:51.150845 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a0d28-d85d-4f3d-9583-a6ebfe63bbe7 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:51.150955 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a0d28-d85d-4f3d-9583-a6ebfe63bbe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:51.169899 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-075a0d28-d85d-4f3d-9583-a6ebfe63bbe7 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:26:51.171216 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-075a0d28-d85d-4f3d-9583-a6ebfe63bbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:51.232956 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1391/2801] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:26:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:26:51.244948 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6aead5-4e84-4e29-8e88-b497349cdd30 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:51.247010 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3f6aead5-4e84-4e29-8e88-b497349cdd30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:51.270281 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:51.313300 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6aead5-4e84-4e29-8e88-b497349cdd30 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:51.317409 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea96d92-84f4-4d02-9f54-516487dd70e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:51.318204 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea96d92-84f4-4d02-9f54-516487dd70e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:51.318402 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea96d92-84f4-4d02-9f54-516487dd70e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:51.318730 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea96d92-84f4-4d02-9f54-516487dd70e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:51.328689 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea96d92-84f4-4d02-9f54-516487dd70e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:51.331086 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea96d92-84f4-4d02-9f54-516487dd70e4 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:51.342399 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1411/2802] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:26:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:26:51.634949 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a0d28-d85d-4f3d-9583-a6ebfe63bbe7 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:26:51.636507 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-075a0d28-d85d-4f3d-9583-a6ebfe63bbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:26:51.652229 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a0d28-d85d-4f3d-9583-a6ebfe63bbe7 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:26:51.657173 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3057d97-f4a2-4ca9-90db-73568e3bad8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:26:51.657905 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3057d97-f4a2-4ca9-90db-73568e3bad8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:26:51.658186 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3057d97-f4a2-4ca9-90db-73568e3bad8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:26:51.658478 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3057d97-f4a2-4ca9-90db-73568e3bad8d admin admin] PATH_INFO: `/v3/projects/f17b20836aa34a25a2a7c4951863ad22` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:26:51.661104 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3057d97-f4a2-4ca9-90db-73568e3bad8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f17b20836aa34a25a2a7c4951863ad22)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:26:51.663619 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3057d97-f4a2-4ca9-90db-73568e3bad8d admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:26:51.716336 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-c3057d97-f4a2-4ca9-90db-73568e3bad8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f17b20836aa34a25a2a7c4951863ad22', 'request_id': 'req-c3057d97-f4a2-4ca9-90db-73568e3bad8d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:26:51.722362 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-c3057d97-f4a2-4ca9-90db-73568e3bad8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f17b20836aa34a25a2a7c4951863ad22', 'request_id': 'req-c3057d97-f4a2-4ca9-90db-73568e3bad8d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:26:51.730340 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-c3057d97-f4a2-4ca9-90db-73568e3bad8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f17b20836aa34a25a2a7c4951863ad22', 'request_id': 'req-c3057d97-f4a2-4ca9-90db-73568e3bad8d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:26:51.744632 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-c3057d97-f4a2-4ca9-90db-73568e3bad8d admin admin] The token cache is being invalidate because project f17b20836aa34a25a2a7c4951863ad22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:26:51.744920 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-c3057d97-f4a2-4ca9-90db-73568e3bad8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:26:51.745571 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-c3057d97-f4a2-4ca9-90db-73568e3bad8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:26:51.747148 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1392/2803] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:26:51 2022] DELETE /identity/v3/projects/f17b20836aa34a25a2a7c4951863ad22 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:27:01.338004 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=18 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:27:01.741376 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:27:14.873373 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a41ab-d12c-4212-b29c-3e483b774bee None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:27:14.873949 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a41ab-d12c-4212-b29c-3e483b774bee None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:27:14.874083 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a41ab-d12c-4212-b29c-3e483b774bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:27:14.892951 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-934a41ab-d12c-4212-b29c-3e483b774bee None None] MFA Rules not processed for user `c23c732f628c487d89d79f4ed8088b0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:27:14.894149 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-934a41ab-d12c-4212-b29c-3e483b774bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:27:14.949240 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1412/2804] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:27:14 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:27:17.418508 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f19e5a-6d76-4785-bdf6-fe641a8e0142 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:27:17.419375 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f19e5a-6d76-4785-bdf6-fe641a8e0142 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:27:17.419835 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f19e5a-6d76-4785-bdf6-fe641a8e0142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:27:17.444064 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-b4f19e5a-6d76-4785-bdf6-fe641a8e0142 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:27:17.445466 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-b4f19e5a-6d76-4785-bdf6-fe641a8e0142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:27:17.518710 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1393/2805] 10.222.0.91 () {58 vars in 1016 bytes} [Wed Aug 31 19:27:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:27:17.536608 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a41ab-d12c-4212-b29c-3e483b774bee None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:27:17.539233 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-934a41ab-d12c-4212-b29c-3e483b774bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:27:17.628537 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a41ab-d12c-4212-b29c-3e483b774bee None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:27:17.635064 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261ac05-dbb2-485a-8b2a-8862526493b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:27:17.635676 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261ac05-dbb2-485a-8b2a-8862526493b5 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:27:17.635956 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261ac05-dbb2-485a-8b2a-8862526493b5 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:27:17.636227 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261ac05-dbb2-485a-8b2a-8862526493b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:27:17.644576 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261ac05-dbb2-485a-8b2a-8862526493b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:27:17.646211 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261ac05-dbb2-485a-8b2a-8862526493b5 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:27:17.658160 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1413/2806] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:27:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:27:20.421724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ac7a7-5f59-444f-8acd-62b977fa240e None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:27:20.422314 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ac7a7-5f59-444f-8acd-62b977fa240e None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:27:20.422314 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ac7a7-5f59-444f-8acd-62b977fa240e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:27:20.445150 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-d90ac7a7-5f59-444f-8acd-62b977fa240e None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:27:20.446385 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d90ac7a7-5f59-444f-8acd-62b977fa240e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:27:20.456600 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1394/2807] 10.222.0.91 () {58 vars in 1016 bytes} [Wed Aug 31 19:27:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:27:20.473901 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261ac05-dbb2-485a-8b2a-8862526493b5 service nova] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:27:20.475570 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f261ac05-dbb2-485a-8b2a-8862526493b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:27:20.492550 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261ac05-dbb2-485a-8b2a-8862526493b5 service nova] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:27:20.498671 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac865d2-32f3-4a68-bea3-d67816fb65dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:27:20.499354 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac865d2-32f3-4a68-bea3-d67816fb65dd service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:27:20.499701 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac865d2-32f3-4a68-bea3-d67816fb65dd service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:27:20.500065 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac865d2-32f3-4a68-bea3-d67816fb65dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:27:20.508847 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac865d2-32f3-4a68-bea3-d67816fb65dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:27:20.510428 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac865d2-32f3-4a68-bea3-d67816fb65dd service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:27:20.520230 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1414/2808] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:27:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:27:23.728228 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcded65-0302-4fa5-a289-7818b74b13b0 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:27:23.728799 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcded65-0302-4fa5-a289-7818b74b13b0 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:27:23.728799 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcded65-0302-4fa5-a289-7818b74b13b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:27:23.749642 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-edcded65-0302-4fa5-a289-7818b74b13b0 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:27:23.750867 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-edcded65-0302-4fa5-a289-7818b74b13b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:27:23.762826 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1395/2809] 10.222.0.91 () {58 vars in 1016 bytes} [Wed Aug 31 19:27:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:27:23.806577 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac865d2-32f3-4a68-bea3-d67816fb65dd service nova] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:27:23.818284 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac865d2-32f3-4a68-bea3-d67816fb65dd service nova] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:27:23.824179 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8140d2-2796-4062-8c99-3b4d0ca90d69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:27:23.824784 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8140d2-2796-4062-8c99-3b4d0ca90d69 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:27:23.825063 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8140d2-2796-4062-8c99-3b4d0ca90d69 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:27:23.825333 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8140d2-2796-4062-8c99-3b4d0ca90d69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:27:23.835171 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8140d2-2796-4062-8c99-3b4d0ca90d69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:27:23.837519 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8140d2-2796-4062-8c99-3b4d0ca90d69 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:27:23.847277 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1415/2810] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:27:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:27:26.844681 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eecf10-2043-4bb8-91f2-b1be323d7ba9 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:27:26.845263 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eecf10-2043-4bb8-91f2-b1be323d7ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:27:26.845263 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eecf10-2043-4bb8-91f2-b1be323d7ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:27:26.872038 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-61eecf10-2043-4bb8-91f2-b1be323d7ba9 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:27:26.873466 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-61eecf10-2043-4bb8-91f2-b1be323d7ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:27:26.884358 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1396/2811] 10.222.0.91 () {58 vars in 1016 bytes} [Wed Aug 31 19:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:27:26.911812 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8140d2-2796-4062-8c99-3b4d0ca90d69 service nova] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:27:26.926468 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8140d2-2796-4062-8c99-3b4d0ca90d69 service nova] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:27:26.939741 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1674f-dca1-467f-8b69-27e8922e0a3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:27:26.940473 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1674f-dca1-467f-8b69-27e8922e0a3d service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:27:26.941010 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1674f-dca1-467f-8b69-27e8922e0a3d service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:27:26.941358 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1674f-dca1-467f-8b69-27e8922e0a3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:27:26.951075 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd1674f-dca1-467f-8b69-27e8922e0a3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:27:26.953565 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd1674f-dca1-467f-8b69-27e8922e0a3d service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:27:26.976467 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1416/2812] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:27:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:27:30.009354 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc5208-b380-4132-b51b-b21f4f265bf4 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:27:30.009881 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc5208-b380-4132-b51b-b21f4f265bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:27:30.010118 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc5208-b380-4132-b51b-b21f4f265bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:27:30.037626 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-21bc5208-b380-4132-b51b-b21f4f265bf4 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:27:30.038873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-21bc5208-b380-4132-b51b-b21f4f265bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:27:30.047381 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1397/2813] 10.222.0.91 () {58 vars in 1016 bytes} [Wed Aug 31 19:27:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:27:30.063082 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1674f-dca1-467f-8b69-27e8922e0a3d service nova] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:27:30.074316 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1674f-dca1-467f-8b69-27e8922e0a3d service nova] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:27:30.080565 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b19eab9-d7c8-4ea3-82cf-924276e36b92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:27:30.081162 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19eab9-d7c8-4ea3-82cf-924276e36b92 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:27:30.081441 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19eab9-d7c8-4ea3-82cf-924276e36b92 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:27:30.081775 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19eab9-d7c8-4ea3-82cf-924276e36b92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:27:30.091481 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b19eab9-d7c8-4ea3-82cf-924276e36b92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:27:30.093090 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b19eab9-d7c8-4ea3-82cf-924276e36b92 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:27:30.103386 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1417/2814] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:27:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:27:33.176790 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0cdaa-ec45-4936-a636-f6ab24e7ec88 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:27:33.177321 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0cdaa-ec45-4936-a636-f6ab24e7ec88 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:27:33.177321 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0cdaa-ec45-4936-a636-f6ab24e7ec88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:27:33.200101 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-03b0cdaa-ec45-4936-a636-f6ab24e7ec88 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:27:33.201350 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-03b0cdaa-ec45-4936-a636-f6ab24e7ec88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:27:33.209324 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1398/2815] 10.222.0.91 () {58 vars in 1016 bytes} [Wed Aug 31 19:27:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:27:33.225330 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b19eab9-d7c8-4ea3-82cf-924276e36b92 service nova] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:27:33.236580 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b19eab9-d7c8-4ea3-82cf-924276e36b92 service nova] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:27:33.242698 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b0ad5-ca2f-4f52-9232-43cc85076b36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:27:33.243310 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b0ad5-ca2f-4f52-9232-43cc85076b36 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:27:33.243588 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b0ad5-ca2f-4f52-9232-43cc85076b36 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:27:33.243861 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b0ad5-ca2f-4f52-9232-43cc85076b36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:27:33.252756 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075b0ad5-ca2f-4f52-9232-43cc85076b36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:27:33.254333 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075b0ad5-ca2f-4f52-9232-43cc85076b36 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:27:33.266580 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1418/2816] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:27:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:27:43.198319 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=42 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:27:43.260133 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:27:49.600570 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c666a-d549-4601-b764-687d21386d48 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:27:49.601166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c666a-d549-4601-b764-687d21386d48 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:27:49.601166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c666a-d549-4601-b764-687d21386d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:27:49.621315 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-813c666a-d549-4601-b764-687d21386d48 None None] MFA Rules not processed for user `e7f7c4ae78ae45ab8a659b4327ca538d`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:27:49.622559 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-813c666a-d549-4601-b764-687d21386d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:27:49.679439 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1399/2817] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:27:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:27:50.276889 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b0ad5-ca2f-4f52-9232-43cc85076b36 service nova] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:27:50.278526 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-075b0ad5-ca2f-4f52-9232-43cc85076b36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:27:50.346266 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b0ad5-ca2f-4f52-9232-43cc85076b36 service nova] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:27:50.350055 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35282e2-99d2-4bdd-9dec-6fed88bdec4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:27:50.350714 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35282e2-99d2-4bdd-9dec-6fed88bdec4a service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:27:50.351001 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35282e2-99d2-4bdd-9dec-6fed88bdec4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:27:50.351281 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35282e2-99d2-4bdd-9dec-6fed88bdec4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:27:50.353096 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d35282e2-99d2-4bdd-9dec-6fed88bdec4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:27:50.368957 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35282e2-99d2-4bdd-9dec-6fed88bdec4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:27:50.370090 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35282e2-99d2-4bdd-9dec-6fed88bdec4a service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:27:50.382182 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1419/2818] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:27:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:27:53.931523 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c666a-d549-4601-b764-687d21386d48 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:27:53.932988 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-813c666a-d549-4601-b764-687d21386d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:27:53.946132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c666a-d549-4601-b764-687d21386d48 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:27:53.949855 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f9172-4d6f-493a-ab53-2acdd20c2c5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:27:53.950477 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f9172-4d6f-493a-ab53-2acdd20c2c5e service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:27:53.950762 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f9172-4d6f-493a-ab53-2acdd20c2c5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:27:53.951041 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f9172-4d6f-493a-ab53-2acdd20c2c5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:27:53.952768 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-755f9172-4d6f-493a-ab53-2acdd20c2c5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:27:53.967311 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f9172-4d6f-493a-ab53-2acdd20c2c5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:27:53.968741 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f9172-4d6f-493a-ab53-2acdd20c2c5e service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:27:53.979869 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1400/2819] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:27:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:28:00.376542 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=26 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:01.634932 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22a355-7aa8-4645-b78f-99c6e49dc3c1 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:01.635610 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22a355-7aa8-4645-b78f-99c6e49dc3c1 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:01.635610 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22a355-7aa8-4645-b78f-99c6e49dc3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:01.655082 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-1d22a355-7aa8-4645-b78f-99c6e49dc3c1 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:01.656298 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1d22a355-7aa8-4645-b78f-99c6e49dc3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:01.664558 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1420/2820] 10.222.0.91 () {58 vars in 1016 bytes} [Wed Aug 31 19:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:01.682049 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f9172-4d6f-493a-ab53-2acdd20c2c5e service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:01.693324 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f9172-4d6f-493a-ab53-2acdd20c2c5e service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:01.698793 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1b3ad-582b-4e61-850c-2db093d1d81c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:01.699390 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1b3ad-582b-4e61-850c-2db093d1d81c service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:01.699666 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1b3ad-582b-4e61-850c-2db093d1d81c service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:01.699935 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1b3ad-582b-4e61-850c-2db093d1d81c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:01.708160 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a1b3ad-582b-4e61-850c-2db093d1d81c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:01.709718 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a1b3ad-582b-4e61-850c-2db093d1d81c service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:01.719267 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1401/2821] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:28:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:28:04.930189 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e717d0c-dabc-4502-be4d-d2965c812239 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:04.930887 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e717d0c-dabc-4502-be4d-d2965c812239 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:04.931128 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e717d0c-dabc-4502-be4d-d2965c812239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:04.951212 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-3e717d0c-dabc-4502-be4d-d2965c812239 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:04.952419 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3e717d0c-dabc-4502-be4d-d2965c812239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:04.960489 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1421/2822] 10.222.0.91 () {58 vars in 1016 bytes} [Wed Aug 31 19:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:04.976027 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1b3ad-582b-4e61-850c-2db093d1d81c service nova] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:04.987473 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1b3ad-582b-4e61-850c-2db093d1d81c service nova] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:04.993512 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59ca64-ffc5-4ceb-8c73-6ef8115aa8ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:04.994112 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59ca64-ffc5-4ceb-8c73-6ef8115aa8ee service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:04.994392 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59ca64-ffc5-4ceb-8c73-6ef8115aa8ee service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:04.994759 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59ca64-ffc5-4ceb-8c73-6ef8115aa8ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:05.003005 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b59ca64-ffc5-4ceb-8c73-6ef8115aa8ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:05.004559 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b59ca64-ffc5-4ceb-8c73-6ef8115aa8ee service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:05.014327 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1402/2823] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:28:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:28:08.000550 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3608b8-5615-42b9-810b-7380c75a47eb None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:08.001123 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3608b8-5615-42b9-810b-7380c75a47eb None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:08.001123 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3608b8-5615-42b9-810b-7380c75a47eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:08.022547 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-0d3608b8-5615-42b9-810b-7380c75a47eb None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:08.023751 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0d3608b8-5615-42b9-810b-7380c75a47eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:08.032585 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1422/2824] 10.222.0.91 () {58 vars in 1016 bytes} [Wed Aug 31 19:28:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:08.056190 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59ca64-ffc5-4ceb-8c73-6ef8115aa8ee service nova] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:08.073971 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59ca64-ffc5-4ceb-8c73-6ef8115aa8ee service nova] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:08.080416 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb0ef1-e7f4-4a86-b696-8ed6d2da7de9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:08.081024 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb0ef1-e7f4-4a86-b696-8ed6d2da7de9 service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:08.081303 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb0ef1-e7f4-4a86-b696-8ed6d2da7de9 service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:08.081576 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb0ef1-e7f4-4a86-b696-8ed6d2da7de9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:08.090718 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb0ef1-e7f4-4a86-b696-8ed6d2da7de9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:08.092289 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb0ef1-e7f4-4a86-b696-8ed6d2da7de9 service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:08.102076 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1403/2825] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:28:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:28:11.157986 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be098c-1547-4fc1-856b-f20d9e36eb31 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:11.158495 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be098c-1547-4fc1-856b-f20d9e36eb31 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:11.158749 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be098c-1547-4fc1-856b-f20d9e36eb31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:11.180109 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-a3be098c-1547-4fc1-856b-f20d9e36eb31 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:11.181804 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a3be098c-1547-4fc1-856b-f20d9e36eb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:11.189815 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1423/2826] 10.222.0.91 () {58 vars in 1016 bytes} [Wed Aug 31 19:28:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:11.207187 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb0ef1-e7f4-4a86-b696-8ed6d2da7de9 service nova] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:11.218833 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb0ef1-e7f4-4a86-b696-8ed6d2da7de9 service nova] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:11.225931 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b92579-4604-43f6-86f0-364e0d4d08a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:11.226974 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b92579-4604-43f6-86f0-364e0d4d08a1 service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:11.227279 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b92579-4604-43f6-86f0-364e0d4d08a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:11.227627 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b92579-4604-43f6-86f0-364e0d4d08a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:11.236786 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b92579-4604-43f6-86f0-364e0d4d08a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:11.238345 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b92579-4604-43f6-86f0-364e0d4d08a1 service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:11.248817 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1404/2827] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:28:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:28:14.326774 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44b407-9028-4082-a987-0fc586d5df6c None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:14.327289 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44b407-9028-4082-a987-0fc586d5df6c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:14.327289 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44b407-9028-4082-a987-0fc586d5df6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:14.347423 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-6b44b407-9028-4082-a987-0fc586d5df6c None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:14.348653 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6b44b407-9028-4082-a987-0fc586d5df6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:14.357315 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1424/2828] 10.222.0.91 () {58 vars in 1016 bytes} [Wed Aug 31 19:28:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:14.375839 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b92579-4604-43f6-86f0-364e0d4d08a1 service nova] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:14.381329 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=56 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:14.388592 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b92579-4604-43f6-86f0-364e0d4d08a1 service nova] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:14.394053 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22849da2-ff4d-45d6-894e-6d6dbcd44e73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:14.394675 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22849da2-ff4d-45d6-894e-6d6dbcd44e73 service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:14.394951 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22849da2-ff4d-45d6-894e-6d6dbcd44e73 service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:14.395217 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22849da2-ff4d-45d6-894e-6d6dbcd44e73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:14.403707 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22849da2-ff4d-45d6-894e-6d6dbcd44e73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:14.405253 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22849da2-ff4d-45d6-894e-6d6dbcd44e73 service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:14.414319 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1405/2829] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:28:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:28:24.342103 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=15 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:24.410298 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=5 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:24.805800 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b44b407-9028-4082-a987-0fc586d5df6c None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:24.818883 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b44b407-9028-4082-a987-0fc586d5df6c None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:24.824387 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354afd5-5f83-436b-a893-311bc12d7c2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:24.825035 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354afd5-5f83-436b-a893-311bc12d7c2f service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:24.825309 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354afd5-5f83-436b-a893-311bc12d7c2f service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:24.826006 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354afd5-5f83-436b-a893-311bc12d7c2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:24.827509 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b354afd5-5f83-436b-a893-311bc12d7c2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:24.841159 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b354afd5-5f83-436b-a893-311bc12d7c2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:24.842775 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b354afd5-5f83-436b-a893-311bc12d7c2f service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:24.853976 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1425/2830] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:28:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:28:31.748664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c19d81-616c-4e02-a6d4-049d41af78f0 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:31.749165 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c19d81-616c-4e02-a6d4-049d41af78f0 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:31.749272 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c19d81-616c-4e02-a6d4-049d41af78f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:31.798817 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-43c19d81-616c-4e02-a6d4-049d41af78f0 None None] MFA Rules not processed for user `3e070c93f47045ecb5bf0a1622395091`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:31.800014 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-43c19d81-616c-4e02-a6d4-049d41af78f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:31.863207 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1406/2831] 10.222.0.79 () {58 vars in 1009 bytes} [Wed Aug 31 19:28:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:31.910781 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354afd5-5f83-436b-a893-311bc12d7c2f service nova] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:31.912166 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b354afd5-5f83-436b-a893-311bc12d7c2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:31.998880 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354afd5-5f83-436b-a893-311bc12d7c2f service nova] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:32.003794 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c799a2c-8743-4fd0-afc8-fcf29136997a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b289a0bef53460ca5173ad946394d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:32.004375 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c799a2c-8743-4fd0-afc8-fcf29136997a service swift] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:32.004655 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c799a2c-8743-4fd0-afc8-fcf29136997a service swift] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:32.004943 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c799a2c-8743-4fd0-afc8-fcf29136997a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:32.013562 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c799a2c-8743-4fd0-afc8-fcf29136997a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:32.015166 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c799a2c-8743-4fd0-afc8-fcf29136997a service swift] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:32.023293 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1426/2832] 10.222.0.79 () {60 vars in 1384 bytes} [Wed Aug 31 19:28:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:28:41.315583 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c19d81-616c-4e02-a6d4-049d41af78f0 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:41.325081 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c19d81-616c-4e02-a6d4-049d41af78f0 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:41.328640 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e0800-4703-4c5a-a5fe-3265925b5678 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:41.329241 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e0800-4703-4c5a-a5fe-3265925b5678 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:41.329520 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e0800-4703-4c5a-a5fe-3265925b5678 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:41.329902 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e0800-4703-4c5a-a5fe-3265925b5678 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:41.331602 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-368e0800-4703-4c5a-a5fe-3265925b5678 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:41.342065 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e0800-4703-4c5a-a5fe-3265925b5678 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:41.343518 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e0800-4703-4c5a-a5fe-3265925b5678 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:41.351850 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1407/2833] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:28:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:28:42.020129 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=47 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:43.690543 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c799a2c-8743-4fd0-afc8-fcf29136997a service swift] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:43.692021 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8c799a2c-8743-4fd0-afc8-fcf29136997a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:43.706383 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c799a2c-8743-4fd0-afc8-fcf29136997a service swift] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:43.711271 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e74d5c2-9ec3-4340-9045-deeadda0d21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:43.712460 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74d5c2-9ec3-4340-9045-deeadda0d21d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:43.712765 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74d5c2-9ec3-4340-9045-deeadda0d21d admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:43.713037 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74d5c2-9ec3-4340-9045-deeadda0d21d admin admin] PATH_INFO: `/v3/users/e7f7c4ae78ae45ab8a659b4327ca538d` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:43.714165 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e74d5c2-9ec3-4340-9045-deeadda0d21d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7f7c4ae78ae45ab8a659b4327ca538d)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:43.716111 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e74d5c2-9ec3-4340-9045-deeadda0d21d admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:43.762791 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1e74d5c2-9ec3-4340-9045-deeadda0d21d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7f7c4ae78ae45ab8a659b4327ca538d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:43.770276 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1e74d5c2-9ec3-4340-9045-deeadda0d21d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7f7c4ae78ae45ab8a659b4327ca538d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:43.777847 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1e74d5c2-9ec3-4340-9045-deeadda0d21d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7f7c4ae78ae45ab8a659b4327ca538d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:43.789405 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1e74d5c2-9ec3-4340-9045-deeadda0d21d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7f7c4ae78ae45ab8a659b4327ca538d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:43.790040 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1e74d5c2-9ec3-4340-9045-deeadda0d21d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7f7c4ae78ae45ab8a659b4327ca538d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:43.795894 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1427/2834] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:28:43 2022] DELETE /identity/v3/users/e7f7c4ae78ae45ab8a659b4327ca538d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:28:43.980759 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e0800-4703-4c5a-a5fe-3265925b5678 service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:43.992187 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e0800-4703-4c5a-a5fe-3265925b5678 service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:44.049116 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ab615-4853-4ec7-adac-3571eb2ba911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:44.049662 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ab615-4853-4ec7-adac-3571eb2ba911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:44.049936 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ab615-4853-4ec7-adac-3571eb2ba911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:44.050205 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ab615-4853-4ec7-adac-3571eb2ba911 admin admin] PATH_INFO: `/v3/projects/bd15207b3f5e466c8fdaeca7bc034417` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:44.051357 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ab615-4853-4ec7-adac-3571eb2ba911 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd15207b3f5e466c8fdaeca7bc034417)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:44.053229 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ab615-4853-4ec7-adac-3571eb2ba911 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:44.098856 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-c39ab615-4853-4ec7-adac-3571eb2ba911 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd15207b3f5e466c8fdaeca7bc034417', 'request_id': 'req-c39ab615-4853-4ec7-adac-3571eb2ba911'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:44.104325 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-c39ab615-4853-4ec7-adac-3571eb2ba911 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd15207b3f5e466c8fdaeca7bc034417', 'request_id': 'req-c39ab615-4853-4ec7-adac-3571eb2ba911'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:44.106159 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:44.110726 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-c39ab615-4853-4ec7-adac-3571eb2ba911 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd15207b3f5e466c8fdaeca7bc034417', 'request_id': 'req-c39ab615-4853-4ec7-adac-3571eb2ba911'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:44.123906 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-c39ab615-4853-4ec7-adac-3571eb2ba911 admin admin] The token cache is being invalidate because project bd15207b3f5e466c8fdaeca7bc034417 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:28:44.124197 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-c39ab615-4853-4ec7-adac-3571eb2ba911 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:44.124817 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-c39ab615-4853-4ec7-adac-3571eb2ba911 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:28:44.126322 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1408/2835] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:28:43 2022] DELETE /identity/v3/projects/bd15207b3f5e466c8fdaeca7bc034417 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:28:45.403150 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e74d5c2-9ec3-4340-9045-deeadda0d21d admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:45.404993 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1e74d5c2-9ec3-4340-9045-deeadda0d21d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:45.429171 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ab615-4853-4ec7-adac-3571eb2ba911 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:45.430756 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-c39ab615-4853-4ec7-adac-3571eb2ba911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:45.491075 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e74d5c2-9ec3-4340-9045-deeadda0d21d admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:45.508196 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ab615-4853-4ec7-adac-3571eb2ba911 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:45.513929 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f316660-3399-40b4-93cc-484c360f5ae5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece00ea631594381bf1c27cfc2ece6f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:45.514569 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f316660-3399-40b4-93cc-484c360f5ae5 service placement] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:45.514850 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f316660-3399-40b4-93cc-484c360f5ae5 service placement] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:45.515123 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f316660-3399-40b4-93cc-484c360f5ae5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:45.516850 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-4f316660-3399-40b4-93cc-484c360f5ae5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:45.528915 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f316660-3399-40b4-93cc-484c360f5ae5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:45.530523 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f316660-3399-40b4-93cc-484c360f5ae5 service placement] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:45.541135 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1409/2836] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:28:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:28:45.561342 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5fe96-e3ef-4b50-8e49-93f3213a24ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fd6d45d1bc3479da72cb1a1990a6137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:45.561982 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5fe96-e3ef-4b50-8e49-93f3213a24ce service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:45.562399 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5fe96-e3ef-4b50-8e49-93f3213a24ce service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:45.562717 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5fe96-e3ef-4b50-8e49-93f3213a24ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:45.564439 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c1b5fe96-e3ef-4b50-8e49-93f3213a24ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:45.574283 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:45.576868 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b5fe96-e3ef-4b50-8e49-93f3213a24ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:45.579061 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b5fe96-e3ef-4b50-8e49-93f3213a24ce service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:45.591761 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1428/2837] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:28:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:28:47.054310 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72967b85-1591-4580-818f-f3b15f0f31c9 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:47.054785 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72967b85-1591-4580-818f-f3b15f0f31c9 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:47.054879 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72967b85-1591-4580-818f-f3b15f0f31c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:47.074992 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-72967b85-1591-4580-818f-f3b15f0f31c9 None None] MFA Rules not processed for user `3e070c93f47045ecb5bf0a1622395091`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:28:47.076183 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-72967b85-1591-4580-818f-f3b15f0f31c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:47.129571 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1410/2838] 10.222.0.79 () {58 vars in 1009 bytes} [Wed Aug 31 19:28:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:28:47.141838 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5fe96-e3ef-4b50-8e49-93f3213a24ce service nova] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:28:47.143243 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c1b5fe96-e3ef-4b50-8e49-93f3213a24ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:28:47.210075 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5fe96-e3ef-4b50-8e49-93f3213a24ce service nova] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:28:47.215693 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85bc047-57f9-43ec-83c4-01d62af29051 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b289a0bef53460ca5173ad946394d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:28:47.216327 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85bc047-57f9-43ec-83c4-01d62af29051 service swift] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:28:47.216608 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85bc047-57f9-43ec-83c4-01d62af29051 service swift] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:28:47.216882 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85bc047-57f9-43ec-83c4-01d62af29051 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:28:47.224908 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85bc047-57f9-43ec-83c4-01d62af29051 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:28:47.226508 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85bc047-57f9-43ec-83c4-01d62af29051 service swift] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:28:47.234378 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1429/2839] 10.222.0.79 () {60 vars in 1384 bytes} [Wed Aug 31 19:28:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:28:57.122856 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=60,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:57.231243 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=34 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:02.883481 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04086712-f3ed-40d6-9688-12cd93adc8ab None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:02.884204 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04086712-f3ed-40d6-9688-12cd93adc8ab None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:02.884204 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04086712-f3ed-40d6-9688-12cd93adc8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:02.903521 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-04086712-f3ed-40d6-9688-12cd93adc8ab None None] MFA Rules not processed for user `3e070c93f47045ecb5bf0a1622395091`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:02.904768 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-04086712-f3ed-40d6-9688-12cd93adc8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:02.911964 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1411/2840] 10.222.0.79 () {58 vars in 967 bytes} [Wed Aug 31 19:29:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:02.924124 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85bc047-57f9-43ec-83c4-01d62af29051 service swift] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:02.935260 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85bc047-57f9-43ec-83c4-01d62af29051 service swift] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:02.940288 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465dc9c6-c0f8-44b4-acc5-487372bb2df8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b289a0bef53460ca5173ad946394d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:02.940886 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465dc9c6-c0f8-44b4-acc5-487372bb2df8 service swift] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:02.941165 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465dc9c6-c0f8-44b4-acc5-487372bb2df8 service swift] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:02.941439 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465dc9c6-c0f8-44b4-acc5-487372bb2df8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:02.950188 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465dc9c6-c0f8-44b4-acc5-487372bb2df8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:02.951830 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465dc9c6-c0f8-44b4-acc5-487372bb2df8 service swift] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:02.959706 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1430/2841] 10.222.0.79 () {60 vars in 1384 bytes} [Wed Aug 31 19:29:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 19:29:12.898117 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:12.956542 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=6 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:37.778437 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04086712-f3ed-40d6-9688-12cd93adc8ab None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:37.779873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-04086712-f3ed-40d6-9688-12cd93adc8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:37.841872 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04086712-f3ed-40d6-9688-12cd93adc8ab None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:37.846876 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b38a2-e19e-45d7-91db-04e05297398a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:37.847485 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b38a2-e19e-45d7-91db-04e05297398a service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:37.847756 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b38a2-e19e-45d7-91db-04e05297398a service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:37.848022 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b38a2-e19e-45d7-91db-04e05297398a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:37.851320 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d60b38a2-e19e-45d7-91db-04e05297398a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:37.914234 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b38a2-e19e-45d7-91db-04e05297398a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:37.915709 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b38a2-e19e-45d7-91db-04e05297398a service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:37.926684 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1412/2842] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:37 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:29:44.852093 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465dc9c6-c0f8-44b4-acc5-487372bb2df8 service swift] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:44.853513 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-465dc9c6-c0f8-44b4-acc5-487372bb2df8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:44.909787 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465dc9c6-c0f8-44b4-acc5-487372bb2df8 service swift] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:44.913325 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab435ffb-658c-402e-9b99-4ec4fca8f09e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:44.913925 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab435ffb-658c-402e-9b99-4ec4fca8f09e service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:44.914207 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab435ffb-658c-402e-9b99-4ec4fca8f09e service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:44.914539 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab435ffb-658c-402e-9b99-4ec4fca8f09e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:44.916238 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ab435ffb-658c-402e-9b99-4ec4fca8f09e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:44.978489 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab435ffb-658c-402e-9b99-4ec4fca8f09e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:44.979945 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab435ffb-658c-402e-9b99-4ec4fca8f09e service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:44.989581 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1431/2843] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:29:47.921627 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=48 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:48.146150 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b38a2-e19e-45d7-91db-04e05297398a service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:48.147894 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d60b38a2-e19e-45d7-91db-04e05297398a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:48.163121 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b38a2-e19e-45d7-91db-04e05297398a service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:48.167664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3c745-9460-404e-b69a-fcbc52fffc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:48.168298 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3c745-9460-404e-b69a-fcbc52fffc74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:48.169092 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3c745-9460-404e-b69a-fcbc52fffc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:48.169367 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3c745-9460-404e-b69a-fcbc52fffc74 admin admin] PATH_INFO: `/v3/users/c23c732f628c487d89d79f4ed8088b0b` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:48.170509 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3c745-9460-404e-b69a-fcbc52fffc74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c23c732f628c487d89d79f4ed8088b0b)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:48.172415 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3c745-9460-404e-b69a-fcbc52fffc74 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:48.218335 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-45c3c745-9460-404e-b69a-fcbc52fffc74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c23c732f628c487d89d79f4ed8088b0b'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:48.219020 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-45c3c745-9460-404e-b69a-fcbc52fffc74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c23c732f628c487d89d79f4ed8088b0b'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:48.230533 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-45c3c745-9460-404e-b69a-fcbc52fffc74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c23c732f628c487d89d79f4ed8088b0b'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:48.238331 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-45c3c745-9460-404e-b69a-fcbc52fffc74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c23c732f628c487d89d79f4ed8088b0b'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:48.245052 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-45c3c745-9460-404e-b69a-fcbc52fffc74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c23c732f628c487d89d79f4ed8088b0b'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:48.251637 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1413/2844] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:29:48 2022] DELETE /identity/v3/users/c23c732f628c487d89d79f4ed8088b0b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:48.428016 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab435ffb-658c-402e-9b99-4ec4fca8f09e service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:48.438577 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab435ffb-658c-402e-9b99-4ec4fca8f09e service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:48.496579 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0bb5b-51b3-4b46-9295-97191d063414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:48.497242 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0bb5b-51b3-4b46-9295-97191d063414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:48.497524 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0bb5b-51b3-4b46-9295-97191d063414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:48.497801 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0bb5b-51b3-4b46-9295-97191d063414 admin admin] PATH_INFO: `/v3/projects/d3a26f4a19614684b02f8484836330b7` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:48.498969 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b0bb5b-51b3-4b46-9295-97191d063414 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3a26f4a19614684b02f8484836330b7)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:48.500866 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b0bb5b-51b3-4b46-9295-97191d063414 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:48.552526 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-21b0bb5b-51b3-4b46-9295-97191d063414 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3a26f4a19614684b02f8484836330b7', 'request_id': 'req-21b0bb5b-51b3-4b46-9295-97191d063414'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:48.554408 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:48.558787 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-21b0bb5b-51b3-4b46-9295-97191d063414 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3a26f4a19614684b02f8484836330b7', 'request_id': 'req-21b0bb5b-51b3-4b46-9295-97191d063414'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:48.565074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-21b0bb5b-51b3-4b46-9295-97191d063414 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3a26f4a19614684b02f8484836330b7', 'request_id': 'req-21b0bb5b-51b3-4b46-9295-97191d063414'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:48.577222 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-21b0bb5b-51b3-4b46-9295-97191d063414 admin admin] The token cache is being invalidate because project d3a26f4a19614684b02f8484836330b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:29:48.577510 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-21b0bb5b-51b3-4b46-9295-97191d063414 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:48.578126 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-21b0bb5b-51b3-4b46-9295-97191d063414 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:48.579641 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1432/2845] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:29:48 2022] DELETE /identity/v3/projects/d3a26f4a19614684b02f8484836330b7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:48.584760 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554f26c-7228-4f6b-a792-60e2237eb7f8 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:48.585047 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554f26c-7228-4f6b-a792-60e2237eb7f8 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:48.585321 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554f26c-7228-4f6b-a792-60e2237eb7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:48.605713 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-b554f26c-7228-4f6b-a792-60e2237eb7f8 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:48.607505 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-b554f26c-7228-4f6b-a792-60e2237eb7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:48.664763 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1414/2846] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:29:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:48.673508 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be099c-ce90-4ccf-b0b1-c3d560d044ae None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:48.673798 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be099c-ce90-4ccf-b0b1-c3d560d044ae None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:48.674077 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be099c-ce90-4ccf-b0b1-c3d560d044ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:48.694545 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-93be099c-ce90-4ccf-b0b1-c3d560d044ae None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:48.695744 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-93be099c-ce90-4ccf-b0b1-c3d560d044ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:48.704040 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1433/2847] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:29:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:48.708051 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554f26c-7228-4f6b-a792-60e2237eb7f8 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:48.718478 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554f26c-7228-4f6b-a792-60e2237eb7f8 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:48.723125 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727cdcb9-0c84-415b-b8c5-dd148584b151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:48.723714 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cdcb9-0c84-415b-b8c5-dd148584b151 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:48.723990 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cdcb9-0c84-415b-b8c5-dd148584b151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:48.724260 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cdcb9-0c84-415b-b8c5-dd148584b151 admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:48.724899 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727cdcb9-0c84-415b-b8c5-dd148584b151 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:29:48.725200 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727cdcb9-0c84-415b-b8c5-dd148584b151 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:48.726816 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727cdcb9-0c84-415b-b8c5-dd148584b151 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:48.739361 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1415/2848] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:29:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:29:48.743773 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be099c-ce90-4ccf-b0b1-c3d560d044ae None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:48.756024 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be099c-ce90-4ccf-b0b1-c3d560d044ae None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:48.760677 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0cb7f-86ff-4f2f-b910-b2e448e6cf93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:48.761294 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0cb7f-86ff-4f2f-b910-b2e448e6cf93 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:48.761886 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0cb7f-86ff-4f2f-b910-b2e448e6cf93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:48.762022 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0cb7f-86ff-4f2f-b910-b2e448e6cf93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:48.763233 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0cb7f-86ff-4f2f-b910-b2e448e6cf93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:48.765120 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0cb7f-86ff-4f2f-b910-b2e448e6cf93 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:48.801578 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1434/2849] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:29:48 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:48.805745 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727cdcb9-0c84-415b-b8c5-dd148584b151 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:48.815532 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727cdcb9-0c84-415b-b8c5-dd148584b151 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:48.871186 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee3596-d3d9-4dd4-bdb9-04a111596a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:48.871711 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee3596-d3d9-4dd4-bdb9-04a111596a27 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:48.871991 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee3596-d3d9-4dd4-bdb9-04a111596a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:48.872262 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee3596-d3d9-4dd4-bdb9-04a111596a27 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:48.872880 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee3596-d3d9-4dd4-bdb9-04a111596a27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:48.874798 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee3596-d3d9-4dd4-bdb9-04a111596a27 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:48.882665 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:48.896765 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1416/2850] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:29:48 2022] POST /identity/v3/users => generated 283 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:48.900937 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0cb7f-86ff-4f2f-b910-b2e448e6cf93 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:48.912594 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0cb7f-86ff-4f2f-b910-b2e448e6cf93 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:48.917862 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625caef9-8349-48b7-b71f-ea04f51d5704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:48.918623 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625caef9-8349-48b7-b71f-ea04f51d5704 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:48.918891 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625caef9-8349-48b7-b71f-ea04f51d5704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:48.919159 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625caef9-8349-48b7-b71f-ea04f51d5704 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:48.919859 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625caef9-8349-48b7-b71f-ea04f51d5704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:48.921535 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625caef9-8349-48b7-b71f-ea04f51d5704 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:48.931719 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1435/2851] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:29:48.935837 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee3596-d3d9-4dd4-bdb9-04a111596a27 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:48.945919 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee3596-d3d9-4dd4-bdb9-04a111596a27 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:48.951006 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259f934-3968-4b91-8444-e7666ed35a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:48.951594 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259f934-3968-4b91-8444-e7666ed35a5f admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:48.951870 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259f934-3968-4b91-8444-e7666ed35a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:48.952139 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259f934-3968-4b91-8444-e7666ed35a5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:48.952776 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2259f934-3968-4b91-8444-e7666ed35a5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:48.954333 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2259f934-3968-4b91-8444-e7666ed35a5f admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:48.966531 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1417/2852] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:48.970756 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625caef9-8349-48b7-b71f-ea04f51d5704 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:48.980483 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625caef9-8349-48b7-b71f-ea04f51d5704 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:48.984933 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadbaf3-9845-4b94-8eb7-20fb2594cafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:48.985567 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadbaf3-9845-4b94-8eb7-20fb2594cafe admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:48.985838 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadbaf3-9845-4b94-8eb7-20fb2594cafe admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:48.986106 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadbaf3-9845-4b94-8eb7-20fb2594cafe admin admin] PATH_INFO: `/v3/projects/76b86338056d48f2a57979d3c076a92e/users/e6cf2891fb874ac7a5e7fadcfc50c5f5/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:49.000637 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dadbaf3-9845-4b94-8eb7-20fb2594cafe admin admin] RBAC: Authorizing `identity:create_grant(project_id=76b86338056d48f2a57979d3c076a92e, user_id=e6cf2891fb874ac7a5e7fadcfc50c5f5, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:49.003298 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dadbaf3-9845-4b94-8eb7-20fb2594cafe admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:49.017016 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1436/2853] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:29:48 2022] PUT /identity/v3/projects/76b86338056d48f2a57979d3c076a92e/users/e6cf2891fb874ac7a5e7fadcfc50c5f5/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:49.029442 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518e086-6fb2-4e6d-8f29-541cbad37974 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:49.029728 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518e086-6fb2-4e6d-8f29-541cbad37974 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:49.030140 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518e086-6fb2-4e6d-8f29-541cbad37974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:49.058560 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-1518e086-6fb2-4e6d-8f29-541cbad37974 None None] MFA Rules not processed for user `e6cf2891fb874ac7a5e7fadcfc50c5f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:49.059786 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1518e086-6fb2-4e6d-8f29-541cbad37974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:49.122592 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1418/2854] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:29:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:49.133270 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadbaf3-9845-4b94-8eb7-20fb2594cafe admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:49.135008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7dadbaf3-9845-4b94-8eb7-20fb2594cafe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:49.194229 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadbaf3-9845-4b94-8eb7-20fb2594cafe admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:49.197853 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc51fe0-6a1d-4e6d-99d9-84f48fceb1f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:49.198447 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc51fe0-6a1d-4e6d-99d9-84f48fceb1f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:49.198745 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc51fe0-6a1d-4e6d-99d9-84f48fceb1f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:49.199014 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc51fe0-6a1d-4e6d-99d9-84f48fceb1f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:49.207583 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc51fe0-6a1d-4e6d-99d9-84f48fceb1f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:49.209000 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc51fe0-6a1d-4e6d-99d9-84f48fceb1f8 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:49.217776 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1437/2855] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:29:57.625264 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1518e086-6fb2-4e6d-8f29-541cbad37974 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:57.689132 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1518e086-6fb2-4e6d-8f29-541cbad37974 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:57.693651 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26679f97-8bfd-4d6a-b158-23e91b9e9081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:57.694862 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26679f97-8bfd-4d6a-b158-23e91b9e9081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:57.695140 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26679f97-8bfd-4d6a-b158-23e91b9e9081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:57.695413 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26679f97-8bfd-4d6a-b158-23e91b9e9081 admin admin] PATH_INFO: `/v3/users/e6cf2891fb874ac7a5e7fadcfc50c5f5` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:57.696553 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26679f97-8bfd-4d6a-b158-23e91b9e9081 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6cf2891fb874ac7a5e7fadcfc50c5f5)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:57.698531 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26679f97-8bfd-4d6a-b158-23e91b9e9081 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:57.748262 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-26679f97-8bfd-4d6a-b158-23e91b9e9081 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6cf2891fb874ac7a5e7fadcfc50c5f5'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:57.748930 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-26679f97-8bfd-4d6a-b158-23e91b9e9081 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6cf2891fb874ac7a5e7fadcfc50c5f5'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:57.761303 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-26679f97-8bfd-4d6a-b158-23e91b9e9081 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6cf2891fb874ac7a5e7fadcfc50c5f5'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:57.766315 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:INSERT=3,keystone:SELECT=88,keystone:DELETE=9 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:57.770703 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-26679f97-8bfd-4d6a-b158-23e91b9e9081 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6cf2891fb874ac7a5e7fadcfc50c5f5'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:57.779175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-26679f97-8bfd-4d6a-b158-23e91b9e9081 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6cf2891fb874ac7a5e7fadcfc50c5f5'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:57.785176 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1419/2856] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:29:57 2022] DELETE /identity/v3/users/e6cf2891fb874ac7a5e7fadcfc50c5f5 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:57.789728 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d76e6b-69c5-451b-ac84-6e9af4f838b0 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:57.790252 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d76e6b-69c5-451b-ac84-6e9af4f838b0 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:57.790252 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d76e6b-69c5-451b-ac84-6e9af4f838b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:57.810907 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-52d76e6b-69c5-451b-ac84-6e9af4f838b0 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:57.812114 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-52d76e6b-69c5-451b-ac84-6e9af4f838b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:57.870609 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1438/2857] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:57.881212 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26679f97-8bfd-4d6a-b158-23e91b9e9081 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:57.882646 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-26679f97-8bfd-4d6a-b158-23e91b9e9081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:57.941795 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26679f97-8bfd-4d6a-b158-23e91b9e9081 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:57.945473 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a194fec-5518-4320-b151-205d05ecbd31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:57.946077 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a194fec-5518-4320-b151-205d05ecbd31 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:57.946352 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a194fec-5518-4320-b151-205d05ecbd31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:57.946667 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a194fec-5518-4320-b151-205d05ecbd31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:57.956100 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a194fec-5518-4320-b151-205d05ecbd31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:57.957511 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a194fec-5518-4320-b151-205d05ecbd31 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:57.967093 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1420/2858] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:29:58.238393 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d76e6b-69c5-451b-ac84-6e9af4f838b0 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:58.239927 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-52d76e6b-69c5-451b-ac84-6e9af4f838b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:58.252573 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d76e6b-69c5-451b-ac84-6e9af4f838b0 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:58.257175 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58420211-9ac2-41bd-8c05-33280aabd396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:58.257908 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58420211-9ac2-41bd-8c05-33280aabd396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:58.258082 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58420211-9ac2-41bd-8c05-33280aabd396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:58.258353 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58420211-9ac2-41bd-8c05-33280aabd396 admin admin] PATH_INFO: `/v3/projects/76b86338056d48f2a57979d3c076a92e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:58.259506 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58420211-9ac2-41bd-8c05-33280aabd396 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76b86338056d48f2a57979d3c076a92e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:58.262105 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58420211-9ac2-41bd-8c05-33280aabd396 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:58.268687 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:58.314605 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-58420211-9ac2-41bd-8c05-33280aabd396 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76b86338056d48f2a57979d3c076a92e', 'request_id': 'req-58420211-9ac2-41bd-8c05-33280aabd396'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:58.320172 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-58420211-9ac2-41bd-8c05-33280aabd396 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76b86338056d48f2a57979d3c076a92e', 'request_id': 'req-58420211-9ac2-41bd-8c05-33280aabd396'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:58.326329 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-58420211-9ac2-41bd-8c05-33280aabd396 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76b86338056d48f2a57979d3c076a92e', 'request_id': 'req-58420211-9ac2-41bd-8c05-33280aabd396'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:58.339307 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-58420211-9ac2-41bd-8c05-33280aabd396 admin admin] The token cache is being invalidate because project 76b86338056d48f2a57979d3c076a92e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:29:58.339307 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-58420211-9ac2-41bd-8c05-33280aabd396 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:58.340205 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-58420211-9ac2-41bd-8c05-33280aabd396 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:29:58.342165 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1439/2859] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:29:58 2022] DELETE /identity/v3/projects/76b86338056d48f2a57979d3c076a92e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:29:58.347426 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8be49-b7e4-423e-81e8-680efae8848b None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:58.347706 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8be49-b7e4-423e-81e8-680efae8848b None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:58.347975 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8be49-b7e4-423e-81e8-680efae8848b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:58.368676 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-a7e8be49-b7e4-423e-81e8-680efae8848b None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:58.369699 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-a7e8be49-b7e4-423e-81e8-680efae8848b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:58.431370 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1421/2860] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:58.439431 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b02d0-b90e-42a2-8b72-0f0fb0d4bc8e None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:58.439953 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b02d0-b90e-42a2-8b72-0f0fb0d4bc8e None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:58.440874 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b02d0-b90e-42a2-8b72-0f0fb0d4bc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:58.462234 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-a47b02d0-b90e-42a2-8b72-0f0fb0d4bc8e None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:58.463448 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a47b02d0-b90e-42a2-8b72-0f0fb0d4bc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:58.472156 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1440/2861] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:58.476420 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8be49-b7e4-423e-81e8-680efae8848b None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:58.486875 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8be49-b7e4-423e-81e8-680efae8848b None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:58.491559 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b04890-7847-4ff2-94fc-38027cb80860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:58.492153 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b04890-7847-4ff2-94fc-38027cb80860 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:58.492432 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b04890-7847-4ff2-94fc-38027cb80860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:58.492701 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b04890-7847-4ff2-94fc-38027cb80860 admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:58.493338 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b04890-7847-4ff2-94fc-38027cb80860 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:29:58.493637 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b04890-7847-4ff2-94fc-38027cb80860 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:58.495247 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b04890-7847-4ff2-94fc-38027cb80860 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:58.506917 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1422/2862] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 19:29:58.511372 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b02d0-b90e-42a2-8b72-0f0fb0d4bc8e None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:58.521264 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b02d0-b90e-42a2-8b72-0f0fb0d4bc8e None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:58.526008 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a967cb8-f2fa-418c-99c0-01855b827cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:58.526646 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a967cb8-f2fa-418c-99c0-01855b827cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:58.526930 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a967cb8-f2fa-418c-99c0-01855b827cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:58.527199 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a967cb8-f2fa-418c-99c0-01855b827cb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:58.528002 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a967cb8-f2fa-418c-99c0-01855b827cb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:58.530862 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a967cb8-f2fa-418c-99c0-01855b827cb6 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:58.558638 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1441/2863] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:29:58 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:58.566205 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b04890-7847-4ff2-94fc-38027cb80860 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:58.577832 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b04890-7847-4ff2-94fc-38027cb80860 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:58.632844 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f083c58-8589-4d24-a19c-37b3f96619ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:58.633569 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f083c58-8589-4d24-a19c-37b3f96619ea admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:58.633688 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f083c58-8589-4d24-a19c-37b3f96619ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:58.633952 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f083c58-8589-4d24-a19c-37b3f96619ea admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:58.634594 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f083c58-8589-4d24-a19c-37b3f96619ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:58.636474 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f083c58-8589-4d24-a19c-37b3f96619ea admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:58.659550 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1423/2864] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:29:58 2022] POST /identity/v3/users => generated 283 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:58.663761 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a967cb8-f2fa-418c-99c0-01855b827cb6 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:58.674041 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a967cb8-f2fa-418c-99c0-01855b827cb6 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:58.678667 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996567d-530b-4054-8dbc-57963bb167b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:58.679269 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996567d-530b-4054-8dbc-57963bb167b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:58.679548 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996567d-530b-4054-8dbc-57963bb167b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:58.679818 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996567d-530b-4054-8dbc-57963bb167b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:58.680459 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996567d-530b-4054-8dbc-57963bb167b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:58.682137 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996567d-530b-4054-8dbc-57963bb167b4 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:58.692592 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1442/2865] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:58.697005 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f083c58-8589-4d24-a19c-37b3f96619ea admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:58.707873 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f083c58-8589-4d24-a19c-37b3f96619ea admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:58.712856 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6eb11d-6ce3-4922-a943-57c580c1aabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:58.713453 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6eb11d-6ce3-4922-a943-57c580c1aabd admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:58.713731 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6eb11d-6ce3-4922-a943-57c580c1aabd admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:58.714000 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6eb11d-6ce3-4922-a943-57c580c1aabd admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:58.714666 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6eb11d-6ce3-4922-a943-57c580c1aabd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:58.716864 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6eb11d-6ce3-4922-a943-57c580c1aabd admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:58.718166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:58.729638 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1424/2866] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:58.734089 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996567d-530b-4054-8dbc-57963bb167b4 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:58.744281 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996567d-530b-4054-8dbc-57963bb167b4 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:58.749071 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a872082-b354-444c-893d-1e9480bbe4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:58.749723 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a872082-b354-444c-893d-1e9480bbe4f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:58.750000 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a872082-b354-444c-893d-1e9480bbe4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:58.750273 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a872082-b354-444c-893d-1e9480bbe4f4 admin admin] PATH_INFO: `/v3/projects/37c1c9fc860149ae96e1b3d780b17213/users/882010e30b2f429481b3226dd4db3e3d/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:58.765852 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a872082-b354-444c-893d-1e9480bbe4f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37c1c9fc860149ae96e1b3d780b17213, user_id=882010e30b2f429481b3226dd4db3e3d, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:58.768508 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a872082-b354-444c-893d-1e9480bbe4f4 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:58.783715 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1443/2867] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:29:58 2022] PUT /identity/v3/projects/37c1c9fc860149ae96e1b3d780b17213/users/882010e30b2f429481b3226dd4db3e3d/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:58.794241 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653d1b0-5801-4f40-b013-e17d63ab9701 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:58.794561 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653d1b0-5801-4f40-b013-e17d63ab9701 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:58.794841 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653d1b0-5801-4f40-b013-e17d63ab9701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:58.822113 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-0653d1b0-5801-4f40-b013-e17d63ab9701 None None] MFA Rules not processed for user `882010e30b2f429481b3226dd4db3e3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:58.823373 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-0653d1b0-5801-4f40-b013-e17d63ab9701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:58.889030 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1425/2868] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:29:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:58.893584 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a872082-b354-444c-893d-1e9480bbe4f4 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:58.959044 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a872082-b354-444c-893d-1e9480bbe4f4 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:58.963803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483a285-ab1c-4d2a-8f45-793d71bd78a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:58.964399 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483a285-ab1c-4d2a-8f45-793d71bd78a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:58.964672 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483a285-ab1c-4d2a-8f45-793d71bd78a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:58.964939 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483a285-ab1c-4d2a-8f45-793d71bd78a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:58.965575 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483a285-ab1c-4d2a-8f45-793d71bd78a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:58.967498 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483a285-ab1c-4d2a-8f45-793d71bd78a3 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:58.994024 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1444/2869] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:29:58 2022] POST /identity/v3/projects => generated 369 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:29:58.998752 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653d1b0-5801-4f40-b013-e17d63ab9701 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:59.009094 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653d1b0-5801-4f40-b013-e17d63ab9701 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:59.066231 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b930b-dbea-408a-ab02-64482d6dbaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:59.066878 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b930b-dbea-408a-ab02-64482d6dbaf0 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:59.067161 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b930b-dbea-408a-ab02-64482d6dbaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:59.067434 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b930b-dbea-408a-ab02-64482d6dbaf0 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:59.068074 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b930b-dbea-408a-ab02-64482d6dbaf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:59.070055 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b930b-dbea-408a-ab02-64482d6dbaf0 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:59.091645 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1426/2870] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:29:58 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:29:59.096079 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483a285-ab1c-4d2a-8f45-793d71bd78a3 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:59.106642 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483a285-ab1c-4d2a-8f45-793d71bd78a3 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:59.111282 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06edf813-22f1-41e6-8f54-7ae77da3f814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:59.111886 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edf813-22f1-41e6-8f54-7ae77da3f814 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:59.112166 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edf813-22f1-41e6-8f54-7ae77da3f814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:59.112441 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edf813-22f1-41e6-8f54-7ae77da3f814 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:59.113083 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06edf813-22f1-41e6-8f54-7ae77da3f814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:59.114705 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06edf813-22f1-41e6-8f54-7ae77da3f814 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:59.125798 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1445/2871] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 19:29:59.130194 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b930b-dbea-408a-ab02-64482d6dbaf0 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:59.140838 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b930b-dbea-408a-ab02-64482d6dbaf0 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:59.145571 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0cfbc-8c3e-48fd-a1ba-138691511cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:59.146215 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0cfbc-8c3e-48fd-a1ba-138691511cfd admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:59.146528 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0cfbc-8c3e-48fd-a1ba-138691511cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:59.146805 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0cfbc-8c3e-48fd-a1ba-138691511cfd admin admin] PATH_INFO: `/v3/projects/756b68ce0b764f3689e31d552d8b78fd/users/d66d39bfa1a54c01937749779edc83d6/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:59.161570 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0cfbc-8c3e-48fd-a1ba-138691511cfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=756b68ce0b764f3689e31d552d8b78fd, user_id=d66d39bfa1a54c01937749779edc83d6, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:59.164347 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0cfbc-8c3e-48fd-a1ba-138691511cfd admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:59.177634 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1427/2872] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:29:59 2022] PUT /identity/v3/projects/756b68ce0b764f3689e31d552d8b78fd/users/d66d39bfa1a54c01937749779edc83d6/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:29:59.181674 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06edf813-22f1-41e6-8f54-7ae77da3f814 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:59.188339 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:59.192603 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06edf813-22f1-41e6-8f54-7ae77da3f814 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:59.251963 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e3eba-7235-4857-b2bf-66f78105da6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:59.252506 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e3eba-7235-4857-b2bf-66f78105da6d admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:59.252766 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e3eba-7235-4857-b2bf-66f78105da6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:59.253037 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e3eba-7235-4857-b2bf-66f78105da6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:59.253672 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e3eba-7235-4857-b2bf-66f78105da6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:59.255321 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e3eba-7235-4857-b2bf-66f78105da6d admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:59.265544 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1446/2873] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:29:59.269966 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0cfbc-8c3e-48fd-a1ba-138691511cfd admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:59.280853 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0cfbc-8c3e-48fd-a1ba-138691511cfd admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:59.285813 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe9c67-e003-43b7-b9cf-14bf2a5bd2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:59.286591 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe9c67-e003-43b7-b9cf-14bf2a5bd2c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:59.286912 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe9c67-e003-43b7-b9cf-14bf2a5bd2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:59.287190 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe9c67-e003-43b7-b9cf-14bf2a5bd2c8 admin admin] PATH_INFO: `/v3/projects/756b68ce0b764f3689e31d552d8b78fd/users/d66d39bfa1a54c01937749779edc83d6/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:59.289310 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe9c67-e003-43b7-b9cf-14bf2a5bd2c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=756b68ce0b764f3689e31d552d8b78fd, user_id=d66d39bfa1a54c01937749779edc83d6, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:59.292256 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe9c67-e003-43b7-b9cf-14bf2a5bd2c8 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:59.305205 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1428/2874] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:29:59 2022] PUT /identity/v3/projects/756b68ce0b764f3689e31d552d8b78fd/users/d66d39bfa1a54c01937749779edc83d6/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:29:59.317670 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a73355-105e-420c-bc88-8ae979ca5b09 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:59.317986 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a73355-105e-420c-bc88-8ae979ca5b09 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:59.318264 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a73355-105e-420c-bc88-8ae979ca5b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:59.346085 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-11a73355-105e-420c-bc88-8ae979ca5b09 None None] MFA Rules not processed for user `d66d39bfa1a54c01937749779edc83d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:29:59.347334 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-11a73355-105e-420c-bc88-8ae979ca5b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:59.418039 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1447/2875] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:29:59 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:29:59.429895 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe9c67-e003-43b7-b9cf-14bf2a5bd2c8 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:59.431637 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-18fe9c67-e003-43b7-b9cf-14bf2a5bd2c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:59.476597 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:59.493359 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe9c67-e003-43b7-b9cf-14bf2a5bd2c8 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:59.497539 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff596adc-08bf-4d37-9caa-f5f297eb94e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:59.498160 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff596adc-08bf-4d37-9caa-f5f297eb94e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:59.498432 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff596adc-08bf-4d37-9caa-f5f297eb94e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:59.498727 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff596adc-08bf-4d37-9caa-f5f297eb94e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:59.507870 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff596adc-08bf-4d37-9caa-f5f297eb94e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:59.509229 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff596adc-08bf-4d37-9caa-f5f297eb94e4 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:59.518404 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1429/2876] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:59 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:29:59.563813 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a73355-105e-420c-bc88-8ae979ca5b09 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:29:59.565241 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-11a73355-105e-420c-bc88-8ae979ca5b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:29:59.577608 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a73355-105e-420c-bc88-8ae979ca5b09 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:29:59.581165 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9766df-26ea-464e-92e3-683b86d03f72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:29:59.581782 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9766df-26ea-464e-92e3-683b86d03f72 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:29:59.582040 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9766df-26ea-464e-92e3-683b86d03f72 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:29:59.582330 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9766df-26ea-464e-92e3-683b86d03f72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:29:59.639088 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9766df-26ea-464e-92e3-683b86d03f72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:29:59.640517 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9766df-26ea-464e-92e3-683b86d03f72 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:29:59.650290 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1448/2877] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:29:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:30:02.984987 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff596adc-08bf-4d37-9caa-f5f297eb94e4 service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:03.048897 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff596adc-08bf-4d37-9caa-f5f297eb94e4 service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:03.053402 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ae352-c814-49c5-9443-64fa13c7b41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:03.054019 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ae352-c814-49c5-9443-64fa13c7b41d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:03.054304 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ae352-c814-49c5-9443-64fa13c7b41d admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:03.054611 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ae352-c814-49c5-9443-64fa13c7b41d admin admin] PATH_INFO: `/v3/users/882010e30b2f429481b3226dd4db3e3d` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:03.055980 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03ae352-c814-49c5-9443-64fa13c7b41d admin admin] RBAC: Authorizing `identity:delete_user(user_id=882010e30b2f429481b3226dd4db3e3d)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:03.057957 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03ae352-c814-49c5-9443-64fa13c7b41d admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:03.111667 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d03ae352-c814-49c5-9443-64fa13c7b41d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '882010e30b2f429481b3226dd4db3e3d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:03.112337 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d03ae352-c814-49c5-9443-64fa13c7b41d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '882010e30b2f429481b3226dd4db3e3d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:03.125574 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d03ae352-c814-49c5-9443-64fa13c7b41d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '882010e30b2f429481b3226dd4db3e3d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:03.132567 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d03ae352-c814-49c5-9443-64fa13c7b41d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '882010e30b2f429481b3226dd4db3e3d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:03.140497 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d03ae352-c814-49c5-9443-64fa13c7b41d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '882010e30b2f429481b3226dd4db3e3d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:03.146574 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1430/2878] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:30:02 2022] DELETE /identity/v3/users/882010e30b2f429481b3226dd4db3e3d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:30:03.152841 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb9a34-bcc3-4e38-bd22-7d7b8bfb0174 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:03.153349 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb9a34-bcc3-4e38-bd22-7d7b8bfb0174 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:03.153793 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb9a34-bcc3-4e38-bd22-7d7b8bfb0174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:03.174116 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-5cbb9a34-bcc3-4e38-bd22-7d7b8bfb0174 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:03.175352 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5cbb9a34-bcc3-4e38-bd22-7d7b8bfb0174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:03.194327 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:03.237569 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1449/2879] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:30:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:30:03.248110 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ae352-c814-49c5-9443-64fa13c7b41d admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:03.249707 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d03ae352-c814-49c5-9443-64fa13c7b41d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:03.307075 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ae352-c814-49c5-9443-64fa13c7b41d admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:03.312496 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084cefd0-c078-4cdd-aee8-896e4411c315 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:03.313118 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084cefd0-c078-4cdd-aee8-896e4411c315 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:03.313399 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084cefd0-c078-4cdd-aee8-896e4411c315 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:03.313673 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084cefd0-c078-4cdd-aee8-896e4411c315 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:03.323445 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084cefd0-c078-4cdd-aee8-896e4411c315 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:03.324901 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084cefd0-c078-4cdd-aee8-896e4411c315 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:03.334408 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1431/2880] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:30:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 19:30:03.609456 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb9a34-bcc3-4e38-bd22-7d7b8bfb0174 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:03.611135 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5cbb9a34-bcc3-4e38-bd22-7d7b8bfb0174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:03.627234 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb9a34-bcc3-4e38-bd22-7d7b8bfb0174 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:03.632265 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4916bf0d-121c-4593-bbb3-377585f07311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:03.632909 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916bf0d-121c-4593-bbb3-377585f07311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:03.633189 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916bf0d-121c-4593-bbb3-377585f07311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:03.633460 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916bf0d-121c-4593-bbb3-377585f07311 admin admin] PATH_INFO: `/v3/projects/37c1c9fc860149ae96e1b3d780b17213` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:03.634659 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4916bf0d-121c-4593-bbb3-377585f07311 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37c1c9fc860149ae96e1b3d780b17213)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:03.636804 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4916bf0d-121c-4593-bbb3-377585f07311 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:03.686389 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4916bf0d-121c-4593-bbb3-377585f07311 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37c1c9fc860149ae96e1b3d780b17213', 'request_id': 'req-4916bf0d-121c-4593-bbb3-377585f07311'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:03.691910 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4916bf0d-121c-4593-bbb3-377585f07311 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37c1c9fc860149ae96e1b3d780b17213', 'request_id': 'req-4916bf0d-121c-4593-bbb3-377585f07311'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:03.698064 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4916bf0d-121c-4593-bbb3-377585f07311 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37c1c9fc860149ae96e1b3d780b17213', 'request_id': 'req-4916bf0d-121c-4593-bbb3-377585f07311'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:03.710603 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4916bf0d-121c-4593-bbb3-377585f07311 admin admin] The token cache is being invalidate because project 37c1c9fc860149ae96e1b3d780b17213 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:30:03.711132 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4916bf0d-121c-4593-bbb3-377585f07311 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:03.711755 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4916bf0d-121c-4593-bbb3-377585f07311 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:03.713227 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1450/2881] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:30:03 2022] DELETE /identity/v3/projects/37c1c9fc860149ae96e1b3d780b17213 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:30:03.718088 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084cefd0-c078-4cdd-aee8-896e4411c315 service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:03.722983 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:03.729723 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084cefd0-c078-4cdd-aee8-896e4411c315 service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:03.789781 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22408e3f-5cd6-4444-91ba-125cb597b6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:03.790606 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22408e3f-5cd6-4444-91ba-125cb597b6fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:03.790886 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22408e3f-5cd6-4444-91ba-125cb597b6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:03.791251 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22408e3f-5cd6-4444-91ba-125cb597b6fa admin admin] PATH_INFO: `/v3/users/d66d39bfa1a54c01937749779edc83d6` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:03.792399 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22408e3f-5cd6-4444-91ba-125cb597b6fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=d66d39bfa1a54c01937749779edc83d6)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:03.794320 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22408e3f-5cd6-4444-91ba-125cb597b6fa admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:03.839080 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-22408e3f-5cd6-4444-91ba-125cb597b6fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd66d39bfa1a54c01937749779edc83d6'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:03.840030 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-22408e3f-5cd6-4444-91ba-125cb597b6fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd66d39bfa1a54c01937749779edc83d6'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:03.853148 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-22408e3f-5cd6-4444-91ba-125cb597b6fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd66d39bfa1a54c01937749779edc83d6'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:03.860502 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-22408e3f-5cd6-4444-91ba-125cb597b6fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd66d39bfa1a54c01937749779edc83d6'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:03.867900 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-22408e3f-5cd6-4444-91ba-125cb597b6fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd66d39bfa1a54c01937749779edc83d6'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:03.874682 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1432/2882] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:30:03 2022] DELETE /identity/v3/users/d66d39bfa1a54c01937749779edc83d6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:30:04.153988 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4916bf0d-121c-4593-bbb3-377585f07311 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:04.155528 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4916bf0d-121c-4593-bbb3-377585f07311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:04.170861 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4916bf0d-121c-4593-bbb3-377585f07311 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:04.229936 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d69dd7-160e-4d62-9b33-4d632d81159a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:04.230591 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d69dd7-160e-4d62-9b33-4d632d81159a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:04.230869 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d69dd7-160e-4d62-9b33-4d632d81159a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:04.231292 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d69dd7-160e-4d62-9b33-4d632d81159a admin admin] PATH_INFO: `/v3/projects/756b68ce0b764f3689e31d552d8b78fd` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:04.232426 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d69dd7-160e-4d62-9b33-4d632d81159a admin admin] RBAC: Authorizing `identity:delete_project(project_id=756b68ce0b764f3689e31d552d8b78fd)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:04.234313 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d69dd7-160e-4d62-9b33-4d632d81159a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:04.279831 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-49d69dd7-160e-4d62-9b33-4d632d81159a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '756b68ce0b764f3689e31d552d8b78fd', 'request_id': 'req-49d69dd7-160e-4d62-9b33-4d632d81159a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:04.280985 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:04.286813 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-49d69dd7-160e-4d62-9b33-4d632d81159a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '756b68ce0b764f3689e31d552d8b78fd', 'request_id': 'req-49d69dd7-160e-4d62-9b33-4d632d81159a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:04.293683 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-49d69dd7-160e-4d62-9b33-4d632d81159a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '756b68ce0b764f3689e31d552d8b78fd', 'request_id': 'req-49d69dd7-160e-4d62-9b33-4d632d81159a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:04.305856 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-49d69dd7-160e-4d62-9b33-4d632d81159a admin admin] The token cache is being invalidate because project 756b68ce0b764f3689e31d552d8b78fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:30:04.306194 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-49d69dd7-160e-4d62-9b33-4d632d81159a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:04.307286 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-49d69dd7-160e-4d62-9b33-4d632d81159a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:04.308899 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1451/2883] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:30:04 2022] DELETE /identity/v3/projects/756b68ce0b764f3689e31d552d8b78fd => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:30:04.315794 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce87ce5-a7d7-4eda-ab44-6af4d9ab3832 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:04.316337 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce87ce5-a7d7-4eda-ab44-6af4d9ab3832 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:04.316337 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce87ce5-a7d7-4eda-ab44-6af4d9ab3832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:04.337393 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-9ce87ce5-a7d7-4eda-ab44-6af4d9ab3832 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:04.338632 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-9ce87ce5-a7d7-4eda-ab44-6af4d9ab3832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:04.399212 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1433/2884] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:30:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:30:04.409015 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c841d55-b547-46f7-a86b-218c6e78ff9e None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:04.409301 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c841d55-b547-46f7-a86b-218c6e78ff9e None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:04.409579 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c841d55-b547-46f7-a86b-218c6e78ff9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:04.431400 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-8c841d55-b547-46f7-a86b-218c6e78ff9e None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:04.432606 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8c841d55-b547-46f7-a86b-218c6e78ff9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:04.441893 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1452/2885] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:30:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:30:04.446397 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce87ce5-a7d7-4eda-ab44-6af4d9ab3832 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:04.457543 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce87ce5-a7d7-4eda-ab44-6af4d9ab3832 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:04.462872 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32d12c-99ec-4e71-841f-3bb958e50390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:04.463484 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32d12c-99ec-4e71-841f-3bb958e50390 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:04.463755 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32d12c-99ec-4e71-841f-3bb958e50390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:04.464056 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32d12c-99ec-4e71-841f-3bb958e50390 admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:04.464700 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32d12c-99ec-4e71-841f-3bb958e50390 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:30:04.465001 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32d12c-99ec-4e71-841f-3bb958e50390 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:04.466628 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32d12c-99ec-4e71-841f-3bb958e50390 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:04.478684 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1434/2886] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:30:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:30:04.483612 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c841d55-b547-46f7-a86b-218c6e78ff9e None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:04.492893 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c841d55-b547-46f7-a86b-218c6e78ff9e None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:04.498748 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca73b61-7c6e-4266-a9db-b1e0e7049184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:04.499339 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca73b61-7c6e-4266-a9db-b1e0e7049184 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:04.499618 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca73b61-7c6e-4266-a9db-b1e0e7049184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:04.499938 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca73b61-7c6e-4266-a9db-b1e0e7049184 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:04.500516 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca73b61-7c6e-4266-a9db-b1e0e7049184 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:04.502435 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca73b61-7c6e-4266-a9db-b1e0e7049184 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:04.532321 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1453/2887] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:30:04 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:30:04.536791 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32d12c-99ec-4e71-841f-3bb958e50390 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:04.547954 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32d12c-99ec-4e71-841f-3bb958e50390 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:04.552748 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:04.613299 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23397f-633d-4509-9616-81c9e499ba4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:04.613812 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23397f-633d-4509-9616-81c9e499ba4a admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:04.614090 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23397f-633d-4509-9616-81c9e499ba4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:04.614361 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23397f-633d-4509-9616-81c9e499ba4a admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:04.615029 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d23397f-633d-4509-9616-81c9e499ba4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:04.616966 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d23397f-633d-4509-9616-81c9e499ba4a admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:04.639310 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1435/2888] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:30:04 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:30:04.643767 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca73b61-7c6e-4266-a9db-b1e0e7049184 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:04.656849 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca73b61-7c6e-4266-a9db-b1e0e7049184 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:04.661486 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144fc1a-cce4-436b-98cc-9b978184f902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:04.662082 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144fc1a-cce4-436b-98cc-9b978184f902 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:04.662357 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144fc1a-cce4-436b-98cc-9b978184f902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:04.662666 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144fc1a-cce4-436b-98cc-9b978184f902 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:04.663304 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2144fc1a-cce4-436b-98cc-9b978184f902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:04.664879 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2144fc1a-cce4-436b-98cc-9b978184f902 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:04.676834 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1454/2889] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:30:04.681199 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23397f-633d-4509-9616-81c9e499ba4a admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:04.691912 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23397f-633d-4509-9616-81c9e499ba4a admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:04.697173 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a39d11-5bc2-4ad7-86cf-25b72c0059a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:04.697955 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a39d11-5bc2-4ad7-86cf-25b72c0059a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:04.698433 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a39d11-5bc2-4ad7-86cf-25b72c0059a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:04.698951 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a39d11-5bc2-4ad7-86cf-25b72c0059a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:04.699616 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a39d11-5bc2-4ad7-86cf-25b72c0059a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:04.701391 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a39d11-5bc2-4ad7-86cf-25b72c0059a9 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:04.713178 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1436/2890] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:30:04.717578 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144fc1a-cce4-436b-98cc-9b978184f902 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:04.727785 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144fc1a-cce4-436b-98cc-9b978184f902 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:04.732875 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7a2de-18aa-405e-938f-c883f87ccaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:04.733528 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7a2de-18aa-405e-938f-c883f87ccaaa admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:04.733803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7a2de-18aa-405e-938f-c883f87ccaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:04.734073 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7a2de-18aa-405e-938f-c883f87ccaaa admin admin] PATH_INFO: `/v3/projects/372ed3bf19d94e789f1106c8494a4be4/users/ba0e3e57396a4eb0abb905a36ef3d0e1/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:04.749863 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d7a2de-18aa-405e-938f-c883f87ccaaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=372ed3bf19d94e789f1106c8494a4be4, user_id=ba0e3e57396a4eb0abb905a36ef3d0e1, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:04.752565 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d7a2de-18aa-405e-938f-c883f87ccaaa admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:04.765863 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1455/2891] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:30:04 2022] PUT /identity/v3/projects/372ed3bf19d94e789f1106c8494a4be4/users/ba0e3e57396a4eb0abb905a36ef3d0e1/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:30:04.776462 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1a72e-83a6-45e1-8725-fef1728caf04 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:04.776752 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1a72e-83a6-45e1-8725-fef1728caf04 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:04.777030 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1a72e-83a6-45e1-8725-fef1728caf04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:04.806277 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-15d1a72e-83a6-45e1-8725-fef1728caf04 None None] MFA Rules not processed for user `ba0e3e57396a4eb0abb905a36ef3d0e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:04.807533 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-15d1a72e-83a6-45e1-8725-fef1728caf04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:04.884556 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1437/2892] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:30:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:30:04.889105 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7a2de-18aa-405e-938f-c883f87ccaaa admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:04.952447 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7a2de-18aa-405e-938f-c883f87ccaaa admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:04.957346 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef464b-7199-4c6d-8c86-a4ef6c71cb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:04.957951 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef464b-7199-4c6d-8c86-a4ef6c71cb8c admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:04.958230 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef464b-7199-4c6d-8c86-a4ef6c71cb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:04.958528 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef464b-7199-4c6d-8c86-a4ef6c71cb8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:04.959158 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef464b-7199-4c6d-8c86-a4ef6c71cb8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:04.961307 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef464b-7199-4c6d-8c86-a4ef6c71cb8c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:04.989963 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1456/2893] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:30:04 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:30:04.994683 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1a72e-83a6-45e1-8725-fef1728caf04 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:05.005757 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1a72e-83a6-45e1-8725-fef1728caf04 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:05.066249 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a5319-9ed2-49c0-95da-d86ac0d82c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:05.066890 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a5319-9ed2-49c0-95da-d86ac0d82c33 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:05.067171 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a5319-9ed2-49c0-95da-d86ac0d82c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:05.067444 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a5319-9ed2-49c0-95da-d86ac0d82c33 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:05.068093 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14a5319-9ed2-49c0-95da-d86ac0d82c33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:05.070001 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14a5319-9ed2-49c0-95da-d86ac0d82c33 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:05.092405 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1438/2894] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:30:04 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 19:30:05.096506 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef464b-7199-4c6d-8c86-a4ef6c71cb8c admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:05.107712 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef464b-7199-4c6d-8c86-a4ef6c71cb8c admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:05.112414 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d941cf-deb5-465d-9244-9cb3ac51c302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:05.113020 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d941cf-deb5-465d-9244-9cb3ac51c302 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:05.113300 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d941cf-deb5-465d-9244-9cb3ac51c302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:05.113573 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d941cf-deb5-465d-9244-9cb3ac51c302 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:05.114214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d941cf-deb5-465d-9244-9cb3ac51c302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:05.115854 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d941cf-deb5-465d-9244-9cb3ac51c302 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:05.127367 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1457/2895] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:30:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:30:05.131641 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a5319-9ed2-49c0-95da-d86ac0d82c33 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:05.141852 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a5319-9ed2-49c0-95da-d86ac0d82c33 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:05.146372 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0772ba-bc00-487f-9404-9404931eb1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:05.147189 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0772ba-bc00-487f-9404-9404931eb1d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:05.147473 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0772ba-bc00-487f-9404-9404931eb1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:05.147754 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0772ba-bc00-487f-9404-9404931eb1d7 admin admin] PATH_INFO: `/v3/projects/b06ffab5470d41d3a82d34f711e6f492/users/461a11c190d343f287ae37527f96555d/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:05.150063 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:05.164948 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0772ba-bc00-487f-9404-9404931eb1d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b06ffab5470d41d3a82d34f711e6f492, user_id=461a11c190d343f287ae37527f96555d, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:05.167664 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0772ba-bc00-487f-9404-9404931eb1d7 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:05.181190 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1439/2896] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:30:05 2022] PUT /identity/v3/projects/b06ffab5470d41d3a82d34f711e6f492/users/461a11c190d343f287ae37527f96555d/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:30:05.185383 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d941cf-deb5-465d-9244-9cb3ac51c302 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:05.195422 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d941cf-deb5-465d-9244-9cb3ac51c302 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:05.240021 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:05.253299 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d340ff97-8c0c-4d43-8dab-af7bf188ce9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:05.253904 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340ff97-8c0c-4d43-8dab-af7bf188ce9f admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:05.254183 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340ff97-8c0c-4d43-8dab-af7bf188ce9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:05.254485 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340ff97-8c0c-4d43-8dab-af7bf188ce9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:05.255121 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d340ff97-8c0c-4d43-8dab-af7bf188ce9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:05.256773 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d340ff97-8c0c-4d43-8dab-af7bf188ce9f admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:05.267107 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1458/2897] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:30:05 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:30:05.271334 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0772ba-bc00-487f-9404-9404931eb1d7 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:05.282251 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0772ba-bc00-487f-9404-9404931eb1d7 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:05.286930 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a23776-0852-4ad4-87c1-027ddcfe49eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:05.287573 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a23776-0852-4ad4-87c1-027ddcfe49eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:05.287853 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a23776-0852-4ad4-87c1-027ddcfe49eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:05.288124 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a23776-0852-4ad4-87c1-027ddcfe49eb admin admin] PATH_INFO: `/v3/projects/b06ffab5470d41d3a82d34f711e6f492/users/461a11c190d343f287ae37527f96555d/roles/edc551338adb4ae88bdafc591ad69582` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:05.290074 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a23776-0852-4ad4-87c1-027ddcfe49eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b06ffab5470d41d3a82d34f711e6f492, user_id=461a11c190d343f287ae37527f96555d, role_id=edc551338adb4ae88bdafc591ad69582)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:05.292726 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a23776-0852-4ad4-87c1-027ddcfe49eb admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:05.302904 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1440/2898] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:30:05 2022] PUT /identity/v3/projects/b06ffab5470d41d3a82d34f711e6f492/users/461a11c190d343f287ae37527f96555d/roles/edc551338adb4ae88bdafc591ad69582 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:30:05.368262 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d93970-6480-46cd-97cb-e690ce7fe89c None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:05.368546 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d93970-6480-46cd-97cb-e690ce7fe89c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:05.368813 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d93970-6480-46cd-97cb-e690ce7fe89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:05.398441 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-a7d93970-6480-46cd-97cb-e690ce7fe89c None None] MFA Rules not processed for user `461a11c190d343f287ae37527f96555d`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:05.399658 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a7d93970-6480-46cd-97cb-e690ce7fe89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:05.472723 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1459/2899] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:30:05 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:30:05.483435 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a23776-0852-4ad4-87c1-027ddcfe49eb admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:05.485168 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-22a23776-0852-4ad4-87c1-027ddcfe49eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:05.542997 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a23776-0852-4ad4-87c1-027ddcfe49eb admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:05.546706 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fcd248-ffe2-4ea8-9802-572fcd761e97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:05.547312 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcd248-ffe2-4ea8-9802-572fcd761e97 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:05.547590 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcd248-ffe2-4ea8-9802-572fcd761e97 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:05.547860 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcd248-ffe2-4ea8-9802-572fcd761e97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:05.556702 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fcd248-ffe2-4ea8-9802-572fcd761e97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:05.558116 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fcd248-ffe2-4ea8-9802-572fcd761e97 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:05.567583 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1441/2900] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:30:05 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:30:05.946791 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d93970-6480-46cd-97cb-e690ce7fe89c None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:06.010086 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d93970-6480-46cd-97cb-e690ce7fe89c None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:06.015154 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f428ec-a2e7-481d-b029-08fb46acb786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:06.015777 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f428ec-a2e7-481d-b029-08fb46acb786 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:06.016052 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f428ec-a2e7-481d-b029-08fb46acb786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:06.016318 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f428ec-a2e7-481d-b029-08fb46acb786 admin admin] PATH_INFO: `/v3/users/ba0e3e57396a4eb0abb905a36ef3d0e1` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:06.017425 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f428ec-a2e7-481d-b029-08fb46acb786 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba0e3e57396a4eb0abb905a36ef3d0e1)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:06.019364 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f428ec-a2e7-481d-b029-08fb46acb786 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:06.068951 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-83f428ec-a2e7-481d-b029-08fb46acb786 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba0e3e57396a4eb0abb905a36ef3d0e1'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:06.076477 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-83f428ec-a2e7-481d-b029-08fb46acb786 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba0e3e57396a4eb0abb905a36ef3d0e1'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:06.083726 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-83f428ec-a2e7-481d-b029-08fb46acb786 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba0e3e57396a4eb0abb905a36ef3d0e1'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:06.091131 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:06.097542 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-83f428ec-a2e7-481d-b029-08fb46acb786 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba0e3e57396a4eb0abb905a36ef3d0e1'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:06.098317 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-83f428ec-a2e7-481d-b029-08fb46acb786 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba0e3e57396a4eb0abb905a36ef3d0e1'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:06.105097 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1460/2901] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:30:05 2022] DELETE /identity/v3/users/ba0e3e57396a4eb0abb905a36ef3d0e1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:30:06.110099 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e632d5-27c8-4118-9382-703f5b20bcd4 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:06.110386 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e632d5-27c8-4118-9382-703f5b20bcd4 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:06.110708 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e632d5-27c8-4118-9382-703f5b20bcd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:06.131325 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-c6e632d5-27c8-4118-9382-703f5b20bcd4 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:06.132536 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-c6e632d5-27c8-4118-9382-703f5b20bcd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:06.193764 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1442/2902] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:30:06.203693 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f428ec-a2e7-481d-b029-08fb46acb786 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:06.205199 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-83f428ec-a2e7-481d-b029-08fb46acb786 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:06.262405 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f428ec-a2e7-481d-b029-08fb46acb786 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:06.266067 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d648a9-8cdd-44f3-baaa-b9dc80a761c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:06.266691 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d648a9-8cdd-44f3-baaa-b9dc80a761c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:06.266968 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d648a9-8cdd-44f3-baaa-b9dc80a761c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:06.267238 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d648a9-8cdd-44f3-baaa-b9dc80a761c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:06.276091 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d648a9-8cdd-44f3-baaa-b9dc80a761c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:06.277506 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d648a9-8cdd-44f3-baaa-b9dc80a761c5 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:06.287280 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1461/2903] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:30:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:30:06.555754 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e632d5-27c8-4118-9382-703f5b20bcd4 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:06.557224 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-c6e632d5-27c8-4118-9382-703f5b20bcd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:06.569201 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e632d5-27c8-4118-9382-703f5b20bcd4 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:06.574984 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a5f3f-e1e3-478a-bfcd-104283a2f5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:06.575923 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a5f3f-e1e3-478a-bfcd-104283a2f5a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:06.576198 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a5f3f-e1e3-478a-bfcd-104283a2f5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:06.576495 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a5f3f-e1e3-478a-bfcd-104283a2f5a1 admin admin] PATH_INFO: `/v3/projects/372ed3bf19d94e789f1106c8494a4be4` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:06.577852 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a5f3f-e1e3-478a-bfcd-104283a2f5a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=372ed3bf19d94e789f1106c8494a4be4)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:06.579940 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a5f3f-e1e3-478a-bfcd-104283a2f5a1 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:06.633792 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-0b1a5f3f-e1e3-478a-bfcd-104283a2f5a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '372ed3bf19d94e789f1106c8494a4be4', 'request_id': 'req-0b1a5f3f-e1e3-478a-bfcd-104283a2f5a1'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:06.640279 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-0b1a5f3f-e1e3-478a-bfcd-104283a2f5a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '372ed3bf19d94e789f1106c8494a4be4', 'request_id': 'req-0b1a5f3f-e1e3-478a-bfcd-104283a2f5a1'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:06.646521 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-0b1a5f3f-e1e3-478a-bfcd-104283a2f5a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '372ed3bf19d94e789f1106c8494a4be4', 'request_id': 'req-0b1a5f3f-e1e3-478a-bfcd-104283a2f5a1'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:06.650122 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:06.661250 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-0b1a5f3f-e1e3-478a-bfcd-104283a2f5a1 admin admin] The token cache is being invalidate because project 372ed3bf19d94e789f1106c8494a4be4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:30:06.661724 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-0b1a5f3f-e1e3-478a-bfcd-104283a2f5a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:06.662824 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-0b1a5f3f-e1e3-478a-bfcd-104283a2f5a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:06.667509 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1443/2904] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:30:06 2022] DELETE /identity/v3/projects/372ed3bf19d94e789f1106c8494a4be4 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:30:06.669343 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d648a9-8cdd-44f3-baaa-b9dc80a761c5 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:06.679128 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d648a9-8cdd-44f3-baaa-b9dc80a761c5 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:06.736264 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a047c-9120-4a3d-8801-c7da3d15e06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:06.736811 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a047c-9120-4a3d-8801-c7da3d15e06e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:06.737092 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a047c-9120-4a3d-8801-c7da3d15e06e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:06.737367 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a047c-9120-4a3d-8801-c7da3d15e06e admin admin] PATH_INFO: `/v3/users/461a11c190d343f287ae37527f96555d` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:06.738517 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a047c-9120-4a3d-8801-c7da3d15e06e admin admin] RBAC: Authorizing `identity:delete_user(user_id=461a11c190d343f287ae37527f96555d)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:06.740522 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a047c-9120-4a3d-8801-c7da3d15e06e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:06.786033 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3e8a047c-9120-4a3d-8801-c7da3d15e06e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '461a11c190d343f287ae37527f96555d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:06.793808 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3e8a047c-9120-4a3d-8801-c7da3d15e06e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '461a11c190d343f287ae37527f96555d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:06.800683 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3e8a047c-9120-4a3d-8801-c7da3d15e06e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '461a11c190d343f287ae37527f96555d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:06.812230 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3e8a047c-9120-4a3d-8801-c7da3d15e06e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '461a11c190d343f287ae37527f96555d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:06.812864 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3e8a047c-9120-4a3d-8801-c7da3d15e06e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '461a11c190d343f287ae37527f96555d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:06.818695 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1462/2905] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:30:06 2022] DELETE /identity/v3/users/461a11c190d343f287ae37527f96555d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:30:07.093909 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a5f3f-e1e3-478a-bfcd-104283a2f5a1 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:07.095395 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-0b1a5f3f-e1e3-478a-bfcd-104283a2f5a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:07.110636 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a5f3f-e1e3-478a-bfcd-104283a2f5a1 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:07.169808 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c3099c-838f-4f68-9f91-ab0a335c5dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:07.170436 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3099c-838f-4f68-9f91-ab0a335c5dbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:07.170806 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3099c-838f-4f68-9f91-ab0a335c5dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:07.171075 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3099c-838f-4f68-9f91-ab0a335c5dbb admin admin] PATH_INFO: `/v3/projects/b06ffab5470d41d3a82d34f711e6f492` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:07.172163 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c3099c-838f-4f68-9f91-ab0a335c5dbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b06ffab5470d41d3a82d34f711e6f492)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:07.174044 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c3099c-838f-4f68-9f91-ab0a335c5dbb admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:07.219940 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-31c3099c-838f-4f68-9f91-ab0a335c5dbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b06ffab5470d41d3a82d34f711e6f492', 'request_id': 'req-31c3099c-838f-4f68-9f91-ab0a335c5dbb'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:07.225259 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-31c3099c-838f-4f68-9f91-ab0a335c5dbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b06ffab5470d41d3a82d34f711e6f492', 'request_id': 'req-31c3099c-838f-4f68-9f91-ab0a335c5dbb'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:07.231321 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-31c3099c-838f-4f68-9f91-ab0a335c5dbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b06ffab5470d41d3a82d34f711e6f492', 'request_id': 'req-31c3099c-838f-4f68-9f91-ab0a335c5dbb'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:07.243744 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-31c3099c-838f-4f68-9f91-ab0a335c5dbb admin admin] The token cache is being invalidate because project b06ffab5470d41d3a82d34f711e6f492 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:30:07.244034 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-31c3099c-838f-4f68-9f91-ab0a335c5dbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:07.244658 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-31c3099c-838f-4f68-9f91-ab0a335c5dbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:07.246128 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1444/2906] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:30:07 2022] DELETE /identity/v3/projects/b06ffab5470d41d3a82d34f711e6f492 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:30:07.251543 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b53aa-ec27-4be1-86ef-fed0c7b963e7 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:07.252002 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b53aa-ec27-4be1-86ef-fed0c7b963e7 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:07.252113 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b53aa-ec27-4be1-86ef-fed0c7b963e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:07.272456 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-753b53aa-ec27-4be1-86ef-fed0c7b963e7 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:07.273581 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-753b53aa-ec27-4be1-86ef-fed0c7b963e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:07.278822 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:07.333308 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1463/2907] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:30:07.341451 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d18a68-3476-4184-aa10-9b09aa03bcd7 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:07.341736 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d18a68-3476-4184-aa10-9b09aa03bcd7 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:07.342019 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d18a68-3476-4184-aa10-9b09aa03bcd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:07.361417 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-46d18a68-3476-4184-aa10-9b09aa03bcd7 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:07.362656 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-46d18a68-3476-4184-aa10-9b09aa03bcd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:07.370637 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1445/2908] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:30:07.375363 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b53aa-ec27-4be1-86ef-fed0c7b963e7 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:07.384905 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b53aa-ec27-4be1-86ef-fed0c7b963e7 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:07.391233 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636322b-1989-4a09-8ce5-dfe9a70ec6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:07.391834 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636322b-1989-4a09-8ce5-dfe9a70ec6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:07.392115 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636322b-1989-4a09-8ce5-dfe9a70ec6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:07.392393 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636322b-1989-4a09-8ce5-dfe9a70ec6e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:07.393039 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636322b-1989-4a09-8ce5-dfe9a70ec6e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:30:07.393340 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636322b-1989-4a09-8ce5-dfe9a70ec6e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:07.394969 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636322b-1989-4a09-8ce5-dfe9a70ec6e7 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:07.406769 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1464/2909] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:30:07.411114 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d18a68-3476-4184-aa10-9b09aa03bcd7 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:07.420588 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d18a68-3476-4184-aa10-9b09aa03bcd7 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:07.425226 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde76870-796f-4156-8548-1e845df48da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:07.425822 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde76870-796f-4156-8548-1e845df48da7 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:07.426098 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde76870-796f-4156-8548-1e845df48da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:07.426369 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde76870-796f-4156-8548-1e845df48da7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:07.427029 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde76870-796f-4156-8548-1e845df48da7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:07.428929 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde76870-796f-4156-8548-1e845df48da7 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:07.456686 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1446/2910] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:30:07 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:30:07.460857 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636322b-1989-4a09-8ce5-dfe9a70ec6e7 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:07.470820 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636322b-1989-4a09-8ce5-dfe9a70ec6e7 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:07.525508 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4425a-c349-43aa-98ea-83aa97dc071e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:07.526028 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4425a-c349-43aa-98ea-83aa97dc071e admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:07.526304 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4425a-c349-43aa-98ea-83aa97dc071e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:07.526659 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4425a-c349-43aa-98ea-83aa97dc071e admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:07.527244 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f4425a-c349-43aa-98ea-83aa97dc071e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:07.529206 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f4425a-c349-43aa-98ea-83aa97dc071e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:07.551464 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1465/2911] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:30:07 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:30:07.555736 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde76870-796f-4156-8548-1e845df48da7 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:07.567138 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde76870-796f-4156-8548-1e845df48da7 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:07.571703 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b02ad5-dbab-4723-acbe-74a5e3299ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:07.572288 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b02ad5-dbab-4723-acbe-74a5e3299ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:07.572562 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b02ad5-dbab-4723-acbe-74a5e3299ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:07.572826 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b02ad5-dbab-4723-acbe-74a5e3299ab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:07.573451 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b02ad5-dbab-4723-acbe-74a5e3299ab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:07.575165 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b02ad5-dbab-4723-acbe-74a5e3299ab6 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:07.584904 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1447/2912] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:30:07.589117 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4425a-c349-43aa-98ea-83aa97dc071e admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:07.598882 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4425a-c349-43aa-98ea-83aa97dc071e admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:07.603394 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23352c2e-4c14-47cf-a39a-60d04804da00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:07.603980 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23352c2e-4c14-47cf-a39a-60d04804da00 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:07.604254 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23352c2e-4c14-47cf-a39a-60d04804da00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:07.604522 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23352c2e-4c14-47cf-a39a-60d04804da00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:07.605160 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23352c2e-4c14-47cf-a39a-60d04804da00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:07.607274 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23352c2e-4c14-47cf-a39a-60d04804da00 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:07.617464 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1466/2913] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:30:07.622321 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b02ad5-dbab-4723-acbe-74a5e3299ab6 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:07.632162 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b02ad5-dbab-4723-acbe-74a5e3299ab6 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:07.636836 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebaba02-9f76-42fb-8ad6-10e282a33afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:07.637482 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebaba02-9f76-42fb-8ad6-10e282a33afe admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:07.637767 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebaba02-9f76-42fb-8ad6-10e282a33afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:07.638039 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebaba02-9f76-42fb-8ad6-10e282a33afe admin admin] PATH_INFO: `/v3/projects/a383ec604ad64cb4847cdad308d85034/users/63ff9fbcbeb5480dbc69329a65b1a219/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:07.652405 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebaba02-9f76-42fb-8ad6-10e282a33afe admin admin] RBAC: Authorizing `identity:create_grant(project_id=a383ec604ad64cb4847cdad308d85034, user_id=63ff9fbcbeb5480dbc69329a65b1a219, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:07.654986 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebaba02-9f76-42fb-8ad6-10e282a33afe admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:07.667686 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1448/2914] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:30:07 2022] PUT /identity/v3/projects/a383ec604ad64cb4847cdad308d85034/users/63ff9fbcbeb5480dbc69329a65b1a219/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 19:30:07.679617 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1f888-edb9-4a09-817f-9ca6b9bae0a0 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:07.679904 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1f888-edb9-4a09-817f-9ca6b9bae0a0 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:07.680173 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1f888-edb9-4a09-817f-9ca6b9bae0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:07.707367 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-ecc1f888-edb9-4a09-817f-9ca6b9bae0a0 None None] MFA Rules not processed for user `63ff9fbcbeb5480dbc69329a65b1a219`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:07.708557 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ecc1f888-edb9-4a09-817f-9ca6b9bae0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:07.772584 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1467/2915] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:30:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:30:07.783372 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebaba02-9f76-42fb-8ad6-10e282a33afe admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:07.785164 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-2ebaba02-9f76-42fb-8ad6-10e282a33afe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:07.811680 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:07.843411 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebaba02-9f76-42fb-8ad6-10e282a33afe admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:07.847005 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e80cf-9ac8-4b94-a338-8d3054598a21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:07.847601 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e80cf-9ac8-4b94-a338-8d3054598a21 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:07.847876 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e80cf-9ac8-4b94-a338-8d3054598a21 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:07.848145 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e80cf-9ac8-4b94-a338-8d3054598a21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:07.856793 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e80cf-9ac8-4b94-a338-8d3054598a21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:07.858282 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e80cf-9ac8-4b94-a338-8d3054598a21 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:07.867319 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1449/2916] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:30:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:30:10.866897 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1f888-edb9-4a09-817f-9ca6b9bae0a0 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:10.875391 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:10.929534 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1f888-edb9-4a09-817f-9ca6b9bae0a0 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:10.933964 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a4ca2-e896-482e-bb53-9d8790e06e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:10.934619 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a4ca2-e896-482e-bb53-9d8790e06e8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:10.934897 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a4ca2-e896-482e-bb53-9d8790e06e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:10.935188 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a4ca2-e896-482e-bb53-9d8790e06e8d admin admin] PATH_INFO: `/v3/users/63ff9fbcbeb5480dbc69329a65b1a219` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:10.936320 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a4ca2-e896-482e-bb53-9d8790e06e8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=63ff9fbcbeb5480dbc69329a65b1a219)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:10.938215 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a4ca2-e896-482e-bb53-9d8790e06e8d admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:10.983941 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d81a4ca2-e896-482e-bb53-9d8790e06e8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63ff9fbcbeb5480dbc69329a65b1a219'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:10.991039 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d81a4ca2-e896-482e-bb53-9d8790e06e8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63ff9fbcbeb5480dbc69329a65b1a219'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:10.997961 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d81a4ca2-e896-482e-bb53-9d8790e06e8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63ff9fbcbeb5480dbc69329a65b1a219'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:11.009416 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d81a4ca2-e896-482e-bb53-9d8790e06e8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63ff9fbcbeb5480dbc69329a65b1a219'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:11.010049 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d81a4ca2-e896-482e-bb53-9d8790e06e8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63ff9fbcbeb5480dbc69329a65b1a219'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:11.016156 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1468/2917] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:30:10 2022] DELETE /identity/v3/users/63ff9fbcbeb5480dbc69329a65b1a219 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:30:11.020608 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69660cee-e88d-44c9-83e9-a9dac80f09ca None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:11.021073 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69660cee-e88d-44c9-83e9-a9dac80f09ca None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:11.021307 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69660cee-e88d-44c9-83e9-a9dac80f09ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:11.041663 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-69660cee-e88d-44c9-83e9-a9dac80f09ca None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:11.043191 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-69660cee-e88d-44c9-83e9-a9dac80f09ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:11.101078 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1450/2918] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:30:11.111442 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a4ca2-e896-482e-bb53-9d8790e06e8d admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:11.112874 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d81a4ca2-e896-482e-bb53-9d8790e06e8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:11.169695 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a4ca2-e896-482e-bb53-9d8790e06e8d admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:11.174105 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493cdffd-343c-479f-bd43-ef499003fa60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:11.174747 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cdffd-343c-479f-bd43-ef499003fa60 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:11.175030 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cdffd-343c-479f-bd43-ef499003fa60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:11.175299 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cdffd-343c-479f-bd43-ef499003fa60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:11.184226 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493cdffd-343c-479f-bd43-ef499003fa60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:11.185657 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493cdffd-343c-479f-bd43-ef499003fa60 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:11.194935 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1469/2919] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:30:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:30:11.466050 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69660cee-e88d-44c9-83e9-a9dac80f09ca None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:11.468175 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-69660cee-e88d-44c9-83e9-a9dac80f09ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:11.483461 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69660cee-e88d-44c9-83e9-a9dac80f09ca None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:11.489538 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d22fd8-bec1-40b2-94e0-0642796bfc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:11.490364 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d22fd8-bec1-40b2-94e0-0642796bfc52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:11.490898 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d22fd8-bec1-40b2-94e0-0642796bfc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:11.491197 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d22fd8-bec1-40b2-94e0-0642796bfc52 admin admin] PATH_INFO: `/v3/projects/a383ec604ad64cb4847cdad308d85034` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:11.492581 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d22fd8-bec1-40b2-94e0-0642796bfc52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a383ec604ad64cb4847cdad308d85034)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:11.494581 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d22fd8-bec1-40b2-94e0-0642796bfc52 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:11.541557 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-76d22fd8-bec1-40b2-94e0-0642796bfc52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a383ec604ad64cb4847cdad308d85034', 'request_id': 'req-76d22fd8-bec1-40b2-94e0-0642796bfc52'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:11.547121 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-76d22fd8-bec1-40b2-94e0-0642796bfc52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a383ec604ad64cb4847cdad308d85034', 'request_id': 'req-76d22fd8-bec1-40b2-94e0-0642796bfc52'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:11.553207 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-76d22fd8-bec1-40b2-94e0-0642796bfc52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a383ec604ad64cb4847cdad308d85034', 'request_id': 'req-76d22fd8-bec1-40b2-94e0-0642796bfc52'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:11.567034 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-76d22fd8-bec1-40b2-94e0-0642796bfc52 admin admin] The token cache is being invalidate because project a383ec604ad64cb4847cdad308d85034 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:30:11.567402 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-76d22fd8-bec1-40b2-94e0-0642796bfc52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:11.568068 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-76d22fd8-bec1-40b2-94e0-0642796bfc52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:11.569870 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1451/2920] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:30:11 2022] DELETE /identity/v3/projects/a383ec604ad64cb4847cdad308d85034 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:30:11.575085 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd185be0-369a-45a8-9d74-1dfa47c3b13e None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:11.575368 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd185be0-369a-45a8-9d74-1dfa47c3b13e None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:11.575665 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd185be0-369a-45a8-9d74-1dfa47c3b13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:11.596330 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-fd185be0-369a-45a8-9d74-1dfa47c3b13e None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:11.597560 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-fd185be0-369a-45a8-9d74-1dfa47c3b13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:11.622104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:11.659270 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1470/2921] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:30:11.666897 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10866b-003a-460f-adb7-871727763a91 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:11.667190 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10866b-003a-460f-adb7-871727763a91 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:11.667470 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10866b-003a-460f-adb7-871727763a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:11.688382 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-6c10866b-003a-460f-adb7-871727763a91 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:11.689614 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-6c10866b-003a-460f-adb7-871727763a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:11.697440 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1452/2922] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:30:11.702286 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd185be0-369a-45a8-9d74-1dfa47c3b13e None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:11.712041 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd185be0-369a-45a8-9d74-1dfa47c3b13e None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:11.716622 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba79138-3be4-4129-8995-627d9fd215ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:11.717217 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba79138-3be4-4129-8995-627d9fd215ec admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:11.717499 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba79138-3be4-4129-8995-627d9fd215ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:11.717770 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba79138-3be4-4129-8995-627d9fd215ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:11.718419 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba79138-3be4-4129-8995-627d9fd215ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:30:11.718756 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba79138-3be4-4129-8995-627d9fd215ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:11.720337 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba79138-3be4-4129-8995-627d9fd215ec admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:11.731608 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1471/2923] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:30:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:30:11.736286 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10866b-003a-460f-adb7-871727763a91 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:11.745432 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10866b-003a-460f-adb7-871727763a91 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:11.750916 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3ace8-35d1-4e4c-bf62-93a120f28feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:11.751532 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3ace8-35d1-4e4c-bf62-93a120f28feb admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:11.751811 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3ace8-35d1-4e4c-bf62-93a120f28feb admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:11.752083 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3ace8-35d1-4e4c-bf62-93a120f28feb admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:11.752707 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d3ace8-35d1-4e4c-bf62-93a120f28feb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:11.754631 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d3ace8-35d1-4e4c-bf62-93a120f28feb admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:11.783561 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1453/2924] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:30:11 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:30:11.787790 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba79138-3be4-4129-8995-627d9fd215ec admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:11.797529 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba79138-3be4-4129-8995-627d9fd215ec admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:11.854087 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e43c9-ac5a-4bbc-a3b2-0a9460376c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:11.854710 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e43c9-ac5a-4bbc-a3b2-0a9460376c38 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:11.854995 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e43c9-ac5a-4bbc-a3b2-0a9460376c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:11.855273 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e43c9-ac5a-4bbc-a3b2-0a9460376c38 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:11.855983 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e43c9-ac5a-4bbc-a3b2-0a9460376c38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:11.857898 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e43c9-ac5a-4bbc-a3b2-0a9460376c38 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:11.878603 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1472/2925] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:30:11 2022] POST /identity/v3/users => generated 296 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:30:11.882852 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3ace8-35d1-4e4c-bf62-93a120f28feb admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:11.893552 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3ace8-35d1-4e4c-bf62-93a120f28feb admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:11.898106 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae42f73-f55b-44e4-a8a5-b2cb4deedf64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:11.898725 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae42f73-f55b-44e4-a8a5-b2cb4deedf64 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:11.899003 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae42f73-f55b-44e4-a8a5-b2cb4deedf64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:11.899274 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae42f73-f55b-44e4-a8a5-b2cb4deedf64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:11.899904 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae42f73-f55b-44e4-a8a5-b2cb4deedf64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:11.901478 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae42f73-f55b-44e4-a8a5-b2cb4deedf64 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:11.911683 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1454/2926] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:30:11.915585 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e43c9-ac5a-4bbc-a3b2-0a9460376c38 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:11.925281 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e43c9-ac5a-4bbc-a3b2-0a9460376c38 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:11.929800 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d87ca-808b-4366-8e7e-02b4867ecf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:11.930387 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d87ca-808b-4366-8e7e-02b4867ecf6c admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:11.930695 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d87ca-808b-4366-8e7e-02b4867ecf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:11.930965 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d87ca-808b-4366-8e7e-02b4867ecf6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:11.931598 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d87ca-808b-4366-8e7e-02b4867ecf6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:11.933199 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d87ca-808b-4366-8e7e-02b4867ecf6c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:11.944003 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1473/2927] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:30:11.948166 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae42f73-f55b-44e4-a8a5-b2cb4deedf64 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:11.958441 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae42f73-f55b-44e4-a8a5-b2cb4deedf64 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:11.963381 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ddb733-8748-4d82-9fb3-7f87d872e834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:11.964031 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddb733-8748-4d82-9fb3-7f87d872e834 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:11.964305 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddb733-8748-4d82-9fb3-7f87d872e834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:11.964696 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddb733-8748-4d82-9fb3-7f87d872e834 admin admin] PATH_INFO: `/v3/projects/4b95bb33dc1e4cfe9d8b6f915c7098e7/users/9a5adbf4315f41be82ee48d0ac7a6175/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:11.967916 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:11.981129 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ddb733-8748-4d82-9fb3-7f87d872e834 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b95bb33dc1e4cfe9d8b6f915c7098e7, user_id=9a5adbf4315f41be82ee48d0ac7a6175, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:11.984450 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ddb733-8748-4d82-9fb3-7f87d872e834 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:11.997186 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1455/2928] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:30:11 2022] PUT /identity/v3/projects/4b95bb33dc1e4cfe9d8b6f915c7098e7/users/9a5adbf4315f41be82ee48d0ac7a6175/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:30:12.008373 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1c44d-a03e-4c9b-bcfa-547cad32ca2f None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:12.008653 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1c44d-a03e-4c9b-bcfa-547cad32ca2f None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:12.008924 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1c44d-a03e-4c9b-bcfa-547cad32ca2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:12.037104 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-8ad1c44d-a03e-4c9b-bcfa-547cad32ca2f None None] MFA Rules not processed for user `9a5adbf4315f41be82ee48d0ac7a6175`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:12.038411 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8ad1c44d-a03e-4c9b-bcfa-547cad32ca2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:12.103069 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1474/2929] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:30:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:30:12.114188 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ddb733-8748-4d82-9fb3-7f87d872e834 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:12.115998 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-66ddb733-8748-4d82-9fb3-7f87d872e834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:12.171776 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ddb733-8748-4d82-9fb3-7f87d872e834 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:12.175293 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49903c0f-34b7-4498-a868-981af39e4a9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:12.175890 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49903c0f-34b7-4498-a868-981af39e4a9e service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:12.176169 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49903c0f-34b7-4498-a868-981af39e4a9e service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:12.176436 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49903c0f-34b7-4498-a868-981af39e4a9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:12.184576 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49903c0f-34b7-4498-a868-981af39e4a9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:12.186646 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49903c0f-34b7-4498-a868-981af39e4a9e service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:12.195161 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1456/2930] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:30:12 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:30:22.100188 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=86,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:22.191323 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=32,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:22.240468 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad1c44d-a03e-4c9b-bcfa-547cad32ca2f None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:22.301149 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad1c44d-a03e-4c9b-bcfa-547cad32ca2f None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:22.305574 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f216fa0-f42c-4f02-b14b-4d82712af2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:22.306190 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f216fa0-f42c-4f02-b14b-4d82712af2ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:22.306491 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f216fa0-f42c-4f02-b14b-4d82712af2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:22.306765 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f216fa0-f42c-4f02-b14b-4d82712af2ee admin admin] PATH_INFO: `/v3/users/9a5adbf4315f41be82ee48d0ac7a6175` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:22.308073 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f216fa0-f42c-4f02-b14b-4d82712af2ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a5adbf4315f41be82ee48d0ac7a6175)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:22.310191 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f216fa0-f42c-4f02-b14b-4d82712af2ee admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:22.356803 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0f216fa0-f42c-4f02-b14b-4d82712af2ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a5adbf4315f41be82ee48d0ac7a6175'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:22.364320 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0f216fa0-f42c-4f02-b14b-4d82712af2ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a5adbf4315f41be82ee48d0ac7a6175'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:22.371442 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0f216fa0-f42c-4f02-b14b-4d82712af2ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a5adbf4315f41be82ee48d0ac7a6175'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:22.384254 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0f216fa0-f42c-4f02-b14b-4d82712af2ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a5adbf4315f41be82ee48d0ac7a6175'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:22.384946 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0f216fa0-f42c-4f02-b14b-4d82712af2ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a5adbf4315f41be82ee48d0ac7a6175'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:22.391436 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1475/2931] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:30:22 2022] DELETE /identity/v3/users/9a5adbf4315f41be82ee48d0ac7a6175 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:30:22.395896 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed8fb8-9099-4cd7-9145-c4768ba03322 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:22.396186 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed8fb8-9099-4cd7-9145-c4768ba03322 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:22.396463 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed8fb8-9099-4cd7-9145-c4768ba03322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:22.415101 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-47ed8fb8-9099-4cd7-9145-c4768ba03322 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:22.416280 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-47ed8fb8-9099-4cd7-9145-c4768ba03322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:22.473759 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1457/2932] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:30:22.484084 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f216fa0-f42c-4f02-b14b-4d82712af2ee admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:22.485643 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0f216fa0-f42c-4f02-b14b-4d82712af2ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:22.549194 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f216fa0-f42c-4f02-b14b-4d82712af2ee admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:22.552871 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efde323-b04d-47c6-9269-cde4a3175da5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:22.553477 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efde323-b04d-47c6-9269-cde4a3175da5 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:22.553757 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efde323-b04d-47c6-9269-cde4a3175da5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:22.554030 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efde323-b04d-47c6-9269-cde4a3175da5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:22.563949 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efde323-b04d-47c6-9269-cde4a3175da5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:22.565385 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efde323-b04d-47c6-9269-cde4a3175da5 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:22.574718 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1476/2933] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:30:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:30:22.848233 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed8fb8-9099-4cd7-9145-c4768ba03322 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:22.849745 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-47ed8fb8-9099-4cd7-9145-c4768ba03322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:22.865317 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed8fb8-9099-4cd7-9145-c4768ba03322 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:22.870260 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921a9cb-e2a1-4627-ae39-925857069dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:22.870942 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921a9cb-e2a1-4627-ae39-925857069dd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:22.871223 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921a9cb-e2a1-4627-ae39-925857069dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:22.871495 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921a9cb-e2a1-4627-ae39-925857069dd5 admin admin] PATH_INFO: `/v3/projects/4b95bb33dc1e4cfe9d8b6f915c7098e7` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:22.872659 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b921a9cb-e2a1-4627-ae39-925857069dd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b95bb33dc1e4cfe9d8b6f915c7098e7)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:22.874719 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b921a9cb-e2a1-4627-ae39-925857069dd5 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:22.921752 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-b921a9cb-e2a1-4627-ae39-925857069dd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b95bb33dc1e4cfe9d8b6f915c7098e7', 'request_id': 'req-b921a9cb-e2a1-4627-ae39-925857069dd5'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:22.927245 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-b921a9cb-e2a1-4627-ae39-925857069dd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b95bb33dc1e4cfe9d8b6f915c7098e7', 'request_id': 'req-b921a9cb-e2a1-4627-ae39-925857069dd5'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:22.934096 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-b921a9cb-e2a1-4627-ae39-925857069dd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b95bb33dc1e4cfe9d8b6f915c7098e7', 'request_id': 'req-b921a9cb-e2a1-4627-ae39-925857069dd5'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:22.946568 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-b921a9cb-e2a1-4627-ae39-925857069dd5 admin admin] The token cache is being invalidate because project 4b95bb33dc1e4cfe9d8b6f915c7098e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:30:22.946856 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-b921a9cb-e2a1-4627-ae39-925857069dd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:22.947475 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-b921a9cb-e2a1-4627-ae39-925857069dd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:22.948944 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1458/2934] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:30:22 2022] DELETE /identity/v3/projects/4b95bb33dc1e4cfe9d8b6f915c7098e7 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:30:22.953948 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976efb6d-421d-443a-8df0-1bad1e954541 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:22.954309 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976efb6d-421d-443a-8df0-1bad1e954541 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:22.954698 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976efb6d-421d-443a-8df0-1bad1e954541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:22.975359 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-976efb6d-421d-443a-8df0-1bad1e954541 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:22.976544 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-976efb6d-421d-443a-8df0-1bad1e954541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:22.993912 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:23.039063 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1477/2935] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:30:23.047457 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5555c31-adec-4c24-b5a6-835a33b3d94b None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:23.047736 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5555c31-adec-4c24-b5a6-835a33b3d94b None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:23.048005 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5555c31-adec-4c24-b5a6-835a33b3d94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:23.067616 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-a5555c31-adec-4c24-b5a6-835a33b3d94b None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:23.068801 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-a5555c31-adec-4c24-b5a6-835a33b3d94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:23.076726 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1459/2936] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:30:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:30:23.080956 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976efb6d-421d-443a-8df0-1bad1e954541 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:23.090887 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976efb6d-421d-443a-8df0-1bad1e954541 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:23.096059 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194f017-cb4a-43a8-b077-2f0fb247b57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:23.096661 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194f017-cb4a-43a8-b077-2f0fb247b57d admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:23.096941 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194f017-cb4a-43a8-b077-2f0fb247b57d admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:23.097214 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194f017-cb4a-43a8-b077-2f0fb247b57d admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:23.097864 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194f017-cb4a-43a8-b077-2f0fb247b57d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 19:30:23.098167 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194f017-cb4a-43a8-b077-2f0fb247b57d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:23.099811 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194f017-cb4a-43a8-b077-2f0fb247b57d admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:23.112340 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1478/2937] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Aug 31 19:30:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 19:30:23.116608 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5555c31-adec-4c24-b5a6-835a33b3d94b None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:23.125603 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5555c31-adec-4c24-b5a6-835a33b3d94b None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:23.130169 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017de65-d4f2-469b-83a6-bf0ccd15e5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:23.130787 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017de65-d4f2-469b-83a6-bf0ccd15e5d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:23.131215 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017de65-d4f2-469b-83a6-bf0ccd15e5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:23.131488 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017de65-d4f2-469b-83a6-bf0ccd15e5d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:23.132105 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0017de65-d4f2-469b-83a6-bf0ccd15e5d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:23.133963 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0017de65-d4f2-469b-83a6-bf0ccd15e5d8 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:23.160785 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1460/2938] 10.222.0.79 () {60 vars in 1153 bytes} [Wed Aug 31 19:30:23 2022] POST /identity/v3/projects => generated 399 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:30:23.165000 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194f017-cb4a-43a8-b077-2f0fb247b57d admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:23.176048 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194f017-cb4a-43a8-b077-2f0fb247b57d admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:23.234444 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15729c36-ac23-4b6c-b85b-eed64777b754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:23.235074 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15729c36-ac23-4b6c-b85b-eed64777b754 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:23.235356 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15729c36-ac23-4b6c-b85b-eed64777b754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:23.235630 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15729c36-ac23-4b6c-b85b-eed64777b754 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:23.236254 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15729c36-ac23-4b6c-b85b-eed64777b754 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:23.238167 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15729c36-ac23-4b6c-b85b-eed64777b754 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:23.259416 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1479/2939] 10.222.0.79 () {60 vars in 1144 bytes} [Wed Aug 31 19:30:23 2022] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 19:30:23.263489 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017de65-d4f2-469b-83a6-bf0ccd15e5d8 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:23.274115 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017de65-d4f2-469b-83a6-bf0ccd15e5d8 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:23.280815 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44efc8c-9cc6-4395-91eb-d1e44fc35bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:23.281454 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44efc8c-9cc6-4395-91eb-d1e44fc35bfa admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:23.281735 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44efc8c-9cc6-4395-91eb-d1e44fc35bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:23.282009 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44efc8c-9cc6-4395-91eb-d1e44fc35bfa admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:23.282696 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44efc8c-9cc6-4395-91eb-d1e44fc35bfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:23.284293 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44efc8c-9cc6-4395-91eb-d1e44fc35bfa admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:23.294440 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1461/2940] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:30:23.298790 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15729c36-ac23-4b6c-b85b-eed64777b754 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:23.308559 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15729c36-ac23-4b6c-b85b-eed64777b754 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:23.313306 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ffcb8-d18b-4081-b131-298cf0108a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:23.313906 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ffcb8-d18b-4081-b131-298cf0108a1c admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:23.314202 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ffcb8-d18b-4081-b131-298cf0108a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:23.314471 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ffcb8-d18b-4081-b131-298cf0108a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:23.315122 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ffcb8-d18b-4081-b131-298cf0108a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:23.316736 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ffcb8-d18b-4081-b131-298cf0108a1c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:23.327734 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1480/2941] 10.222.0.79 () {58 vars in 1122 bytes} [Wed Aug 31 19:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 19:30:23.331987 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44efc8c-9cc6-4395-91eb-d1e44fc35bfa admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:23.341919 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44efc8c-9cc6-4395-91eb-d1e44fc35bfa admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:23.347136 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d494e5ac-3f47-41e6-85d5-4d079506f051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:23.347786 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494e5ac-3f47-41e6-85d5-4d079506f051 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:23.348067 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494e5ac-3f47-41e6-85d5-4d079506f051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:23.348342 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494e5ac-3f47-41e6-85d5-4d079506f051 admin admin] PATH_INFO: `/v3/projects/9849e0e2f4e048828c2204a2c97d19ca/users/41e899a36b5647b38c1375a6d5d53567/roles/27c44f922df34ac6bcb3794b111cb3da` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:23.362555 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d494e5ac-3f47-41e6-85d5-4d079506f051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9849e0e2f4e048828c2204a2c97d19ca, user_id=41e899a36b5647b38c1375a6d5d53567, role_id=27c44f922df34ac6bcb3794b111cb3da)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:23.365186 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d494e5ac-3f47-41e6-85d5-4d079506f051 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:23.379542 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1462/2942] 10.222.0.79 () {60 vars in 1483 bytes} [Wed Aug 31 19:30:23 2022] PUT /identity/v3/projects/9849e0e2f4e048828c2204a2c97d19ca/users/41e899a36b5647b38c1375a6d5d53567/roles/27c44f922df34ac6bcb3794b111cb3da => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:30:23.390387 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac814f-862e-4d79-9435-3f95a8108d06 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:23.390694 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac814f-862e-4d79-9435-3f95a8108d06 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:23.390990 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac814f-862e-4d79-9435-3f95a8108d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:23.418182 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-5dac814f-862e-4d79-9435-3f95a8108d06 None None] MFA Rules not processed for user `41e899a36b5647b38c1375a6d5d53567`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:23.419401 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5dac814f-862e-4d79-9435-3f95a8108d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:23.484730 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1481/2943] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:30:23 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 19:30:23.496680 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d494e5ac-3f47-41e6-85d5-4d079506f051 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:23.499061 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d494e5ac-3f47-41e6-85d5-4d079506f051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:23.530874 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:23.569356 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d494e5ac-3f47-41e6-85d5-4d079506f051 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:23.573044 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb14749-d845-4648-8b90-da8a73dfd310 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17e0a157474749939b6f8d2af26d7d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:23.573650 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb14749-d845-4648-8b90-da8a73dfd310 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:23.573924 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb14749-d845-4648-8b90-da8a73dfd310 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:23.574903 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb14749-d845-4648-8b90-da8a73dfd310 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:23.584255 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb14749-d845-4648-8b90-da8a73dfd310 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:23.585678 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb14749-d845-4648-8b90-da8a73dfd310 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:23.594600 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1463/2944] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:30:23 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:30:28.583504 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac814f-862e-4d79-9435-3f95a8108d06 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:28.603663 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:28.649423 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac814f-862e-4d79-9435-3f95a8108d06 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:28.653900 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131cd1f4-688c-45dc-8770-88ca56b5c9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:28.654559 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cd1f4-688c-45dc-8770-88ca56b5c9cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:28.654842 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cd1f4-688c-45dc-8770-88ca56b5c9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:28.655115 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cd1f4-688c-45dc-8770-88ca56b5c9cc admin admin] PATH_INFO: `/v3/users/41e899a36b5647b38c1375a6d5d53567` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:28.656269 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131cd1f4-688c-45dc-8770-88ca56b5c9cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=41e899a36b5647b38c1375a6d5d53567)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:28.658184 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131cd1f4-688c-45dc-8770-88ca56b5c9cc admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:28.704176 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-131cd1f4-688c-45dc-8770-88ca56b5c9cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41e899a36b5647b38c1375a6d5d53567'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:28.718035 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-131cd1f4-688c-45dc-8770-88ca56b5c9cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41e899a36b5647b38c1375a6d5d53567'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:28.727119 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-131cd1f4-688c-45dc-8770-88ca56b5c9cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41e899a36b5647b38c1375a6d5d53567'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:28.739240 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-131cd1f4-688c-45dc-8770-88ca56b5c9cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41e899a36b5647b38c1375a6d5d53567'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:28.739946 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-131cd1f4-688c-45dc-8770-88ca56b5c9cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41e899a36b5647b38c1375a6d5d53567'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:28.745922 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1482/2945] 10.222.0.79 () {58 vars in 1224 bytes} [Wed Aug 31 19:30:28 2022] DELETE /identity/v3/users/41e899a36b5647b38c1375a6d5d53567 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:30:28.750428 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100046c-5ece-4338-9b34-db4bf8cb75c0 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:28.750961 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100046c-5ece-4338-9b34-db4bf8cb75c0 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:28.751073 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100046c-5ece-4338-9b34-db4bf8cb75c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:28.770541 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-d100046c-5ece-4338-9b34-db4bf8cb75c0 None None] MFA Rules not processed for user `cf2ffbbfceaa4c36a9027a844dd4920a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 19:30:28.771736 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d100046c-5ece-4338-9b34-db4bf8cb75c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:28.833677 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1464/2946] 10.222.0.79 () {58 vars in 958 bytes} [Wed Aug 31 19:30:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 19:30:28.843899 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131cd1f4-688c-45dc-8770-88ca56b5c9cc admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:28.845369 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-131cd1f4-688c-45dc-8770-88ca56b5c9cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:28.904533 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131cd1f4-688c-45dc-8770-88ca56b5c9cc admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:28.908273 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3211c29-bc55-456c-a7c2-915e79d7f6d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a91998a2818444a595adc06f1f481fe1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:28.908870 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3211c29-bc55-456c-a7c2-915e79d7f6d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:28.909149 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3211c29-bc55-456c-a7c2-915e79d7f6d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:28.909422 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3211c29-bc55-456c-a7c2-915e79d7f6d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:28.919565 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3211c29-bc55-456c-a7c2-915e79d7f6d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:28.921285 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3211c29-bc55-456c-a7c2-915e79d7f6d9 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:28.932202 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1483/2947] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:30:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:30:29.202555 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100046c-5ece-4338-9b34-db4bf8cb75c0 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:30:29.204249 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d100046c-5ece-4338-9b34-db4bf8cb75c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:30:29.216792 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100046c-5ece-4338-9b34-db4bf8cb75c0 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:30:29.222007 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667052b3-3720-40b4-a1d3-f3b134f9687a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf2ffbbfceaa4c36a9027a844dd4920a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eabc1ce4c37941459d2c18a04fbaba99', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:30:29.222680 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667052b3-3720-40b4-a1d3-f3b134f9687a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:30:29.222991 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667052b3-3720-40b4-a1d3-f3b134f9687a admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:30:29.223264 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667052b3-3720-40b4-a1d3-f3b134f9687a admin admin] PATH_INFO: `/v3/projects/9849e0e2f4e048828c2204a2c97d19ca` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:30:29.224397 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667052b3-3720-40b4-a1d3-f3b134f9687a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9849e0e2f4e048828c2204a2c97d19ca)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:30:29.226310 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667052b3-3720-40b4-a1d3-f3b134f9687a admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:30:29.275441 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-667052b3-3720-40b4-a1d3-f3b134f9687a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9849e0e2f4e048828c2204a2c97d19ca', 'request_id': 'req-667052b3-3720-40b4-a1d3-f3b134f9687a'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:29.281265 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-667052b3-3720-40b4-a1d3-f3b134f9687a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9849e0e2f4e048828c2204a2c97d19ca', 'request_id': 'req-667052b3-3720-40b4-a1d3-f3b134f9687a'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:29.288044 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-667052b3-3720-40b4-a1d3-f3b134f9687a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9849e0e2f4e048828c2204a2c97d19ca', 'request_id': 'req-667052b3-3720-40b4-a1d3-f3b134f9687a'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:29.301524 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-667052b3-3720-40b4-a1d3-f3b134f9687a admin admin] The token cache is being invalidate because project 9849e0e2f4e048828c2204a2c97d19ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 19:30:29.301817 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-667052b3-3720-40b4-a1d3-f3b134f9687a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:29.302445 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-667052b3-3720-40b4-a1d3-f3b134f9687a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 19:30:29.304215 dv-cinder-852210-6-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1465/2948] 10.222.0.79 () {58 vars in 1233 bytes} [Wed Aug 31 19:30:29 2022] DELETE /identity/v3/projects/9849e0e2f4e048828c2204a2c97d19ca => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 19:30:38.927971 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:39.297775 dv-cinder-852210-6-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:08.654986 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3211c29-bc55-456c-a7c2-915e79d7f6d9 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 19:31:08.656402 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e3211c29-bc55-456c-a7c2-915e79d7f6d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:08.724313 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3211c29-bc55-456c-a7c2-915e79d7f6d9 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 19:31:08.782186 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245732a-f70b-4dae-aba5-caf42db908b4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece00ea631594381bf1c27cfc2ece6f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9e550ea75dd4245bd9c2bcd6322c507', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 19:31:08.782830 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245732a-f70b-4dae-aba5-caf42db908b4 service placement] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 19:31:08.783111 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245732a-f70b-4dae-aba5-caf42db908b4 service placement] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 19:31:08.783384 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245732a-f70b-4dae-aba5-caf42db908b4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 19:31:08.785138 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a245732a-f70b-4dae-aba5-caf42db908b4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 19:31:08.796149 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a245732a-f70b-4dae-aba5-caf42db908b4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 19:31:08.797728 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a245732a-f70b-4dae-aba5-caf42db908b4 service placement] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 19:31:08.807559 dv-cinder-852210-6-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1484/2949] 10.222.0.79 () {60 vars in 1365 bytes} [Wed Aug 31 19:31:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 19:31:18.803347 dv-cinder-852210-6-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=58 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}